Senior Software Engineer

Location: Ramat Hahayal, Tel Aviv

Employment Type: Full-time

Company: GSI Technology – A publicly traded, international high-tech company (NASDAQ: GSIT) developing the cutting-edge Gemini® Associative Processing Unit (APU) for computer-in-memory acceleration.

GSI is pioneering the Gemini APU—a cutting-edge, game-changing processor designed to accelerate compute-intensive tasks like large language models, machine learning, advanced image processing, and radar imaging.

If you're passionate about architecting high-performance software systems, implementing advanced algorithms, and drilling into low-level technical details, this is the role for you.

We’re seeking a dynamic and fast-learning engineer with a passion for diving deep into large language model implementations, and a keen focus on performance optimization and efficient execution.

The Role

We are looking for a Senior Software Engineer to implement AI models ( CNN,LLM,VLM) with C++. This roll sits at the intersection of AI Algorithm and our cutting edge APU Architecture .

At GSI Technology, we don't just use AI chips—we build them. We are developing the Gemini® APU, a compute-in-memory processor designed to accelerate massive workloads like LLMs and VLMs.

We are looking for an architecturally-minded engineer who understands hardware constraints and can take complex AI algorithms (written in Python) and optimize them to run at lightning speed on our proprietary hardware (using C/C++).

Who You Are

• You are a Software Engineer who is curious about AI models implementation.
• You understand what happens "under the hood" when software talks to hardware (memory management, caching, latency).
• You are "Open Minded" ,you enjoy tackling unsolved problems and aren't afraid to learn a new proprietary architecture from scratch.

Key Responsibilities

• Bridge the Gap: Translate high-level AI models (LLMs, Vision Transformers) from Python reference code into highly optimized C/C++ implementations for the Gemini APU.
• System Architecture: Design and maintain the software stack and libraries that allow customers to run AI workloads on our hardware.
• Performance Tuning: Squeeze every bit of performance out of the chip. Deal with memory bandwidth, latency, and compute constraints.
• Algorithm Engineering: Adapt standard algorithms (CNNs, Transformers) to fit a unique compute-in-memory architecture.
• Collaborate: Work closely with the Hardware design team to influence the next generation of chips and with the Data Science team to understand the workloads.
• Developing software compilers tools.

Must-Have Qualifications

• B.Sc. in Computer Science or Electrical Engineering.
• 5+ years of software development experience with a strong focus on C/C++ and Python.
• Embedded/Systems Background: Experience with RT-Embedded, DSP, or low-level driver development. You understand registers, memory hierarchy, and pointers.
• Algorithmic Mindset: You can look at a mathematical formula or an algorithm and understand how to implement it efficiently in code.
• Architecture Knowledge: Understanding of how processors work (SIMD, Vector processing, Caches, Pipelines).

Advantages (We will teach you the rest!)

• Experience with CUDA, OpenCL, or Writing Kernels.
• Understanding of Deep Learning primitives (Quantization, Pruning, Matrix Multiplication).
• Experience writing compilers, assemblers, or SDKs.
• Background in Computer Vision or Signal Processing pipelines.

Why Join GSI?

You will not just be writing code; you will be defining how a new class of processor consumes software. If you love deep technical challenges and want to work on the bare metal of the AI revolution, apply now.

Privacy Statement

All applications will be handled with strict confidentiality. Your information will not be shared without your consent.