Software Engineer

Location: Ramat Hahayal, Tel Aviv

Employment Type: Full-time

Company: GSI Technology – A publicly traded, international high-tech company (NASDAQ: GSIT) developing the cutting-edge Gemini® Associative Processing Unit (APU) for computer-in-memory acceleration.

GSI is pioneering the Gemini APU - a cutting-edge, game-changing processor designed to accelerate compute-intensive tasks like large language models, machine learning, advanced image processing, and radar imaging.

If you're passionate about architecting high-performance software systems, implementing advanced algorithms, and drilling into low-level technical details, this is the role for you.

We’re seeking a dynamic and fast-learning engineer with a passion for diving deep into large language model implementations, and a keen focus on performance optimization and efficient execution.

What you’ll be owning:

• Deep dive into our cutting edge associative HW processing unit
• Design, build, and optimize low-level microcode - including instruction scheduling, memory access patterns, and control flow -for our custom Associative Processing architecture.
• You'll be working directly with a novel instruction set and hardware behaviors to craft routines that unlock parallelism and maximize throughput. This involves writing cycle-aware logic for compute units, managing hardware state transitions, and tuning for ultra-low latency across deeply pipelined data paths
• Prototype, and iterate on diverse workloads—including transformer-based LLM inference, OpenCV pipelines, FFTs, and edge ML use cases -pushing the boundaries of distributed compute and memory co-location

Required Technical Expertise:

• Proven track record developing and optimizing software algorithms with deep consideration for hardware architecture, memory bandwidth, and system constraints
• Strong understanding of processor architecture fundamentals—caches, pipeline stages, execution units, and memory hierarchies
• Ability to interpret detailed hardware specifications and translate them into robust, efficient software solution

Qualifications:

• B.Sc. or M.Sc. in Computer Science, Electrical Engineering, Software Engineering
• 5+ years of professional C/C++ development focused on low-level programming or microcode for hardware processing units (e.g., CPU, GPU)

Preferred Qualifications / Additional Skills:

• Practical experience with microcode development and optimization
• Proficiency in assembly language programming
• Strong understanding of deep learning or computer vision algorithms, architectures, and frameworks

Privacy Statement

All applications will be handled with strict confidentiality. Your information will not be shared without your consent.