Software Engineer, ML Accelerators

This role is focused on building the ML compiler stack and inference infrastructure for a next-generation AI compute platform with hardware acceleration and software/hardware co-design. You will take a full-stack engineering approach to connect AI workloads to low-level hardware operators and deliver high-performance inference.

Role Focus

You will work across the software and systems layers required to run AI inference efficiently. The work includes designing compiler components that bridge AI workloads to hardware operators, as well as the supporting software infrastructure needed for high-performance inference.

Responsibilities

• Own a full-stack software engineering role centered on the ML compiler and inference infrastructure.
• Design and develop an ML compiler stack that connects AI workloads to low-level hardware (HW) operators.
• Design and develop software infrastructure to enable high-performance inference.
• Drive software/hardware co-design, including kernel optimization, performance tuning, and debugging.

Required Qualifications

• Bachelor’s degree in Computer Science, a related technical field, or equivalent practical experience.
• Experience building software using Python and C++.
• Experience working with ML hardware accelerators, ML compiler stacks (for example, JAX, PyTorch, XLA), and kernel development.

Technical Skills

• Python
• C++
• JAX
• PyTorch
• XLA

Preferred Qualifications

• PhD in Computer Engineering, Computer Science, or a related field.
• 2 years of experience with full-stack system development for hardware accelerators.
• 2 years of experience collaborating on hyper-scalar software development and applying engineering best practices.
• Experience scoping, planning, and executing projects aligned with team goals in ambiguous environments.

Compensation and Location

• Location: San Francisco, CA (onsite)
• Base salary: USD 174,000 - 252,000 per year
• Bonus and equity: 15% bonus target + equity + benefits
• US total reference: $174000 - $252000 (USD) + 15% bonus target + equity + benefits

Education

Bachelor’s degree in Computer Science, a related technical field, or equivalent practical experience.

About the Team and Mission

The team is building a next-generation compute platform for AI inference workloads, emphasizing memory technologies, hardware acceleration, and software/hardware co-design. The organization brings together scientists and engineers working on advancing machine learning for Google and industry, with a focus on safety and ethics as top priorities, and on applying technology for public benefit and scientific discovery.