Inference Infrastructure Developer Jobs

1 job found

Today

Software Engineer, ML Accelerators

DeepMind San Francisco, CA

San Francisco, CA

Today

$174k - $252k/yr Full time Ai Accelerators Engineer Engineering

Apply Now

Job Description

This role is focused on building the ML compiler stack and inference infrastructure for a next-generation AI compute platform with hardware acceleration and software/hardware co-design. You will take a full-stack engineering approach to connect AI workloads to low-level hardware operators and deliver high-performance inference.

Role Focus

You will work across the software and systems layers required to run AI inference efficiently. The work includes designing compiler components that bridge AI workloads to hardware operators, as well as the supporting software infrastructure needed for high-performance inference.

Responsibilities

Own a full-stack software engineering role centered on the ML compiler and inference infrastructure.
Design and develop an ML compiler stack that connects AI workloads to low-level hardware (HW) operators.
Design and develop software infrastructure to enable high-performance inference.
Drive software/hardware co-design, including kernel optimization, performance tuning, and debugging.

Required Qualifications

Bachelor’s degree in Computer Science, a related technical field, or equivalent practical experience.
Experience building software using Python and C++.
Experience working with ML hardware accelerators, ML compiler stacks (for example, JAX, PyTorch, XLA), and kernel development.

Technical Skills

Python
C++
JAX
PyTorch
XLA

Preferred Qualifications

PhD in Computer Engineering, Computer Science, or a related field.
2 years of experience with full-stack system development for hardware accelerators.
2 years of experience collaborating on hyper-scalar software development and applying engineering best practices.
Experience scoping, planning, and executing projects aligned with team goals in ambiguous environments.

Compensation and Location

Location: San Francisco, CA (onsite)
Base salary: USD 174,000 - 252,000 per year
Bonus and equity: 15% bonus target + equity + benefits
US total reference: $174000 - $252000 (USD) + 15% bonus target + equity + benefits

Education

Bachelor’s degree in Computer Science, a related technical field, or equivalent practical experience.

About the Team and Mission

The team is building a next-generation compute platform for AI inference workloads, emphasizing memory technologies, hardware acceleration, and software/hardware co-design. The organization brings together scientists and engineers working on advancing machine learning for Google and industry, with a focus on safety and ethics as top priorities, and on applying technology for public benefit and scientific discovery.

View full job page →

Get Inference Infrastructure Developer Jobs alerts

New Inference Infrastructure Developer Jobs, daily.