Trainium

Trainium Developer Jobs

2 jobs found

1mo ago

Software Engineer- AI/ML, AWS Neuron Distributed Training - Performance Optimization

Annapurna Labs (U.S.) Inc. Cupertino, CA

Cupertino, CA

1mo ago Closed

$144k - $194k/yr Full time AWS Aws Neuron Cloud

This position is no longer accepting applications (closed Jul 21, 2026).

Job Description

Annapurna Labs (U.S.) Inc., based in Cupertino, is seeking a Software Engineer to join the AWS Neuron Distributed Training team. This role centers on performance optimization for distributed training on Trainium, collaborating with PyTorch, JAX, and the Neuron compiler and runtime to boost throughput and efficiency for large-scale models.

Responsibilities

Lead efforts to optimize distributed training performance on Trainium, with a primary focus on maximizing training throughput, model FLOPs utilization, and overall efficiency across the Neuron software stack.
Collaborate across PyTorch, JAX, and the Neuron compiler and runtime to enable and tune large-scale training workloads on the latest Trainium instances.

Requirements

3+ years of non-internship professional software development experience
2+ years of non-internship design or architecture experience (design patterns, reliability and scaling) of new and existing systems
Experience programming with at least one software programming language
3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
Bachelor's degree in computer science or equivalent

Technologies

PyTorch
JAX
AWS Neuron
Neuron compiler
Neuron runtime
Trainium
Trn3/Trn2/Trn1
Inf1/Inf2 servers

Benefits

Health insurance
401(k) matching
Paid time off
Parental leave
Sign-on payments
Restricted stock units (RSUs)
Basic Life & AD&D insurance
Supplemental life plans
Employee Assistance Program (EAP)
Mental Health Support
Medical Advice Line
Flexible Spending Accounts
Adoption and Surrogacy Reimbursement coverage

Description

Annapurna Labs designs silicon and software that accelerates innovation. Customers rely on us to create cloud solutions that solve challenges that were unimaginable a short time ago—even yesterday. Our custom chips, accelerators, and software stacks enable us to take on technical challenges that have never been seen before, and deliver results that help our customers change the world. AWS Neuron is the complete software stack for the AWS Trainium and Inferentia cloud-scale machine learning accelerators.

View full job page →

1mo ago

Software Engineer I - AI/ML, AWS Neuron Distributed Training

Annapurna Labs (U.S.) Inc. Cupertino, CA

Cupertino, CA

1mo ago Closed

$127k - $185k/yr Full time AWS Aws Neuron Cloud

This position is no longer accepting applications (closed Jul 7, 2026).

Job Description

Annapurna Labs (U.S.) Inc is seeking a Software Engineer I to contribute to AI and ML distributed training initiatives in Cupertino, onsite. This role centers on optimizing large-scale models on AWS Trainium, including mixed-precision training and framework extensions, in collaboration with hardware and AWS teams. The position offers a salary range of USD 127,100 - 185,000 per yearly.

Responsibilities

Help design and implement distributed training solutions for large-scale ML models running on Trainium instances.
Extend and optimize distributed training frameworks such as FSDP, torchtitan, and Hugging Face libraries within the Neuron ecosystem.
Develop and optimize mixed-precision and low-precision training techniques, including BF16, FP8, and emerging numerical formats to boost training throughput while preserving accuracy.
Implement precision-aware training strategies, loss scaling, and careful gradient management to maintain stability across reduced precision formats.
Profile, analyze, and tune end-to-end training pipelines to maximize performance on Trainium hardware.
Collaborate with hardware, compiler, and runtime teams to understand system constraints and unlock new capabilities.
Work with AWS solution architects and customers to support the deployment and optimization of training workloads at scale.

Requirements

Bachelor's degree or higher in computer science, computer engineering, or a related field, or equivalent
1+ years of programming experience in at least one software language (including academic projects, internships, or research)
Experience with software development practices including code reviews, source control, testing, and build processes
Experience with machine learning concepts and at least one ML framework (PyTorch, JAX, or TensorFlow)

Technologies

FSDP
torchtitan
Hugging Face libraries
PyTorch
JAX
TensorFlow
Trainium
AWS Neuron
BF16
FP8

Benefits

Health insurance
401(k) matching
Paid time off
Parental leave
Sign-on payments
Restricted stock units (RSUs)
Flexible Spending Accounts
Employee Assistance Program (EAP)
Mental Health Support
Adoption and Surrogacy Reimbursement

View full job page →

Trainium Developer Jobs

Software Engineer- AI/ML, AWS Neuron Distributed Training - Performance Optimization

Software Engineer I - AI/ML, AWS Neuron Distributed Training

Get Trainium Developer Jobs alerts