Software Engineer- AI/ML, AWS Neuron Distributed Training - Performance Optimization

Annapurna Labs (U.S.) Inc., based in Cupertino, is seeking a Software Engineer to join the AWS Neuron Distributed Training team. This role centers on performance optimization for distributed training on Trainium, collaborating with PyTorch, JAX, and the Neuron compiler and runtime to boost throughput and efficiency for large-scale models.

Responsibilities

• Lead efforts to optimize distributed training performance on Trainium, with a primary focus on maximizing training throughput, model FLOPs utilization, and overall efficiency across the Neuron software stack.
• Collaborate across PyTorch, JAX, and the Neuron compiler and runtime to enable and tune large-scale training workloads on the latest Trainium instances.

Requirements

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture experience (design patterns, reliability and scaling) of new and existing systems
• Experience programming with at least one software programming language
• 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Bachelor's degree in computer science or equivalent

Technologies

• PyTorch
• JAX
• AWS Neuron
• Neuron compiler
• Neuron runtime
• Trainium
• Trn3/Trn2/Trn1
• Inf1/Inf2 servers

Benefits

• Health insurance
• 401(k) matching
• Paid time off
• Parental leave
• Sign-on payments
• Restricted stock units (RSUs)
• Basic Life & AD&D insurance
• Supplemental life plans
• Employee Assistance Program (EAP)
• Mental Health Support
• Medical Advice Line
• Flexible Spending Accounts
• Adoption and Surrogacy Reimbursement coverage

Description

Annapurna Labs designs silicon and software that accelerates innovation. Customers rely on us to create cloud solutions that solve challenges that were unimaginable a short time ago—even yesterday. Our custom chips, accelerators, and software stacks enable us to take on technical challenges that have never been seen before, and deliver results that help our customers change the world. AWS Neuron is the complete software stack for the AWS Trainium and Inferentia cloud-scale machine learning accelerators.