Sr. Machine Learning Engineer
Job Description
Amazon Ads is hiring a Senior Machine Learning Engineer to strengthen machine learning infrastructure that supports ad relevance at scale. In this role, you will help set architectural direction across large-scale training, real-time inference, and LLM-based GenAI workloads, partnering closely with applied scientists to deliver end-to-end ML pipelines.
You will lead technical execution for production systems that drive reliable model performance, from model training and evaluation through deployment and serving, while also establishing best practices that extend beyond your immediate team.
Responsibilities
- Lead development of LLM inference infrastructure for next-generation GenAI workloads at Amazon Ads scale, including defining technical strategy, evaluating tradeoffs, and delivering production-ready solutions
- Own architectural direction for large-scale ML training and real-time inference systems, driving improvements in scalability, automation, and efficiency across the organization
- Partner with applied scientists to design and optimize end-to-end ML pipelines, from model training and evaluation through deployment and serving
- Establish ML infrastructure best practices and contribute to cross-team architectural decisions to influence technical direction beyond the immediate team
- Make principled tradeoff decisions on complex, ambiguous problems in a fast-moving GenAI environment and deliver results independently
- Mentor engineers on the team and serve as a technical resource for ML infrastructure expertise
Requirements
- 5+ years of non-internship professional software development experience
- 5+ years of programming with experience in at least one software programming language
- 5+ years leading design or architecture (including design patterns, reliability, and scaling) of new and existing systems
- Experience mentoring, serving as a tech lead, or leading an engineering team
- 5+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations
- Bachelor’s degree in computer science or equivalent
Benefits
- Comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance, and option for Supplemental life plans), EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, and Adoption and Surrogacy Reimbursement coverage
- 401(k) matching
- Paid time off
- Parental leave
- Sign-on payments
- Restricted stock units (RSUs)
Location: New York, NY (onsite). Compensation: USD 193,300 - 227,400 per yearly.