Machine Learning Engineer, Foundation Model Services

Apple is hiring a Machine Learning Engineer, Foundation Model Services to help build production-grade systems for serving large foundation models in real time.

Responsibilities

• Collaborate with product teams to deliver production-grade solutions that enable real-time model serving for customers
• Work with foundation model researchers to prototype and develop inference for new model architectures
• Build tools to identify and remove performance bottlenecks across hardware platforms and varied use cases
• Write high-quality code and ramp quickly in a fast-moving field
• Take ownership of larger parts of the system to expand impact

Requirements

• 2+ years of industry experience building and shipping production software and/or machine learning systems
• Proficiency in a modern programming language such as Go or Python
• Experience deploying and operating services on a cloud platform (AWS, Azure, GCP, or equivalent) using containers and Kubernetes/Docker
• 5+ years of industry experience in ML technologies, including LLMs, Machine Learning, NLP, Information Retrieval, and Statistics
• Experience building or operating high-throughput, low-latency services
• Strong communication and collaboration skills to partner across research and product teams
• Bachelor’s degree or higher in Computer Science or a related technical field

Technologies

• Go, Python
• AWS, Azure, GCP
• Containers, Kubernetes, Docker
• Nvidia TensorRT-LLM, vLLLM
• DeepSpeed, Nvidia Triton Server

Preferred Qualifications

• Familiarity with Nvidia TensorRT-LLM, vLLLM, DeepSpeed, and Nvidia Triton Server

Location

• Santa Clara, CA (onsite)

Compensation

• USD 175,000 - 308,500 per year

Education

• Bachelor’s degree or higher in Computer Science or related technical field

Benefits

• Comprehensive medical and dental coverage
• Retirement benefits
• Discounted products and free services
• Reimbursement for certain educational expenses, including tuition
• Discretionary employee stock programs (opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs)
• Eligible for discretionary restricted stock unit awards
• Apple stock at a discount if voluntarily participating in the Employee Stock Purchase Plan
• Additionally, this role might be eligible for discretionary bonuses or commission payments
• Relocation may be available