Senior Machine Learning Engineer, Multimodal Intelligence for Apple Pencil
Job Description
Drive multimodal intelligence for Apple Pencil by building ML systems that understand free-form ink and power generative features across prototyping and production.
Responsibilities
- Build machine learning systems that bring intelligence to Apple Pencil.
- Work across perception and generation, including understanding rich free-form ink in its full multimodal context.
- Develop generative features that create and transform content from ink input.
- Apply large language models and classical machine learning, selecting the right approach for each feature.
- Own problems end to end: frame interactions, prototype on iPad with real Apple Pencil input, evaluate results, and ship.
- Partner closely with design, frameworks, and app teams across Apple.
- Stay current with AI research and rapidly apply impactful developments.
- Pioneer new ideas tailored specifically for Apple Pencil and Apple’s ecosystem, with an emphasis on on-device optimization.
Requirements
- 5+ years of industry experience building ML-powered product features, including hands-on multimodal model work.
- Experience taking an ML system from prototype through evaluation to production deployment.
- Strong software engineering skills in Python and at least one of: Swift, C++, or Objective-C.
- Experience with a modern ML framework such as PyTorch or JAX.
- MS or PhD in Computer Science or a related field, or equivalent industry experience.
- Experience building agentic workflows and designing LLM-based evaluation judges for LLM systems.
Preferred Qualifications
- Proficiency with agentic coding tools and workflows for prototyping, optimization, and developing production code.
- Experience with generative models for images or other visual content.
- Experience with on-device machine learning, including quantization, distillation, latency, and memory budgets.
Technology
- Python, Swift, C++, Objective-C
- PyTorch, JAX
- Large language models, multimodal models
- iPad, Apple Pencil
- LLM-based evaluation judges
Compensation
- USD 184,700 - 324,800 per year
Location
- Cupertino, CA (onsite)
Benefits
- Comprehensive medical and dental coverage
- Retirement benefits
- Discounted products and free services
- Reimbursement for certain educational expenses, including tuition