DeveloperJobs.io
← Back to all jobs
Apple

Senior Machine Learning Engineer, Multimodal Intelligence for Apple Pencil

Cupertino, CA $185k - $325k/yr Full time Posted 1d ago

Job Description

Drive multimodal intelligence for Apple Pencil by building ML systems that understand free-form ink and power generative features across prototyping and production.

Responsibilities

  • Build machine learning systems that bring intelligence to Apple Pencil.
  • Work across perception and generation, including understanding rich free-form ink in its full multimodal context.
  • Develop generative features that create and transform content from ink input.
  • Apply large language models and classical machine learning, selecting the right approach for each feature.
  • Own problems end to end: frame interactions, prototype on iPad with real Apple Pencil input, evaluate results, and ship.
  • Partner closely with design, frameworks, and app teams across Apple.
  • Stay current with AI research and rapidly apply impactful developments.
  • Pioneer new ideas tailored specifically for Apple Pencil and Apple’s ecosystem, with an emphasis on on-device optimization.

Requirements

  • 5+ years of industry experience building ML-powered product features, including hands-on multimodal model work.
  • Experience taking an ML system from prototype through evaluation to production deployment.
  • Strong software engineering skills in Python and at least one of: Swift, C++, or Objective-C.
  • Experience with a modern ML framework such as PyTorch or JAX.
  • MS or PhD in Computer Science or a related field, or equivalent industry experience.
  • Experience building agentic workflows and designing LLM-based evaluation judges for LLM systems.

Preferred Qualifications

  • Proficiency with agentic coding tools and workflows for prototyping, optimization, and developing production code.
  • Experience with generative models for images or other visual content.
  • Experience with on-device machine learning, including quantization, distillation, latency, and memory budgets.

Technology

  • Python, Swift, C++, Objective-C
  • PyTorch, JAX
  • Large language models, multimodal models
  • iPad, Apple Pencil
  • LLM-based evaluation judges

Compensation

  • USD 184,700 - 324,800 per year

Location

  • Cupertino, CA (onsite)

Benefits

  • Comprehensive medical and dental coverage
  • Retirement benefits
  • Discounted products and free services
  • Reimbursement for certain educational expenses, including tuition

Similar Jobs