Senior Machine Learning Engineer
Job Description
Apple’s AI Platform team builds and ships major components of the ML infrastructure platform behind large-scale model training and generative AI applications. In this role (onsite in Cupertino, CA), you will focus on the data layer that training depends on, delivering scalable ingestion, versioning, lineage, governance, and high-throughput data loading into training fleets. You will help shape how AI models are built and scaled across the full ML lifecycle, from experimentation to deployment.
What you’ll do
- Own and ship major components of the AI Platform team’s platform for ML data and features.
- Build the data layer for large-scale model training, covering ingestion, versioning, lineage, and governance, plus high-throughput data loading on the way out to the training fleet.
- Develop a platform for ML data and features that powers advanced GenAI applications, including embeddings (generation, evaluation, ANN search, multimodal support), AI Ops, efficient inference, and a modern feature platform that streamlines experimentation.
- Contribute to how AI models are built, optimized, and scaled across the end-to-end ML lifecycle from experimentation through deployment.
- Deliver scalable infrastructure that helps teams use the platform effectively.
Experience and background
- 5+ years of work experience in machine learning infrastructure, distributed data systems, or a related field.
- 5+ years building and shipping data or ML infrastructure and systems in production.
- Experience operating production systems, including monitoring, observability, on-call, and incident response.
- Strong programming skills in Python, plus a systems language for performance-critical work (with Rust strongly preferred; C++ or Go acceptable).
- Familiarity with columnar and lakehouse formats such as Parquet, Iceberg, Delta, or Lance, including trade-offs.
- Hands-on performance engineering for I/O-bound workloads using tools and approaches such as Arrow, zero-copy, memory mapping, async I/O, and high-throughput object storage access patterns.
- Working knowledge of the end-to-end ML workflow and how training and inference workloads consume data.
- Knowledge of modern ML and generative techniques (transformers, diffusion, retrieval-augmented generation, fine-tuning) at a level needed to design for downstream consumers.
- Experience designing and operating scalable, highly available systems with a focus on engineer usability.
- Strong collaboration skills and written and verbal communication.
- B.S., M.S., or Ph.D. in Computer Science, Computer Engineering, or equivalent practical experience.
Technologies you may work with
Python, Rust, C++, Go, Parquet, Iceberg, Delta, Lance, Arrow, transformers, diffusion, retrieval-augmented generation, fine-tuning, PyTorch, JAX, TensorFlow, Ray Data, NVIDIA DALI, WebDataset, Mosaic StreamingDataset, DataHub, OpenLineage, Unity Catalog, Spark, Daft, Polars, DuckDB, Docker, Kubernetes.
Compensation and benefits
Base pay range: USD 184,700 - 324,800 per year. Base pay depends on skills, qualifications, experience, and location.
- Comprehensive medical and dental coverage
- Retirement benefits
- Discounted products and free services
- Reimbursement for certain educational expenses, including tuition
- Discretionary employee stock programs (including discretionary restricted stock unit awards) and eligibility for the Employee Stock Purchase Plan at a discount
- Opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs
- Role may be eligible for discretionary bonuses or commission payments and relocation
Preferred qualifications
- Deep experience with the data-loading and dataset-access layer of a modern ML framework (PyTorch, JAX, or TensorFlow).
- Experience with distributed data-loading frameworks for ML, such as Ray Data, NVIDIA DALI, WebDataset, or Mosaic StreamingDataset.
- Experience feeding data to GPU or TPU fleets at scale and keeping them saturated.
- Experience with data lineage and governance systems like DataHub, OpenLineage, Unity Catalog, or equivalent.
- Contributions to or operational experience with Spark, Daft, Polars, or DuckDB internals.
- Containerization and orchestration experience (Docker, Kubernetes).