DeveloperJobs.io
← Back to all jobs

Job Description

Build evaluation systems for personalized, agentic search quality across Apple products.

Responsibilities

  • Create scalable, automated, end-to-end evaluation systems for models and search-powered applications
  • Develop new methods for data generation and data quality assessment to support personal agentic search evaluation
  • Design and implement offline and online metrics to measure quality at both product and component levels for personal agentic search
  • Work with partner teams to define evaluation and data requirements, align on priorities, and identify improvements for the personal search stack
  • Set a long-term technical direction for personal search quality by spotting problem areas and driving solutions across the roadmap

Requirements

  • Experience designing and building production ML systems and applications in areas such as search, NLP, recommendation systems, or information retrieval
  • Experience with data collection and/or data generation and/or data quality assessment across language, image, or multi-modal data
  • Strong background in developing quality metrics, interpreting evaluation results, and communicating findings to an executive audience
  • Master’s or Ph.D. in Computer Science, Engineering, Statistics, or related field, or equivalent industry experience
  • 6+ years of industry experience building machine learning or ML evaluation systems at scale
  • Strong software engineering skills in mainstream languages including Python and C/C++
  • Ability to prototype ideas and solutions quickly, with strong critical analysis
  • Strong communication skills and experience driving solutions in collaboration with partner teams
  • Bachelor’s degree in Computer Science, Engineering, Statistics, or related field

Technologies

  • Python
  • C/C++

Location

  • Cupertino, CA (onsite)

Pay & Benefits

  • Base pay range: USD 184,700 - 324,800 per year
  • Medical and dental coverage
  • Retirement benefits
  • Discounted products and free services
  • Education reimbursement for certain expenses, including tuition
  • Discretionary bonuses or commission payments, and relocation (if eligible)
  • Apple shareholder opportunity via discretionary employee stock programs (RSUs) and eligibility for Employee Stock Purchase Plan at a discount
  • Opportunity to progress as you grow and develop within the role

Similar Jobs