AIML - Engineering Manager, ML Systems Evaluation Engineering

A leading technology company that creates innovative products including iPhone, Mac, and services like Siri.
$219,300 - $329,600
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS

Description For AIML - Engineering Manager, ML Systems Evaluation Engineering

Apple's Global Evaluation Engineering team within the AIML organization is seeking an Engineering Manager to lead the evaluation of machine learning systems globally. This role focuses on driving the evaluation of large-scale, end-to-end ML systems, particularly for Siri and Apple Intelligence products deployed across 40 languages and multiple Apple platforms.

The position offers an opportunity to work at the forefront of AI technology, directly impacting products used by millions of people worldwide. You'll be responsible for crafting success metrics, defining program scope/vision, and ensuring quality delivery in production. The role involves close collaboration with multiple engineering teams and requires expertise in ML system evaluation.

As an Engineering Manager, you'll lead initiatives to assess Apple Intelligence quality at scale, coordinate cross-functional efforts, and drive innovation in evaluation methodologies. The position offers competitive compensation, including base pay between $219,300 and $329,600, plus additional benefits such as stock options and comprehensive healthcare.

This is an ideal opportunity for someone with strong technical leadership experience in ML systems and a passion for driving quality in AI products. You'll be working in Apple's dynamic environment, contributing to groundbreaking technology while having access to extensive resources and professional growth opportunities. The role combines technical expertise with strategic leadership, making it perfect for those looking to make a significant impact in AI technology at a global scale.

Last updated 3 hours ago

Responsibilities For AIML - Engineering Manager, ML Systems Evaluation Engineering

  • Partner with cross-functional teams to define datasets, metrics, quality plans, and evaluation methodologies
  • Coordinate the execution, tracking, and reporting of quality metrics for Siri and ML-powered systems
  • Be the liaison among Product, Engineering, and Eval organizations
  • Optimize and coordinate Siri evaluation and ensure issues are addressed promptly before product release
  • Participate in the creation of new evaluation datasets and strategies for Apple Intelligence

Requirements For AIML - Engineering Manager, ML Systems Evaluation Engineering

  • 5+ years engineering management experience working with E2E systems, preferably ML-powered
  • Experience managing projects spanning multiple cross-functional teams
  • Experience with testing and evaluating complex Machine Learning products
  • Experience with ML development lifecycle, including ML algorithm development and accuracy hillclimbing
  • M.S. in Computer Science or equivalent (preferred)
  • Outstanding communication and presentation abilities
  • Self-motivated and proactive, with multi-tasking capabilities

Benefits For AIML - Engineering Manager, ML Systems Evaluation Engineering

Medical Insurance
Dental Insurance
401k
Education Budget
Equity
Relocation Benefits
  • Comprehensive medical and dental coverage
  • Retirement benefits
  • Employee stock programs
  • Education reimbursement
  • Discretionary restricted stock unit awards
  • Employee Stock Purchase Plan
  • Discretionary bonuses
  • Relocation benefits

Interested in this job?

Jobs Related To Apple AIML - Engineering Manager, ML Systems Evaluation Engineering

Engineering Program Manager, On-Device ML

Engineering Program Manager position at Apple focusing on on-device machine learning implementation and cross-functional team leadership.

AIML - Cloud Infra Engineering Manager, Machine Learning Platform & Infrastructure

Lead Apple's ML infrastructure team building scalable cloud solutions for AI-powered search systems, managing engineering teams and driving technical innovation.

AIML - Staff Machine Learning Engineer, Retrieval and Ranking Quality (SII)

Staff Machine Learning Engineer position at Apple, focusing on retrieval and ranking quality, requiring 7+ years of ML experience and strong technical leadership skills.

Engineering Program Manager, Graphics, Games and Machine Learning

Lead Graphics, Games & Machine Learning projects at Apple, managing cross-functional teams for display and color technologies across Apple's product ecosystem.

AIML-Sr. Machine Learning Manager

Lead Apple's ML experimentation platform teams, managing large-scale systems serving 2B+ devices, with competitive compensation and comprehensive benefits.