Senior Engineering Program Manager, Evaluation - Special Projects

Apple Inc

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Cupertino, CA
Salary
$175,500–$311,700 / yr
Posted
72 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $206k
This role $244k
$135k $331k
below market most similar roles pay here above market

This role pays more than 84% of similar roles. Most pay $176,803–$234,362 — the blue band above. At the midpoint, this role pays about $244k versus about $206k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 3544 open roles on FindRole.

Listed pay typically runs $166,600–$277,600 across 2734 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Senior Engineering Program Manager, Evaluation - Special Projects

The Sr Engineering Program Manager, Evaluation - Special Projects joins the Special Projects team to lead the strategic direction for the AI evaluation framework. This role involves architecting evaluation methodologies to measure and validate the performance of state-of-the-art multi-modal models across various modalities. You will translate ambiguous product requirements into concrete success metrics, orchestrate complex data collection initiatives, and manage simulation infrastructure and evaluation pipelines. The position requires technical depth in ML evaluation, specifically regarding large language models, vision-language models, and reinforcement learning from human feedback. You will drive consensus on subjective quality metrics and communicate complex technical concepts to executive leadership. Key competencies include statistical analysis, A/B testing, experimental design, and managing the end-to-end model development lifecycle to ensure high-quality AI experiences.

What you'll do

  • Define and drive the evaluation strategy for Apple's AI models to influence product roadmaps and technology investments.
  • Translate ambiguous product requirements into concrete success metrics to validate multi-modal model performance.
  • Develop end-to-end programs to measure and validate the performance of state-of-the-art AI models.
  • Orchestrate complex data collection initiatives, simulation infrastructure, and evaluation pipelines.
  • Drive consensus on subjective quality metrics and establish clear success criteria for ambiguous use cases.
  • Coordinate distributed teams across design, research, engineering, and operations to execute programs.
  • Communicate complex technical concepts and program status directly to executive leadership.
  • Deliver process improvements to increase efficiency across the broader organization.

What we're looking for

  • 7+ years of technical program management experience.
  • At least 3 years of experience leading complex AI/ML programs.
  • Proven track record of delivering complex programs by defining requirements and driving engineering teams to outcomes.
  • Experience influencing and driving decisions at the Director/VP level.
  • Excellence in executive communication to distill complex technical information.
  • Master's or PhD in Computer Science, Machine Learning, Statistics, or a related quantitative field (preferred).
  • Deep hands-on experience with LLMs, VLMs, and multi-modal architectures (preferred).
  • Experience with RLHF, preference optimization, statistical analysis, and A/B testing (preferred).

More like this

Similar roles

Senior Engineering Program Manager, AIML Foundation Models

Apple Inc

Cupertino, CA 97 days ago $175,500–$263,800
Machine Learning Generative AI Large Language Models (LLMs) Distributed Training Data Pipelines On-device Inference Model Evaluation ML Lifecycle Hardware/Software Co-design Privacy Engineering Release Management Project Management Data Acquisition
6+ yrs exp