Senior Engineering Program Manager, Evaluation - Special Projects

Apple Inc

Confirmed live yesterday High trust

Quick summary

Work type: On-site
Location: Cupertino, CA
Salary: $175,500–$311,700 / yr
Posted: 27 days ago
Freshness: Confirmed live yesterday
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $212k

This role $244k

$147k most similar roles pay here $329k

This role pays more than 78% of similar roles. Most pay $181,100–$243,600 — the shaded band above. At the midpoint, this role pays about $244k versus about $212k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 1984 open roles on FindRole.

Listed pay typically runs $175,000–$277,600 across 1590 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Senior Engineering Program Manager, Evaluation - Special Projects

Role Posting Log in to save

The Sr Engineering Program Manager, Evaluation - Special Projects joins the Special Projects team to lead the AI evaluation framework at the forefront of next-generation experiences. This role involves driving strategic direction for measuring and validating multi-modal model performance across various modalities. You will translate ambiguous product requirements into concrete success metrics, orchestrate complex data collection initiatives, and develop simulation infrastructure and evaluation pipelines. The position requires managing programs to define quality standards for large language models, vision-language models, and reinforcement learning from human feedback. Key technical competencies include expertise in statistical analysis, A/B testing, experimental design, and the end-to-end model development lifecycle. You will coordinate distributed teams across design, research, engineering, and operations while communicating complex technical concepts to executive leadership to influence product roadmaps and critical hill-climbing decisions regarding AI quality.

Skills

Machine Learning LLMs VLMs Multi-modal Models RLHF Statistical Analysis A/B Testing Experimental Design Evaluation Pipelines Data Collection Simulation Infrastructure Model Development Lifecycle Technical Program Management

What you'll do

Define and drive the evaluation strategy for multi-modal AI models to influence product roadmaps and technology investments.
Translate ambiguous product requirements into concrete success metrics to determine if models meet quality standards.
Establish clear success criteria and consensus for subjective quality metrics in complex use cases.
Orchestrate large-scale data collection initiatives, simulation infrastructure, and evaluation pipelines.
Deliver process improvements to increase efficiency across the broader organization.
Coordinate distributed teams across design, research, engineering, and operations to execute high-stakes programs.
Communicate complex technical concepts and program status directly to executive leadership.

What we're looking for

7+ years of technical program management experience.
At least 3 years of experience leading complex AI/ML programs.
Proven track record of delivering complex programs by defining requirements and driving engineering teams.
Experience influencing and driving decisions at the Director or VP level.
Ability to navigate ambiguity and lead teams through uncertainty while maintaining momentum.
Excellence in executive communication and distilling complex technical information.
Master's or PhD in Computer Science, Machine Learning, Statistics, or a related quantitative field (preferred).
Experience with LLMs, VLMs, multi-modal architectures, RLHF, and statistical analysis (preferred).

Save