Director, Evaluation - Data Science and Insights

Apple Inc

Confirmed live today High trust

Quick summary

Work type: On-site
Location: Cupertino, CA
Salary: $311,100–$496,900 / yr
Posted: 2 days ago
Freshness: Confirmed live today
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $238k

This role $404k

$147k most similar roles pay here $534k

This role pays more than 99% of similar roles. Most pay $208,762–$267,643 — the shaded band above. At the midpoint, this role pays about $404k versus about $238k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 2000 open roles on FindRole.

Listed pay typically runs $175,000–$277,600 across 1613 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Director, Evaluation - Data Science and Insights

Role Posting Log in to save

AIML - Director, Evaluation - Data Science and Insights leads the Data Science and Insights team within the AIML Evaluation organization. This role is responsible for overseeing evaluation strategies for Apple Intelligence, Siri, and a broad portfolio of software features serving over a billion users. The leader will manage a large team of data scientists and machine learning engineers to drive methodologies in human evaluation, logging, A/B testing, and LLM-based autograders and rubrics. Key responsibilities include embedding evaluation into product development cycles to achieve measurable improvements in models and agentic features while balancing quality and privacy requirements. The role requires expertise in large-scale consumer AI products, including conversational assistants and search systems. Essential skills include advanced quantitative knowledge, experience with synthetic data, and the ability to communicate complex technical results to executive leadership.

Skills

Data Science Machine Learning LLM A/B Testing Human Evaluation Logging Synthetic Data Machine Translation Agentic Systems Tool-use Instrumentation Evaluation Frameworks

What you'll do

Define the evaluation strategy for measuring quality across Apple Intelligence, Siri, and other large-scale software features.
Lead a large team of data scientists and machine learning engineers through recruiting, development, and retention.
Drive methodologies for human evaluation, logging, A/B testing, and LLM-based autograders to improve model performance.
Integrate evaluation metrics into product development cycles to achieve measurable quality gains in shipped features.
Partner with internal teams to align evaluation platforms, foundation models, and machine translation efforts.
Represent the team's goals and results to executive leadership across AIML and software engineering divisions.

What we're looking for

10+ years of experience in data science and machine learning evaluation.
6+ years of experience leading large technical teams.
Advanced degree in a quantitative field such as Statistics, Computer Science, or Machine Learning.
Demonstrated track record of running organizations of 50+ data scientists and/or machine learning engineers.
Deep experience in human evaluation methodology, logging, and A/B testing for consumer-facing products at scale.
Hands-on experience building and deploying LLM-based autograders and rubrics to drive improvements in models and agentic features.
Strong written and verbal communication skills to communicate with engineers and senior leadership.
Experience evaluating large consumer AI products, logging infrastructure, or evaluation frameworks for agentic systems (preferred).