below marketmost similar roles pay hereabove market
This role pays more than
95%
of similar roles. Most pay
$151,106–$214,000
— the blue band above.
At the midpoint, this role pays about
$255k
versus about
$183k
for comparable roles.
Based on 240 similar postings.
Employer
About Apple Inc
Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software
Apple Inc currently has
3497 open roles
on FindRole.
Listed pay typically runs
$174,149–$277,600
across 2702 roles with salary data.
The ML - Data Scientist joins the team responsible for evaluating generative image and video features for Apple devices. This role owns quality evaluation end to end, building the measurement foundation by designing golden sets and maintaining evaluation sets to analyze data distributions. Key responsibilities include running human evaluation programs, writing annotation guidelines, and developing automated metrics and LLM-as-judge systems. The candidate will perform significance testing and confidence interval analysis to provide root-cause findings and prioritized recommendations for model development. Required skills include Python, SQL, and experience with machine learning evaluation, algorithm analysis, and foundation models. The work focuses on turning subjective visual quality into measurable, trustworthy signals to determine which generative models are ready for release.
Design and maintain golden sets and evaluation sets to ensure representative data distributions.
Write and iterate on annotation guidelines and label schemas for image and video review.
Build and adapt lightweight labeling tools and monitor annotator quality.
Develop automated metrics and LLM-as-judge systems calibrated against human labels.
Report model-vs-model comparisons using confidence intervals, significance testing, and failure mode breakdowns.
Translate evaluation results into root-cause findings and prioritized recommendations for engineering and product teams.
Define quality standards in coordination with ML, engineering, and design partners.
What we're looking for
Master's degree and a minimum of 5 years of relevant industry experience.
5+ years of experience in data science, machine learning evaluation, algorithm analysis, or related technical disciplines.
Experience designing and analyzing evaluations and experiments for ML or generative model quality, including sampling design, significance testing, and confidence intervals.
Strong Python skills and comfort with SQL to build and maintain evaluation pipelines and small tools.
Familiarity with AI-assisted analysis workflows, foundation models, agentic systems, or intelligent automation approaches.
Experience evaluating 3D Gaussian splats or diffusion models, or assessing perceptual quality (preferred).
Experience building LLM or VLM judges and validating them against human ratings (preferred).
Experience building web-based labeling or review tools (preferred).