AI/ML Evaluation Specialist, Human Data

Apple Inc

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Cupertino, CA
Salary
$144,600–$263,800 / yr
Posted
104 days ago
Freshness
Confirmed live today

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $221k
This role $204k
$129k $294k
below market most similar roles pay here above market

This role pays less than 63% of similar roles. Most pay $187,850–$254,750 — the blue band above. At the midpoint, this role pays about $204k versus about $221k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 3497 open roles on FindRole.

Listed pay typically runs $174,149–$277,600 across 2702 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · AI/ML Evaluation Specialist, Human Data

The AI/ML Evaluation Specialist, Human Data joins the Human-centered AI team within the Data Quality and Operations division. This role leads large-scale, multilingual human data programs for Apple Music, App Store, TV+, Podcasts, and Books. You will own the operational strategy for data collection, curation, and annotation, designing onboarding scaffolds, analyzing behavior patterns, and building automation to offload low-judgment decisions. Key responsibilities include designing measurement frameworks, implementing statistical process controls, and managing data pipelines to ensure high-quality, human-aligned generative AI features. You will utilize Python, R, and SQL to process large datasets and extract insights. The role requires coordinating across engineering, data science, research, procurement, and legal teams to ensure compliant, scalable workflows for speech, text, and multimodal data while reducing cognitive burden for human annotators.

What you'll do

  • Lead end-to-end execution of human data collection programs for multilingual and multimodal AI features.
  • Design and own measurement frameworks to track spend, speed, inter-rater reliability, and volume.
  • Build and implement quality frameworks using statistical process controls to detect and remediate data degradation.
  • Analyze workflows to identify inefficiencies and implement automated agent-in-the-loop or machine-in-the-loop pipelines.
  • Design compliant data collection and user study programs in partnership with Legal, Privacy, and Security teams.
  • Manage the data collection lifecycle for internal and external workforces, including onboarding and calibration programs.
  • Translate human-centered AI principles into scalable task designs that reduce cognitive burden for annotators.

What we're looking for

  • Bachelor's degree or higher in Cognitive Science, Linguistics, or a related field with an experimental or empirical component.
  • Master's degree or higher in Cognitive Science, Linguistics, or a related field with an experimental or empirical component (preferred).
  • 4+ years of experience leading cross-team human data programs for AI/ML in an NLP/NLU or generative AI environment.
  • 2+ years of experience owning data strategy for frontier AI development and human alignment methodologies (preferred).
  • Proficiency in programming and data languages including Python, R, and SQL.
  • Hands-on experience managing 0→1 human-in-the-loop data collection, annotation, and evaluation initiatives.
  • Expertise in end-to-end data annotation quality management, including statistical process controls and data quality metrics.
  • Experience working cross-functionally with engineering, data science, legal, privacy, and third-party suppliers.

More like this

Similar roles

AI/ML Evaluation Specialist, Human Data

Apple Inc

Cupertino, CA 117 days ago $144,600–$263,800
Python R SQL ETL NLP NLU Generative AI Human-in-the-loop Data Pipelines Data Annotation Statistical Process Controls Machine Learning Data Quality Frameworks AI Safety Responsible AI
4+ yrs exp

Evaluation & Insights Machine Learning Engineer

Apple Inc

Cupertino, CA 111 days ago $184,700–$324,800
Python PyTorch JAX Hugging Face LLMs MLOps CI/CD RAG vLLM Ray MLflow Weights & Biases RLHF DPO Fine-Tuning Vector Databases Prompt Engineering Representation Learning Embedding-based Clustering SelfCheckGPT
8+ yrs exp

AIML Data Scientist, Evaluation

Apple Inc

Cupertino, CA 32 days ago $150,400–$277,600
Python SQL LLM NLP Statistics Data Manipulation Natural Language Processing Metrics Development Exploratory Data Analysis Machine Learning Data Science
3+ yrs exp

Machine Learning Evaluation Engineer

Apple Inc

Sunnyvale, CA 20 days ago $150,400–$277,600
Machine Learning Computer Vision Python LLM VLM Data Analysis Statistics Prompt Tuning Automated Pipelines Metric Design Failure Analysis Synthetic Data Human-in-the-loop
3+ yrs exp

Senior Data Scientist, Evaluation

Apple Inc

Cupertino, CA 40 days ago $184,700–$324,800
Machine Learning Data Science Python SQL Spark R Scala LLMs Prompt Engineering Statistical Data Analysis Experimentation Data Processing Analytics
5+ yrs exp