Data Scientist - Survey Design, Data Annotation, and Machine Learning Evaluation

Apple Inc

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Cupertino, CA
Salary
$150,400–$277,600 / yr
Posted
141 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $170k
This role $214k
$89k most similar roles pay here $298k

This role pays more than 77% of similar roles. Most pay $126,800–$212,814 — the shaded band above. At the midpoint, this role pays about $214k versus about $170k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 1984 open roles on FindRole.

Listed pay typically runs $175,000–$277,600 across 1590 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Data Scientist - Survey Design, Data Annotation, and Machine Learning Evaluation

Data Scientist - Survey Design, Data Annotation, and Machine Learning Evaluation will join the Special Projects team to support the development of conversational features leveraging multimodal capabilities of state-of-the-art foundation models. Working closely with ML Engineers, the successful candidate will manage and analyze human and automated data annotation processes while developing, testing, and refining LLM judges for generative AI model evaluation. Daily responsibilities include designing annotation pipelines, creating user instructions, and performing statistical analysis to refine judging criteria. The role requires proficiency in Python and expertise in survey design, prompt engineering, and prompt optimization. This position addresses the technical challenge of evaluating generative AI models by utilizing both human data annotations and automated LLM judges to ensure high-quality outputs for complex multimodal systems within a specialized machine learning evaluation framework.

What does a Data Scientist earn in California?

Median $208978 from 66 postings across 27 companies.

See salary data

What you'll do

  • Design and manage data annotation processes including user instructions and pipeline processing.
  • Develop LLM auto-judges and judging criteria for generative AI model evaluation.
  • Analyze collected human data annotations to assess and refine LLM auto-judges.
  • Perform prompt engineering and optimization for large language models.
  • Create and manage survey designs to gather high-quality human data.
  • Evaluate the performance of multimodal foundation models through automated and manual systems.
  • Translate machine learning engineering requirements into actionable data annotation workflows.

What we're looking for

  • BA or Master's degree in Data Science, Statistics, or a quantitative social science field.
  • PhD in Data Science, Statistics, or a quantitative social science field is preferred.
  • 2+ years of hands-on experience in survey design and human data annotation.
  • Proficiency in Python.
  • Experience with LLM prompt engineering and prompt optimization.
  • Experience with LLM auto-judges for generative AI model evaluation.
  • Experience with large-scale multimodal data and data-annotation pipelines.
  • Strong statistical analysis skills and excellent communication or cross-functional collaboration skills.

More like this

Similar roles

Senior Data Scientist, AIML Evaluation

Apple Inc

Cupertino, CA 76 days ago $150,400$277,600
Machine Learning LLMs Python SQL Spark R Scala Prompt Engineering Statistical Data Analysis Data Processing Experimentation

Machine Learning Engineer, AI Evaluation & LLM Systems

Apple Inc

Cupertino, CA 43 days ago $150,400$225,300
Python C++ PyTorch TensorFlow JAX LLM Multimodal AI Generative AI Git CI/CD Distributed Computing Cloud Platforms Data Processing Statistical Analysis Machine Learning Software Engineering
1+ yrs exp

Senior Data Scientist, Machine Learning

General Dynamics

Remote 27 days ago $123,250$166,750
AWS Python SQL Snowflake Supervised Learning Predictive Modeling Machine Learning Feature Engineering Anomaly Detection Entity Resolution Healthcare Claims Data
5+ yrs exp Remote

Data Scientist & 365 Developer

Booz Allen Hamilton

Edgewood, MD +1 73 days ago $77,600$176,000
Python R SQL NoSQL Machine Learning Artificial Intelligence Natural Language Processing Power Apps SharePoint Qlik Hadoop Spark Kafka Hive EMR MapReduce MySQL Plotly Seaborn ggplot2 Gurobi

Senior Data Scientist, AI Foundations

Capital One Financial

New York, NY +1 109 days ago $148,000$168,900
LLMs NLP Pytorch Hugging Face LangChain Lightning VectorDBs AWS Python SQL Scala R Machine Learning RLHF Training Optimization Self-Supervised Learning Computer Vision
2+ yrs exp

Staff Data Scientist

Intuit

Mountain View, CA +1 17 days ago $194,000$262,500
SQL Python Causal Inference Machine Learning Statistical Modeling Experimental Design Tableau Qlikview Data Visualization Data Pipelines Marketing Analytics Churn Analysis Customer Lifetime Value Product Funnel Optimization
7+ yrs exp