Data Scientist - Survey Design, Data Annotation, and Machine Learning Evaluation

Apple Inc

Quick summary

Work type: On-site
Location: Cupertino, CA
Salary: $141,800–$258,600 / yr
Posted: 43 days ago

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $174k

This role $200k

$117k most similar roles pay here $274k

This role pays more than 64% of similar roles. Most pay $131,750–$215,387 — the shaded band above. At the midpoint, this role pays about $200k versus about $174k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 638 open roles on FindRole.

Listed pay typically runs $171,600–$272,100 across 505 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Data Scientist - Survey Design, Data Annotation, and Machine Learning Evaluation

Apply Now Log in to save

Apple’s Special Projects team is seeking a skilled Data Scientist to join their Machine Learning Evaluations teams, focusing on developing and refining Large Language Model (LLM) judges for generative AI model evaluation. This role involves collaborating closely with ML Engineers to manage data annotation processes, including the creation of user instructions and pipeline improvements, as well as designing and testing LLM auto-judges based on statistical analysis and prompt optimization techniques. The ideal candidate has a background in survey design, human data annotation, and experience with Python, along with expertise in multimodal data handling and cross-functional collaboration within large-scale projects.

Skills

Python LLM prompt engineering prompt optimization data annotation survey design statistical analysis multimodal data CI/CD

What you'll do

Design and manage data annotation processes, including user instructions and pipeline processing.
Develop and refine Large Language Model (LLM) auto-judges for generative AI model evaluation.
Analyze collected data annotations to assess the effectiveness of LLM auto-judges.
Work with ML Engineers to understand and meet data annotation needs.
Improve existing data annotation processes through continuous process improvement.

What we're looking for

Bachelor’s or Master’s degree in Data Science, Statistics, or quantitative social science.
At least 2 years of experience in survey design and human data annotation.
Proficiency in Python for data analysis and processing.
Experience with LLM prompt engineering and optimization.
Ability to develop and refine LLM auto-judges for AI model evaluation.
Strong statistical analysis skills for evaluating generative AI models.

Save