Senior Machine Learning Engineer, Evaluation

Apple Inc

Confirmed live today Trusted

Quick summary

Work type: On-site
Location: Cupertino, CA
Salary: $216,200–$394,000 / yr
Posted: 137 days ago
Freshness: Confirmed live today
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $233k

This role $305k

$159k $419k

below market most similar roles pay here above market

This role pays more than 96% of similar roles. Most pay $210,600–$254,750 — the blue band above. At the midpoint, this role pays about $305k versus about $233k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 3497 open roles on FindRole.

Listed pay typically runs $174,149–$277,600 across 2702 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Senior Machine Learning Engineer, Evaluation

Role Posting Log in to save

AIML - Sr Machine Learning Engineer, Evaluation joins the AIML Evaluation team to build systems that evaluate and refine foundation models and agents. The role involves designing and developing benchmarks, evaluators, simulation environments, and prompt and context optimization pipelines to drive quality improvements. You will build automated pipelines, develop LLM-as-judge evaluators, train reward models calibrated against human feedback, and contribute targeted datasets and reward signals to foundation model post-training. Key responsibilities include building simulation environments for agent evaluation and trajectory-based data generation. The role requires expertise in machine learning systems, distributed infrastructure, and Python using frameworks like PyTorch. You will solve technical problems across offline, device-in-the-loop, and on-device settings, translating failure analysis into measurable improvements for large language models and agentic systems.

What does a Machine Learning Engineer earn in California?

Median $235750 from 200 postings across 34 companies.

See salary data

Skills

Python PyTorch LLM Evaluation Reward Modeling RLHF DPO SFT Agentic Systems Distributed Systems ML Infrastructure Prompt Optimization Simulation Environments Trajectory-based Data Generation LLM-as-judge

What you'll do

Design and build evaluation infrastructure for agents and foundation models.
Develop LLM-as-judge evaluators and reward models calibrated against human feedback.
Build automated pipelines for prompt and context optimization.
Create simulation environments for agent evaluation and trajectory-based data generation.
Contribute targeted datasets and reward signals to the foundation model post-training loop.
Translate failure analysis into measurable model and agent improvements.
Develop evaluation systems for offline, device-in-the-loop, and on-device settings.

What we're looking for

Bachelor's or Master's degree in Computer Science or a related field.
8+ years of professional experience as a software engineer, preferably in machine learning or a related field.
Strong background in machine learning and distributed systems.
Experience building and maintaining ML infrastructure for evaluation, training, or deployment.
Ability to work effectively across multiple codebases, teams, and organizations.
Experience with LLM evaluation, LLM-as-judge, or reward modeling (preferred).
Experience with prompt optimization, agent harness development, or post-training (SFT, DPO, RLHF) (preferred).
Proficiency in Python and ML frameworks such as PyTorch (preferred).