Senior Machine Learning Engineer, Evaluation

Apple Inc

Confirmed live 2 days ago High trust

Quick summary

Work type
On-site
Location
Cupertino, CA
Salary
$216,200–$394,000 / yr
Posted
91 days ago
Freshness
Confirmed live 2 days ago

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $229k
This role $305k
$159k most similar roles pay here $419k

This role pays more than 96% of similar roles. Most pay $202,800–$254,750 — the shaded band above. At the midpoint, this role pays about $305k versus about $229k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 1984 open roles on FindRole.

Listed pay typically runs $175,000–$277,600 across 1590 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Senior Machine Learning Engineer, Evaluation

AIML - Sr Machine Learning Engineer, Evaluation will join the AIML Evaluation team to build systems that evaluate and refine foundation models and agents. The role involves designing and developing evaluation infrastructure, including LLM-as-judge evaluators, reward models calibrated against human feedback, and automated prompt and context optimization pipelines. You will also develop simulation environments for agent evaluation and trajectory-based data generation while contributing datasets and reward signals to the post-training loop. Key responsibilities include translating failure analysis into measurable improvements across offline, device-in-the-loop, and on-device settings. The position requires expertise in machine learning systems, distributed infrastructure, Python, and PyTorch. Ideal candidates possess experience with LLM evaluation, reward modeling, prompt optimization, agentic systems, and post-training techniques like SFT, DPO, or RLHF to improve the quality of AI experiences across various product areas.

What does a Machine Learning Engineer earn in California?

Median $246394 from 172 postings across 28 companies.

See salary data

What you'll do

  • Design and build evaluation infrastructure for agents and foundation models.
  • Develop LLM-as-judge evaluators and reward models calibrated against human feedback.
  • Build automated prompt and context optimization pipelines for agentic systems.
  • Create simulation environments for agent evaluation and trajectory-based data generation.
  • Contribute targeted datasets and reward signals to the foundation model post-training loop.
  • Translate failure analysis from product teams into measurable model and agent improvements.
  • Develop tools for offline benchmarks, device-in-the-loop simulations, and on-device observations.

What we're looking for

  • Bachelor's or Master's degree in Computer Science or a related field.
  • 8+ years of professional experience as a software engineer, preferably in machine learning or a related field.
  • Strong background in machine learning and distributed systems.
  • Experience building and maintaining ML infrastructure for evaluation, training, or deployment.
  • Proficiency in Python and ML frameworks such as PyTorch.
  • Experience with LLM evaluation, reward modeling, prompt optimization, or agentic systems.
  • Experience with simulation environments, trajectory-based data generation, or post-training techniques like SFT, DPO, and RLHF.
  • Excellent communication skills and the ability to work effectively across multiple codebases and teams.

More like this

Similar roles

Senior Machine Learning Engineering Manager, Evaluation

Apple Inc

Cupertino, CA 14 days ago $237,600$401,700
Python Large Language Models LLM-as-judge Reinforcement Learning Synthetic Data Generation Agentic Systems Reward Modeling Post-training Multi-objective Optimization Deep Learning Frameworks Benchmark Infrastructure Simulation Environments Trajectory Analysis
8+ yrs exp

Senior Data Scientist, AIML Evaluation

Apple Inc

Cupertino, CA 76 days ago $150,400$277,600
Machine Learning LLMs Python SQL Spark R Scala Prompt Engineering Statistical Data Analysis Data Processing Experimentation

Software Engineer - AI, Evaluation

Apple Inc

Cupertino, CA 2 days ago $150,400$277,600
Python LLM MLOps CI/CD System Design API Design Machine Learning AI Testing Monitoring Debugging

Machine Learning Engineer, AI Evaluation & LLM Systems

Apple Inc

Cupertino, CA 43 days ago $150,400$225,300
Python C++ PyTorch TensorFlow JAX LLM Multimodal AI Generative AI Git CI/CD Distributed Computing Cloud Platforms Data Processing Statistical Analysis Machine Learning Software Engineering
1+ yrs exp

Evaluation & Insights Machine Learning Engineer

Apple Inc

Cupertino, CA 65 days ago $184,700$324,800
Python PyTorch JAX Hugging Face LLMs RAG MLOps CI/CD vLLM Ray Fine-Tuning Prompt Engineering Vector Databases RLHF DPO MLflow Weights & Biases NLP Embedding-based Clustering
8+ yrs exp