Senior Machine Learning Engineer, ML Systems Evaluation Engineering

Apple Inc

Confirmed live yesterday High trust

Quick summary

Work type: On-site
Location: Seattle, WA
Salary: $175,000–$308,500 / yr
Posted: 17 days ago
Freshness: Confirmed live yesterday
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $229k

This role $242k

$159k most similar roles pay here $325k

This role pays more than 67% of similar roles. Most pay $202,800–$254,750 — the shaded band above. At the midpoint, this role pays about $242k versus about $229k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 2925 open roles on FindRole.

Listed pay typically runs $166,600–$277,600 across 2305 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Senior Machine Learning Engineer, ML Systems Evaluation Engineering

Role Posting Log in to save

Sr. Machine Learning Engineer, ML Systems Evaluation Engineering joins the SCALE team within the Siri organization to evaluate AI and machine learning models at scale. This role focuses on delivering offline evaluation insights to drive model development while maintaining strict privacy standards for a personal assistant. The engineer will curate high-quality evaluation datasets, utilize Large Language Models as judges to automatically assess model changes, and leverage generative AI to create adversarial scenarios that anticipate edge cases in conversational interactions. Key responsibilities include assessing the naturalness of digital assistant conversations and managing large-scale datasets for training and evaluation. Required skills include expert proficiency in Python, deep knowledge of Conversational AI, and experience with systems engineering. The role addresses technical challenges in evaluating highly personalized user experiences and agentic systems within a complex software ecosystem.

What does a Machine Learning Engineer earn in Washington?

Median $241750 from 65 postings across 11 companies.

See salary data

Skills

Machine Learning Large Language Models (LLMs) Conversational AI Python Generative AI Natural Language Understanding Systems Engineering Scalable Data Solutions

What you'll do

Use Large Language Models (LLMs) as judges to automatically evaluate model changes and conversation naturalness.
Harness generative AI to create adversarial scenarios that identify edge cases in conversational systems.
Curate and evolve high-quality evaluation datasets for state-of-the-art machine learning models.
Manage large-scale datasets specifically designed for ML training and evaluation.
Define and measure evaluation coverage for LLMs and agentic systems.
Deliver offline evaluation insights to drive model development and improve end-user experience.
Develop scalable data solutions for natural language products while maintaining strict privacy standards.

What we're looking for

7+ years of professional experience applying machine learning to real-world problems and crafting scalable data solutions for natural language products.
Proven experience managing large-scale datasets for ML training and evaluation.
Excellent programming skills in Python.
MS/PhD in Machine Learning, Computer Science, or equivalent experience in a related field.
Deep domain knowledge in Conversational AI and understanding of the end-to-end ML product lifecycle (preferred).
Expertise in defining and measuring evaluation coverage for Large Language Models and agentic systems (preferred).
Track record of delivering large-scale, cross-functional ML product or platform outcomes (preferred).
Experience with systems engineering and understanding of ML and software component interdependencies (preferred).