AIML, Senior Lead Engineer, Evaluation

Apple Inc

Confirmed live 2 days ago High trust

Quick summary

Work type
On-site
Location
Seattle, WA
Salary
$205,400–$374,300 / yr
Posted
124 days ago
Freshness
Confirmed live 2 days ago

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $202k
This role $290k
$124k $401k
below market most similar roles pay here above market

This role pays more than 95% of similar roles. Most pay $162,000–$241,750 — the blue band above. At the midpoint, this role pays about $290k versus about $202k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 3544 open roles on FindRole.

Listed pay typically runs $166,600–$277,600 across 2734 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · AIML, Senior Lead Engineer, Evaluation

The AIML - Sr Lead Engineer, Evaluation joins the Machine Learning and AI team to lead the design and construction of a next-generation online evaluation platform. This leadership role involves defining the technical vision and multi-year strategy for a scalable experimentation system that enables numerous teams to run rigorous A/B tests at scale. The engineer will build infrastructure to drive improvements in software and features, specifically focusing on service-oriented architecture and the statistical foundations of experiment design. Key requirements include expertise in on-device or embedded system experimentation, modern evaluation programs, and machine learning or AI-driven product teams. The role solves the technical challenge of translating ambiguous, long-horizon problems into concrete engineering plans for operating system layer experiments and shared infrastructure.

What you'll do

  • Design and build a next-generation online evaluation and A/B experimentation platform.
  • Develop and execute a multi-year technical strategy for the experimentation system.
  • Build and lead a high-performing engineering team to deliver scalable infrastructure.
  • Define the technical vision for systems that allow multiple teams to run rigorous experiments at scale.
  • Translate ambiguous, long-horizon problems into concrete engineering plans and deliverables.
  • Align diverse stakeholders across organizational boundaries on shared infrastructure goals.
  • Apply statistical foundations of experimentation to manage trade-offs in experiment design.

What we're looking for

  • 12+ years of experience as a technical engineering leader.
  • Proven experience leading teams that built and scaled experimentation or A/B testing platforms in a service-oriented architecture.
  • Deep understanding of the statistical foundations of experimentation and experiment design trade-offs.
  • Strong track record of translating ambiguous, long-horizon problems into concrete engineering plans.
  • Experience collaborating across organizational boundaries to align diverse stakeholders on shared infrastructure.
  • B.S. or M.S. in Computer Science/Engineering, or equivalent experience.
  • Experience with on-device or embedded system experimentation (preferred).
  • Background in modern evaluation systems, machine learning, or AI-driven product teams (preferred).

More like this

Similar roles

AIML, Senior Software Engineer, AI, Evaluation

Apple Inc

Cupertino, CA 25 days ago $150,400–$277,600
Python LLM Machine Learning System Design API Design LLM-as-judge Agentic Systems System Testing Debugging Monitoring Benchmarking
8+ yrs exp

Senior Software Engineer in Test, Evaluation

Apple Inc

Seattle, WA 95 days ago $175,000–$308,500
Swift Objective-C CI/CD Test Automation Full Stack Backend Services Command-line Tools Software Quality Assurance Scalability Reliability
4+ yrs exp

Senior Machine Learning Engineer, Evaluation

Apple Inc

Cupertino, CA 136 days ago $216,200–$394,000
Python PyTorch LLM Evaluation Reward Modeling RLHF DPO SFT Agentic Systems Distributed Systems ML Infrastructure Prompt Optimization Simulation Environments Trajectory-based Data Generation LLM-as-judge
8+ yrs exp

Senior OS Software Engineer, Evaluation

Apple Inc

Cupertino, CA 143 days ago $150,400–$277,600
Objective-C Swift C++ C Kotlin Operating Systems System Design Threading Inter-process Communication A/B Testing iOS macOS
7+ yrs exp

Senior Instrumentation Platform Engineer, Evaluation

Apple Inc

Sunnyvale, CA 110 days ago $184,700–$324,800
Swift Objective-C C++ iOS macOS API Design Software Architecture Telemetry Observability Data Engineering ML Systems Concurrency Memory Management On-device Processing
8+ yrs exp

Senior Machine Learning Engineering Manager, Evaluation

Apple Inc

Cupertino, CA 59 days ago $237,600–$401,700
Python Machine Learning Large Language Models LLM-as-judge Reinforcement Learning Synthetic Data Generation Deep Learning ML Pipelines Post-training Preference Optimization Reward Modeling Agentic Systems Simulation Environments Regression Testing Multi-objective Optimization On-device Machine Learning
8+ yrs exp