Software Engineer - AI, Evaluation

Apple Inc

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Cupertino, CA
Salary
$150,400–$277,600 / yr
Posted
1 day ago
Freshness
Confirmed live yesterday

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $208k
This role $214k
$135k most similar roles pay here $293k

This role pays more than 60% of similar roles. Most pay $162,000–$254,562 — the shaded band above. At the midpoint, this role pays about $214k versus about $208k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 1984 open roles on FindRole.

Listed pay typically runs $175,000–$277,600 across 1590 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Software Engineer - AI, Evaluation

AIML - Software Engineer - AI, Evaluation will join the Evaluation organization to build software systems that enhance the automatic evaluation of various products including Search, Siri, and Apple Intelligence capabilities. The role involves designing and developing extensible frameworks, pipelines, and tools at the intersection of AI modeling, software engineering, and product quality to facilitate efficient development, deployment, and qualitative measurement of models. Key responsibilities include building LLM-as-judge tools and systems that influence product launch decisions. Candidates must possess exceptional Python skills and solid software engineering fundamentals including system design, API design, CI/CD, testing strategies, and monitoring. Preferred qualifications include experience with LLM applications, MLOps principles, and scalable tools for quality evaluation. The role requires interpreting metrics like precision and recall while translating ambiguous requirements into technical solutions to improve model iteration speed.

What does a Software Engineer earn in California?

Median $214000 from 775 postings across 63 companies.

See salary data

What you'll do

  • Design and develop extensible frameworks, pipelines, and tools for the evaluation of AI models.
  • Build LLM-as-judge systems to improve the quality and efficiency of automated evaluations.
  • Develop software systems to provide principled assessments for products like Siri and Apple Intelligence.
  • Create scalable tools for product quality measurement across a diverse range of features.
  • Implement MLOps principles to manage the lifecycle of AI models.
  • Translate ambiguous product requirements into technical solutions for evaluation infrastructure.
  • Interpret complex evaluation reports including metrics such as precision, recall, and consistency.

What we're looking for

  • BS/MS/PhD degree in Computer Science, Machine Learning, AI, or a related field.
  • Exceptional Python skills.
  • Solid software engineering fundamentals with production experience including system design, API design, CI/CD, and testing strategies.
  • Demonstrated expertise in using AI-assisted software development workflows to accelerate development while maintaining code quality.
  • Strong communication skills and proven ability to work collaboratively with cross-functional teams.
  • Experience with building LLM applications, frameworks, and offline evaluations (preferred).
  • Familiarity with MLOps principles for model lifecycle management (preferred).
  • Experience in building scalable tools for product quality evaluation (preferred).

More like this

Similar roles

Senior Machine Learning Engineer, Evaluation

Apple Inc

Cupertino, CA 90 days ago $216,200$394,000
Machine Learning LLM Python PyTorch Reward Modeling RLHF SFT DPO Prompt Optimization Distributed Systems Agentic Systems Simulation Environments ML Infrastructure Data Generation
8+ yrs exp

Software Engineer, Evaluation

Apple Inc

Cupertino, CA 58 days ago $150,400$277,600
AI Machine Learning Distributed Systems React JavaScript RESTful API SQL NoSQL Benchmarking Software Engineering
3+ yrs exp

Machine Learning Engineer, AI Evaluation & LLM Systems

Apple Inc

Cupertino, CA 42 days ago $150,400$225,300
Python C++ PyTorch TensorFlow JAX LLM Multimodal AI Generative AI Git CI/CD Distributed Computing Cloud Platforms Data Processing Statistical Analysis Machine Learning Software Engineering
1+ yrs exp

Applied AI/ML Software Engineer

Apple Inc

San Diego, CA 5 days ago $142,300$263,300
Machine Learning Generative AI LLMs RAG Python Ruby Java Kubernetes Data Analysis Infrastructure Evaluation Pipelines Agentic Pipelines

Senior Machine Learning Engineering Manager, Evaluation

Apple Inc

Cupertino, CA 13 days ago $237,600$401,700
Python Large Language Models LLM-as-judge Reinforcement Learning Synthetic Data Generation Agentic Systems Reward Modeling Post-training Multi-objective Optimization Deep Learning Frameworks Benchmark Infrastructure Simulation Environments Trajectory Analysis
8+ yrs exp

AI/ML Software Engineer

Apple Inc

Sunnyvale, CA 29 days ago $150,400$277,600
Computer Vision Machine Learning C++ Swift iOS macOS MLX ARKit REKit 3D Graphics Diffusion Transformer Models On-device Inference Linear Algebra Numerical Analysis Agentic Workflow Frameworks Real-time Systems Software Architecture
5+ yrs exp