Software Engineer, Evaluation

Apple Inc

Confirmed live 2 days ago High trust

Quick summary

Work type: On-site
Location: Cupertino, CA
Salary: $150,400–$277,600 / yr
Posted: 58 days ago
Freshness: Confirmed live 2 days ago
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $176k

This role $214k

$107k most similar roles pay here $296k

This role pays more than 80% of similar roles. Most pay $138,287–$213,250 — the shaded band above. At the midpoint, this role pays about $214k versus about $176k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 1984 open roles on FindRole.

Listed pay typically runs $175,000–$277,600 across 1590 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Software Engineer, Evaluation

Role Posting Log in to save

As a Software Engineer, Evaluation, you will join the AIML Evaluation team to improve the quality and user experience of Apple Intelligence features. You will design and develop evaluation systems, frameworks, and infrastructure to ensure AI/ML models meet high standards while improving auditability and scaling workflows. Your daily work involves designing benchmarks for reasoning, knowledge, code, and agentic workflows, as well as researching state-of-the-art scoring frameworks and model-based judging. You will collaborate with product managers, data scientists, and training teams to conduct experimental analysis and gap analysis. The role requires expertise in building production systems, distributed systems, RESTful API design, SQL and NoSQL databases, and frontend web development using React and modern JavaScript frameworks. You will also utilize AI-assisted development tools to solve complex problems within the machine learning domain.

What does a Software Engineer earn in California?

Median $214000 from 775 postings across 63 companies.

See salary data

Skills

AI Machine Learning Distributed Systems React JavaScript RESTful API SQL NoSQL Benchmarking Software Engineering

What you'll do

Design and implement evaluation benchmarks, metrics, and test suites to measure model capabilities across reasoning, knowledge, and code.
Develop evaluation methods that capture how models behave in real product settings to predict user-perceived quality.
Research and apply state-of-the-art evaluation techniques including scoring frameworks and model-based judging.
Build reusable tools, scorer libraries, and analysis frameworks that scale across the team's benchmark portfolio.
Tune evaluation infrastructure, tighten operational controls, and improve auditability and debug trails.
Design and execute rigorous experiments to compare model capabilities and perform gap analysis to guide development priorities.
Collaborate with training and data teams to ensure evaluation insights inform training strategies and product improvements.

What we're looking for

BS or MS in Computer Science, Computer Engineering, or a related degree with applicable experience.
3+ years of professional software engineering experience building and operating production systems.
Experience designing and scaling distributed systems including load balancing and capacity planning.
Experience with frontend web development using React and modern JavaScript frameworks.
Experience with RESTful API design and both SQL and NoSQL databases.
Proficiency in using AI-assisted development tools like coding agents and code review assistants.
Ability to solve complex, ambiguous problems and work on large cross-functional projects.