Software Engineer, Evaluation Engineering

Apple Inc

Confirmed live yesterday High trust

Quick summary

Work type: On-site
Location: Cupertino, CA
Salary: $150,400–$225,300 / yr
Posted: 88 days ago
Freshness: Confirmed live yesterday
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $160k

This role $188k

$110k $238k

below market most similar roles pay here above market

This role pays more than 70% of similar roles. Most pay $122,285–$198,706 — the blue band above. At the midpoint, this role pays about $188k versus about $160k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 3546 open roles on FindRole.

Listed pay typically runs $166,600–$277,600 across 2746 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Software Engineer, Evaluation Engineering

Role Posting Log in to save

Software Engineer - Evaluation Engineering joins the Siri organization to develop foundational on-device execution harnesses and runtime infrastructure for agentic evaluation. The role involves designing low-level orchestration tooling and execution harnesses to drive dynamic, multi-step agent trajectories directly on heterogeneous hardware including iPhone, Mac, Apple Watch, and Apple Vision Pro. Key responsibilities include implementing event-capture layers for high-fidelity trace generation, building CLI tools and local automation scripts, and optimizing harness performance to manage thermal limits and memory profiles. The position requires proficiency in Swift, C++, or Objective-C, along with Python for scripting. The work addresses complex systems engineering challenges such as local device state management, process isolation, and determinism to validate agentic reasoning, tool use, and on-screen awareness across the Apple ecosystem.

What does a Software Engineer earn in California?

Median $214500 from 1134 postings across 74 companies.

See salary data

Skills

Swift C++ Objective-C Python iOS macOS visionOS watchOS LLM Systems Engineering Process Management Telemetry Trace Collection CLI Tools Automation

What you'll do

Architect and build high-reliability execution harnesses for multi-step agentic trajectories on Apple hardware.
Implement lightweight event-capture layers to record high-fidelity execution traces for downstream scoring.
Build CLI tools and local automation scripts for seamless integration into development and testing pipelines.
Manage local device state, process isolation, and determinism across heterogeneous hardware constraints.
Optimize harness performance to minimize resource overhead on thermal limits and memory profiles.
Design orchestration tooling to drive dynamic agent simulations on iOS, macOS, watchOS, and visionOS.
Develop trace collection pipelines to evaluate agentic reasoning and tool use.

What we're looking for

Strong programming proficiency in compiled languages such as Swift, C++, or Objective-C.
B.S. or M.S. in Computer Science, Machine Learning, or equivalent experience.
Solid computer science and systems fundamentals, including process management and local runtimes.
Scripting and automation skills in Python for tooling.
Excellent communication skills and the ability to collaborate across teams.
Hands-on experience developing on Apple platforms or working with low-level OS runtimes and frameworks (preferred).
Experience designing environment-staging systems, state reset mechanisms, or sandboxed test environments (preferred).
Experience building telemetry, trace-capture, or event-logging infrastructure for complex systems (preferred).