Software Engineer, Evaluation Engineering

Apple Inc

Confirmed live yesterday High trust

Quick summary

Work type: On-site
Location: Cupertino, CA
Salary: $150,400–$225,300 / yr
Posted: 143 days ago
Freshness: Confirmed live yesterday
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $160k

This role $188k

$110k $238k

below market most similar roles pay here above market

This role pays more than 70% of similar roles. Most pay $122,285–$198,706 — the blue band above. At the midpoint, this role pays about $188k versus about $160k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 3546 open roles on FindRole.

Listed pay typically runs $166,600–$277,600 across 2746 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Software Engineer, Evaluation Engineering

Role Posting Log in to save

Software Engineer - Evaluation Engineering joins the Siri organization to develop foundational on-device execution harnesses and runtime infrastructure for agentic evaluation. The role involves designing low-level execution harnesses and orchestration tooling to drive dynamic, multi-step agent simulations across iOS, macOS, watchOS, and visionOS. Key responsibilities include implementing event-capture layers for high-fidelity trace generation, building CLI tools and local automation scripts, and optimizing harness performance to manage thermal limits and memory profiles. The position requires proficiency in Swift, C++, or Objective-C, along with Python for scripting and automation. Candidates must possess strong systems fundamentals, including process management and local runtimes. This work addresses the technical challenge of validating agentic reasoning, tool use, and on-screen awareness through deterministic execution on heterogeneous user hardware.

What does a Software Engineer earn in California?

Median $214500 from 1134 postings across 74 companies.

See salary data

Skills

Swift C++ Objective-C Python iOS macOS visionOS watchOS LLM Systems Engineering Process Management Telemetry Trace Collection CLI Tools Automation

What you'll do

Architect and build high-reliability execution harnesses to drive multi-step agentic trajectories on Apple hardware.
Implement lightweight event-capture layers to record high-fidelity execution traces for downstream scoring and analysis.
Build CLI tools and local automation scripts to enable seamless on-device agent harness execution.
Integrate harness tools into local development environments and continuous testing pipelines.
Optimize harness performance to minimize resource overhead on device thermal limits and memory profiles.
Manage local device state, process isolation, and determinism across various hardware constraints.
Develop environment control layers and trace collection pipelines for evaluating agentic reasoning and tool use.

What we're looking for

Strong programming proficiency in compiled languages such as Swift, C++, or Objective-C.
B.S. or M.S. in Computer Science, Machine Learning, or equivalent experience.
Solid computer science and systems fundamentals, including process management and local runtimes.
Scripting and automation skills in Python for tooling.
Excellent communication skills and the ability to collaborate across teams.
Hands-on experience developing on Apple platforms or working with low-level OS runtimes and frameworks (preferred).
Experience designing environment-staging systems, state reset mechanisms, or sandboxed test environments (preferred).
Experience building telemetry, trace-capture, or event-logging infrastructure for complex systems (preferred).