Software Engineer, Evaluation Engineering

Apple Inc

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Cupertino, CA
Salary
$150,400–$225,300 / yr
Posted
38 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $174k
This role $188k
$122k most similar roles pay here $236k

This role pays more than 65% of similar roles. Most pay $135,000–$214,000 — the shaded band above. At the midpoint, this role pays about $188k versus about $174k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 1984 open roles on FindRole.

Listed pay typically runs $175,000–$277,600 across 1590 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Software Engineer, Evaluation Engineering

Software Engineer - Evaluation Engineering will join the Siri organization to develop foundational on-device execution harnesses and runtime infrastructure for agentic evaluation. The role involves building core harnesses, environment control layers, and trace collection pipelines to enable downstream teams to evaluate agentic reasoning, tool use, and personal context actions across the Apple ecosystem. You will design low-level orchestration tooling for dynamic agent simulations, manage local device states, and ensure high-fidelity trace generation across heterogeneous hardware including iPhone, Mac, iPad, Watch, and Vision Pro. The position requires proficiency in Swift, C++, or Objective-C, along with Python for scripting and automation. Key responsibilities include optimizing harness performance against thermal and memory limits while building CLI tools and integration hooks to support seamless testing within local development environments and continuous pipelines for on-device AI systems.

What does a Software Engineer earn in California?

Median $214000 from 775 postings across 63 companies.

See salary data

What you'll do

  • Architect and build high-reliability execution harnesses for multi-step agentic trajectories on target Apple hardware.
  • Implement event-capture layers to record high-fidelity execution traces including tool inputs, outputs, and state mutations.
  • Develop CLI tools and automation scripts to integrate on-device agent harnesses into local development environments.
  • Build infrastructure to support continuous testing pipelines for evaluating agent reasoning and tool use.
  • Solve systems engineering challenges regarding local device state management, process isolation, and determinism.
  • Optimize harness performance to ensure minimal impact on device thermal limits and memory profiles.
  • Design environment control layers to manage state resets and sandboxed test environments across various hardware.

What we're looking for

  • Proficiency in compiled languages such as Swift, C++, or Objective-C.
  • Experience with Python for scripting and automation tasks.
  • A B.S. or M.S. in Computer Science, Machine Learning, or equivalent experience.
  • Solid knowledge of computer science and systems fundamentals including process management and local runtimes.
  • Experience developing on Apple platforms or working with low-level OS runtimes and frameworks.
  • Experience designing environment-staging systems such as state reset mechanisms or sandboxed test environments.
  • Experience building telemetry, trace-capture, or event-logging infrastructure for multi-threaded or asynchronous systems.
  • Familiarity with on-device AI/LLM runtime environments, tool execution mechanics, or agentic system architectures.

More like this

Similar roles

Software Engineer, Evaluation Engineering

Apple Inc

Cupertino, CA 93 days ago $150,400$225,300
Swift C++ Objective-C Python iOS macOS visionOS watchOS LLM Machine Learning CLI Systems Engineering Telemetry Trace Collection Process Management Automation Scripts

Software Engineer

Applied Materials

Santa Clara, CA 107 days ago $179,500$246,500
C++ Python C# Java Rust Machine Learning PyTorch Signal Processing Computer Vision Robotics GPU Programming FPGA Web Service Architecture Numerical Methods
7+ yrs exp

Software Engineer

Applied Materials

Santa Clara, CA 108 days ago $152,000$209,000
C++ Python C# Java Rust Machine Learning PyTorch Web Service Architecture Signal Processing Computer Vision Robotics User Interface Design Mathematical Modelling Numerical Methods GPU Programming FPGA
7+ yrs exp