Systems Engineer, Evaluation Engineering

Apple Inc

Confirmed live today High trust

Quick summary

Work type: On-site
Location: Cupertino, CA
Salary: $150,400–$277,600 / yr
Posted: 4 days ago
Freshness: Confirmed live today
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $159k

This role $214k

$112k $295k

below market most similar roles pay here above market

This role pays more than 88% of similar roles. Most pay $130,942–$187,850 — the blue band above. At the midpoint, this role pays about $214k versus about $159k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 3497 open roles on FindRole.

Listed pay typically runs $174,149–$277,600 across 2702 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Systems Engineer, Evaluation Engineering

Role Posting Log in to save

The Systems Engineer - Evaluation Engineering joins the Machine Learning and AI team to own the infrastructure powering the Siri Agentic Evaluation Platform. You will design and build a distributed execution engine to coordinate complex evaluation loops, agentic simulations, and multi-model judging pipelines across heterogeneous device types. Key responsibilities include developing an internal developer platform with CLI tools and APIs, managing stream processing for high-volume execution traces, and maintaining infrastructure-as-code using GitOps. You will utilize Python (asyncio), Java, gRPC, Protobuf, GraphQL, and FastAPI. The role requires expertise in Kubernetes, Istio, Terraform, and databases like PostgreSQL. You will solve the problem of maintaining deterministic, fault-tolerant, and cost-efficient evaluations across billions of tokens while ensuring immutable data lineage for granular error attribution.

What does a Systems Engineer earn in California?

Median $191000 from 99 postings across 21 companies.

See salary data

Skills

Distributed Systems Python Java Kubernetes Terraform gRPC Protobuf REST FastAPI GraphQL PostgreSQL Kafka Redis AWS GCP Azure Istio ArgoCD CI/CD Distributed Tracing

What you'll do

Architect and scale an asynchronous engine to orchestrate thousands of parallel agent simulations and LLM-as-a-judge pipelines.
Build self-service infrastructure, CLI tools, and internal APIs for ML teams to integrate evaluation pipelines into CI/CD workflows.
Design and maintain high-performance, type-safe gRPC and REST APIs to serve evaluation pipelines and real-time metrics.
Develop data pipelines to ingest high-volume execution traces while ensuring immutable data lineage for error attribution.
Manage deployment topologies across multi-tenant clusters using Infrastructure-as-Code and continuous delivery practices.
Implement distributed tracing, structured metrics, and alerting to ensure platform reliability and observability.
Design smart scheduling layers, token buckets, and circuit breakers to prevent API rate-limiting and cluster failures.

What we're looking for

MS in computer science or equivalent.
7+ years of experience as a distributed systems engineer, platform engineer, or equivalent.
Strong proficiency in languages optimized for concurrency and enterprise scale, such as Python (asyncio) or Java.
Deep expertise in designing robust, versioned production APIs using gRPC/Protobuf, GraphQL, or REST (FastAPI).
Advanced experience with Kubernetes (orchestration, custom operators, service meshes) and cloud providers (AWS, GCP, or Azure).
Strong experience modeling complex relational data and trace hierarchies using PostgreSQL (preferred).
Experience designing asynchronous, event-driven architectures using Kafka, AWS SQS/SNS, RabbitMQ, or Redis Streams (preferred).
Experience building Agentic RAG platforms or developer-facing infrastructure tooling (preferred).

Save