Senior Software Engineer, Agentic Evaluation

Apple Inc

Confirmed live yesterday Trusted

Quick summary

Work type
On-site
Location
Cupertino, CA
Salary
$184,700–$324,800 / yr
Posted
93 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $210k
This role $255k
$140k most similar roles pay here $345k

This role pays more than 85% of similar roles. Most pay $177,250–$243,412 — the shaded band above. At the midpoint, this role pays about $255k versus about $210k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 1984 open roles on FindRole.

Listed pay typically runs $175,000–$277,600 across 1590 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Senior Software Engineer, Agentic Evaluation

Sr. Software Engineer: Agentic Evaluation joins the Siri organization to develop infrastructure, tooling, and pipelines that evaluate the AI assistant reliably at scale. The role involves extending evaluation capabilities across various devices and platforms while transforming ambiguous early requirements into concrete, automated coverage for new features and interaction modalities. You will diagnose failures across the stack, from environment provisioning to scoring, and contribute to architectural decisions for evaluation systems. Key responsibilities include collaborating with infrastructure and program teams to align on shared standards. The position requires proficiency in Python and compiled languages like Swift, C++, or Objective-C. Candidates should possess strong computer science fundamentals and experience evaluating ML, LLM, or agent-based systems. This role focuses on the technical challenge of ensuring consistent performance for an integrated assistant with personal context understanding and on-screen awareness.

What does a Software Engineer earn in California?

Median $214000 from 775 postings across 63 companies.

See salary data

What you'll do

  • Develop infrastructure and pipelines to evaluate Siri features reliably at scale.
  • Extend evaluation capabilities across multiple devices, platforms, and runtime environments.
  • Translate ambiguous early requirements into concrete, automated coverage for new interaction modalities.
  • Diagnose failures across the stack from environment provisioning through pipeline execution and scoring.
  • Implement auto-diagnostics and drive durable fixes for system failures.
  • Contribute to architectural decisions for the team's evaluation systems.
  • Design and operate large-scale test infrastructure including device provisioning and continuous integration.
  • Evaluate ML, LLM, or agent-based systems using specific metrics and scoring methodologies.

What we're looking for

  • Bachelor's or Master's degree in Computer Science, Machine Learning, or a related field (or equivalent experience).
  • Strong programming skills in at least one compiled language such as Swift, C++, or Objective-C.
  • Proficiency in Python for tooling and automation.
  • Solid understanding of computer science fundamentals.
  • Experience evaluating ML, LLM, or agent-based systems including metrics and scoring methodology.
  • Experience designing or operating large-scale test infrastructure and continuous integration systems.
  • Experience staging and provisioning test environments to produce repeatable, deterministic conditions.
  • Ability to communicate effectively with both technical and program audiences while navigating ambiguous requirements.

More like this

Similar roles

Software Engineer, Evaluation Engineering

Apple Inc

Cupertino, CA 93 days ago $150,400$225,300
Swift C++ Objective-C Python iOS macOS visionOS watchOS LLM Machine Learning CLI Systems Engineering Telemetry Trace Collection Process Management Automation Scripts

Senior Software Engineer, Agentic Systems

Adobe

San Jose, CA 64 days ago $183,300$265,350
LLM RAG Python PyTorch TensorFlow Kubernetes Docker AWS Transformers Diffusion Models GANs CLIP MLLMs NVIDIA Triton TorchServe ONNX CUDA Distributed Systems
5+ yrs exp

Machine Learning Engineer, Agentic AI Evaluation Frameworks

Apple Inc

Cupertino, CA 2 days ago $184,700$277,600
Python LLM Generative AI RAG NLP Agentic AI CI/CD Machine Learning Data Pipelines Statistical Analysis Human-in-the-Loop Evaluation Frameworks Multi-turn Conversation Recommendation Systems
7+ yrs exp

Senior Lead Software Engineer, Agentic AI

JPMorgan Chase

Jersey City, NJ 2 days ago
Agentic AI LLMs Python Java LangGraph Semantic Kernel CrewAI AWS Microservices RESTful APIs GraphQL gRPC Docker Kubernetes CI/CD Infrastructure as Code NoSQL Relational Databases Prompt Engineering Retrieval-Augmented Generation
5+ yrs exp