Senior Machine Learning Engineer, Speech LLM Evaluation

Apple Inc

Confirmed live today High trust

Quick summary

Work type: On-site
Location: Cupertino, CA
Salary: $184,700–$324,800 / yr
Posted: 47 days ago
Freshness: Confirmed live today
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $232k

This role $255k

$159k $343k

below market most similar roles pay here above market

This role pays more than 82% of similar roles. Most pay $208,743–$254,750 — the blue band above. At the midpoint, this role pays about $255k versus about $232k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 3497 open roles on FindRole.

Listed pay typically runs $174,149–$277,600 across 2702 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Senior Machine Learning Engineer, Speech LLM Evaluation

Role Posting Log in to save

The Sr. Machine Learning Engineer, Speech LLM Evaluation joins the Speech Evaluation team within the Siri organization. This role owns the data and metrics foundation for evaluating speech large language models, specifically focusing on real-time speech understanding and generation. You will design and curate audio evaluation datasets for personalized, multilingual, and conversational scenarios while defining metrics for accuracy, robustness, and conversational quality. Day-to-day tasks include building automated evaluation pipelines, developing LLM-as-judge tooling, and analyzing results to identify accuracy gaps. You will utilize Python, statistics, and distributed data processing frameworks like Spark to manage large-scale audio datasets. The work addresses the technical challenge of measuring a new class of models that listen, speak, and reason while ensuring reliable performance across various operating systems.

What does a Machine Learning Engineer earn in California?

Median $235750 from 200 postings across 34 companies.

See salary data

Skills

Python LLM ASR TTS NLP Spark Data Processing Pipelines LLM-as-judge Statistics Audio ML Human Evaluation Distributed Data Processing

What you'll do

Design and curate audio evaluation datasets representing real-world, multilingual, and conversational scenarios.
Define and implement evaluation metrics for audio LLMs covering accuracy, robustness, and conversational quality.
Build automated evaluation pipelines and LLM-as-judge tooling to scale model assessment.
Analyze model evaluation results to identify accuracy gaps and communicate findings to modeling teams.
Design rating protocols for human-evaluation programs to validate automated metrics against human judgment.
Integrate new evaluation sets and metrics into shared infrastructure and tooling.
Develop evaluation methodologies for emerging audio LLM capabilities and novel model behaviors.

What we're looking for

Bachelor's degree in Computer Science, Electrical Engineering, or a related field, or equivalent practical experience.
Experience building or working with text, speech, or audio evaluation pipelines and metrics.
Proficiency in Python and experience building data processing pipelines at scale.
Experience curating or annotating datasets for machine learning evaluation or training.
Working knowledge of statistics as applied to measuring model performance and interpreting evaluation results.
Familiarity with large language model evaluation techniques, including automated (LLM-as-judge) and human evaluation methods.
Strong written and verbal communication skills to explain evaluation results to technical and non-technical audiences.
Experience evaluating audio-native or multimodal large language models (preferred).