Senior Machine Learning Engineer, Speech LLM Evaluation

Apple Inc

Confirmed live 2 days ago High trust

Quick summary

Work type: On-site
Location: Cambridge, MA
Salary: $165,800–$292,400 / yr
Posted: 51 days ago
Freshness: Confirmed live 2 days ago
Nearby: 99+ roles within 25 mi

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $234k

This role $229k

$151k $308k

below market most similar roles pay here above market

This role pays less than 56% of similar roles. Most pay $212,448–$254,750 — the blue band above. At the midpoint, this role pays about $229k versus about $234k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 3535 open roles on FindRole.

Listed pay typically runs $166,600–$277,600 across 2738 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Senior Machine Learning Engineer, Speech LLM Evaluation

Role Posting Log in to save

The Sr. Machine Learning Engineer, Speech LLM Evaluation joins the Speech Evaluation team within the Siri organization. This role owns the data and metrics foundation for evaluating speech large language models, specifically focusing on real-time speech understanding and generation. You will design and curate audio evaluation datasets for personalized, multilingual, and conversational scenarios while defining metrics for accuracy, robustness, and conversational quality. Day-to-day responsibilities include building automated evaluation pipelines, developing LLM-as-judge tooling, and analyzing results to identify accuracy gaps. You will utilize Python, statistics, and distributed data processing frameworks like Spark to manage large-scale audio datasets. The work involves solving technical challenges in ASR, TTS, and real-time conversational AI by establishing rigorous evaluation methodologies for models that listen, speak, and reason.

What does a Machine Learning Engineer earn?

Median $231150 from 316 postings across 48 companies.

See salary data

Skills

Python LLM Evaluation TTS NLP Data Processing Pipelines Spark Statistics LLM-as-judge

What you'll do

Design and curate audio evaluation datasets representing real-world usage, including multilingual and conversational scenarios.
Define and implement evaluation metrics for audio LLMs covering accuracy, robustness, and conversational quality.
Build automated evaluation pipelines and LLM-as-judge tooling to scale model assessment.
Analyze model evaluation results to identify accuracy gaps and communicate findings to modeling teams.
Design rating protocols for human-evaluation programs to validate automated metric correlations.
Integrate new evaluation sets and metrics into shared tooling with infrastructure teams.
Develop evaluation methodologies for emerging audio LLM capabilities and novel model behaviors.

What we're looking for

Bachelor's degree in Computer Science, Electrical Engineering, or a related field, or equivalent practical experience.
Experience building or working with text, speech, or audio evaluation pipelines and metrics.
Proficiency in Python and experience building data processing pipelines at scale.
Experience curating or annotating datasets for machine learning evaluation or training.
Working knowledge of statistics as applied to measuring model performance and interpreting evaluation results.
Familiarity with large language model evaluation techniques, including automated (LLM-as-judge) and human evaluation methods.
Strong written and verbal communication skills to explain evaluation results to technical and non-technical audiences.
Experience evaluating audio-native or multimodal large language models (preferred).