Senior Machine Learning Engineer, Speech LLM Evaluation

Apple Inc

Confirmed live today High trust

Quick summary

Work type: On-site
Location: Cambridge, MA
Salary: $165,800–$292,400 / yr
Posted: 2 days ago
Freshness: Confirmed live today
Nearby: 99+ roles within 25 mi

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $229k

This role $229k

$151k most similar roles pay here $308k

This role pays less than 52% of similar roles. Most pay $202,412–$254,750 — the shaded band above. At the midpoint, this role pays about $229k versus about $229k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 2000 open roles on FindRole.

Listed pay typically runs $175,000–$277,600 across 1613 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Senior Machine Learning Engineer, Speech LLM Evaluation

Role Posting Log in to save

As a Sr. Machine Learning Engineer, Speech LLM Evaluation within the Siri organization, you will join the Speech Evaluation team to focus on evaluating audio large language models. You will own the data and metrics foundation for real-time speech understanding and generation models, ensuring they meet standards for accuracy, robustness, and conversational quality. Your daily work involves designing and curating multi-turn, multilingual evaluation datasets, building automated pipelines with LLM-as-judge tooling, and analyzing results to identify performance gaps. You will collaborate with modeling, infrastructure, and product partners to integrate metrics into shared tools and develop rating protocols for human evaluation programs. To succeed, you must be proficient in Python and data processing at scale while possessing expertise in speech or audio evaluation pipelines, statistics, and large language model evaluation techniques including automated and human-based methods.

What does a Machine Learning Engineer earn?

Median $235750 from 324 postings across 54 companies.

See salary data

Skills

Python LLM ASR TTS NLP Spark Machine Learning Data Processing Pipelines Statistics Human Evaluation

What you'll do

Design and curate audio evaluation datasets covering personalized, multilingual, and conversational scenarios.
Define and implement metrics for accuracy, robustness, and conversational quality in speech LLMs.
Build automated evaluation pipelines and "LLM-as-judge" tooling to scale model assessment.
Analyze evaluation results to identify performance gaps and provide actionable feedback to modeling teams.
Design rating protocols for human evaluation programs to validate automated metric correlation.
Integrate new evaluation sets and metrics into shared infrastructure tools.
Develop evaluation methodologies for emerging audio LLM capabilities and novel model behaviors.

What we're looking for

Bachelor's degree in Computer Science, Electrical Engineering, or a related field, or equivalent practical experience.
Experience building or working with text, speech, or audio evaluation pipelines and metrics.
Proficiency in Python and experience building data processing pipelines at scale.
Experience curating or annotating datasets for machine learning evaluation or training.
Working knowledge of statistics as applied to measuring model performance and interpreting results.
Familiarity with large language model evaluation techniques, including automated (LLM-as-judge) and human evaluation methods.
Strong written and verbal communication skills to explain results to technical and non-technical audiences.
Experience evaluating audio-native or multimodal models; designing human studies; and multilingual dataset development (preferred).