below marketmost similar roles pay hereabove market
This role pays more than
91%
of similar roles. Most pay
$188,675–$254,750
— the blue band above.
At the midpoint, this role pays about
$281k
versus about
$222k
for comparable roles.
Based on 240 similar postings.
Employer
About Apple Inc
Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software
Apple Inc currently has
3497 open roles
on FindRole.
Listed pay typically runs
$174,149–$277,600
across 2702 roles with salary data.
The AIML - Manager, Applied AI Science - LLM/VLM-as-a-judge leads a team of applied AI scientists and machine learning engineers within the Evaluation organization. This manager sets the technical vision and roadmap for developing state-of-the-art autograder systems to assess the quality of internal GenAI products. Key responsibilities include hiring, talent development, and building scalable LLM/VLM-based evaluation systems that provide reliable product-quality decisions. The role requires deep expertise in GenAI models, model alignment, benchmark creation, and rubric design. Candidates must demonstrate proficiency in developing automated evaluation workflows and translating research into production-ready systems. The work focuses on providing principled assessments for diverse features, including Search and Siri, by creating trustworthy automated evaluation foundations that allow the organization to scale beyond bespoke autograder development.
Lead and grow a high-performing team of applied AI scientists and machine learning engineers.
Set the technical vision and roadmap for autograder development and evaluation methodologies.
Deliver reliable and scalable LLM/VLM-based evaluation systems for product-quality decisions.
Identify opportunities to standardize and automate end-to-end evaluation workflows.
Translate emerging GenAI techniques and research into production-ready systems.
Navigate complex technical challenges and resolve cross-functional dependencies across the organization.
Develop senior machine learning engineers and technical leads through active mentorship.
What we're looking for
MS/PhD degree in Computer Science, Machine Learning, AI, or a related field.
1+ years of industry experience building LLM/VLM-based evaluators, autograders, or automated evaluation systems.
5+ years of hands-on experience in machine learning, model alignment, or benchmark creation.
Track record of managing teams of 3+ machine learning engineers and/or AI scientists.
Deep understanding of GenAI models, evaluation methodologies, rubric design, evaluation set development, validation, calibration, and human-model alignment.
Strong technical judgment and a track record of leading complex, ambiguous AI/ML projects from definition through delivery (preferred).
Experience translating emerging GenAI techniques and research into reliable, production-ready systems (preferred).
Experience scaling AI/ML solutions into reusable platforms, frameworks, or standardized workflows (preferred).
LLMs
Natural Language Processing
Python
PyTorch
JAX
Reinforcement Learning
Distributed Training
Machine Translation
Bash
Java
C
C++
Data Filtering
Curriculum Learning
Post-training
Evaluation Methodologies