Machine Learning Engineer, Visual Agents, Special Projects

Apple Inc

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Cupertino, CA
Salary
$129,300–$225,300 / yr
Posted
147 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $221k
This role $177k
$112k most similar roles pay here $289k

This role pays less than 79% of similar roles. Most pay $187,000–$254,750 — the shaded band above. At the midpoint, this role pays about $177k versus about $221k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 1984 open roles on FindRole.

Listed pay typically runs $175,000–$277,600 across 1590 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Machine Learning Engineer, Visual Agents, Special Projects

Machine Learning Engineer - Visual Agents - Special Projects joins the Special Projects team to develop novel experiences powered by state-of-the-art agentic vision-language models that incorporate visual context into conversational interaction. The role involves building, fine-tuning, and rigorously evaluating these systems while translating ambiguous product requirements into measurable criteria. Key responsibilities include curating multimodal datasets, developing automated evaluation pipelines like LLM-as-judge frameworks, and designing controlled experiments to identify model failure modes. The candidate will work with ML Researchers to define methodologies for foundation models and perform statistical analysis on performance gaps. Required skills include proficiency in Python and machine learning frameworks such as PyTorch or TensorFlow. Experience is required with vision-language models, multimodal systems, and potentially video understanding, temporal reasoning, activity recognition, and agentic system design involving tool use and grounding.

What does a Machine Learning Engineer earn in California?

Median $246394 from 172 postings across 28 companies.

See salary data

What you'll do

  • Build and evaluate vision-language agents that incorporate real-world scene context into conversational models.
  • Curate, annotate, and build multimodal datasets to support model training and evaluation.
  • Develop automated evaluation pipelines including LLM-as-judge frameworks and human evaluation protocols.
  • Fine-tune Large Language Models (LLMs) and Visual-Language Models (VLMs) for specific use cases.
  • Design controlled experiments to measure model capabilities and identify failure modes.
  • Conduct robust statistical analysis to identify performance gaps and model deficiencies.
  • Translate ambiguous product requirements into measurable evaluation criteria and methodologies.

What we're looking for

  • BA or Master's degree in Computer Science or Machine Learning.
  • PhD in Computer Science, Machine Learning, Statistics, or another STEM field is preferred.
  • 2+ years of hands-on experience building and evaluating generative AI or multimodal models.
  • Experience working with vision-language models or multimodal systems.
  • Proficiency in Python and ML frameworks such as PyTorch or TensorFlow.
  • Experience with video understanding, temporal reasoning, or activity recognition.
  • Familiarity with agentic system design including tool use, grounding, or perceive-act loops.
  • Experience building large-scale multimodal data and annotation pipelines.

More like this

Similar roles

Senior ML Engineer, Robotics, Special Projects

Apple Inc

Santa Clara, CA 161 days ago $184,700$324,800
PyTorch TensorFlow Swift LLMs VLMs Robotics 3D Reconstruction Multi-view Geometry Mobile Deployment Machine Learning Deep Learning
3+ yrs exp

Machine Learning Engineer, AI Evaluation & LLM Systems

Apple Inc

Cupertino, CA 43 days ago $150,400$225,300
Python C++ PyTorch TensorFlow JAX LLM Multimodal AI Generative AI Git CI/CD Distributed Computing Cloud Platforms Data Processing Statistical Analysis Machine Learning Software Engineering
1+ yrs exp

Machine Learning Engineer II, Visual AI

Pinterest

Remote 7 days ago $138,905$285,982
Machine Learning Computer Vision Large Language Models Generative Modeling RLHF Fine-tuning SQL Cursor Copilot Codex Recommender Systems Graph Neural Networks
2+ yrs exp Remote