Machine Learning Engineer, Foundation Model Services

Apple Inc

Confirmed live yesterday High trust

Quick summary

Work type: On-site
Location: Santa Clara, CA
Salary: $184,700–$324,800 / yr
Posted: 11 days ago
Freshness: Confirmed live yesterday
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $229k

This role $255k

$162k $342k

below market most similar roles pay here above market

This role pays more than 82% of similar roles. Most pay $202,800–$254,750 — the blue band above. At the midpoint, this role pays about $255k versus about $229k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 3452 open roles on FindRole.

Listed pay typically runs $166,600–$277,600 across 2651 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Machine Learning Engineer, Foundation Model Services

Role Posting Log in to save

JOB TITLE: Machine Learning Engineer, Foundation Model Services The Machine Learning Engineer, Foundation Model Services joins the team responsible for building the frameworks, services, and tools that run large foundation models in production. This role involves building production-grade solutions to launch models for customers in real time and partnering with researchers to prototype inference for cutting-edge architectures. You will develop tools to identify and remove performance bottlenecks across various hardware and use cases. Key responsibilities include writing high-quality code and operating high-throughput, low-latency services. Required skills include proficiency in Go or Python, experience with cloud platforms like AWS, Azure, or GCP using containers and Kubernetes, and expertise in LLMs, NLP, and Information Retrieval. Preferred experience includes familiarity with Nvidia TensorRT-LLM, vLLM, DeepSpeed, and Nvidia Triton Server.

What does a Machine Learning Engineer earn in California?

Median $231150 from 185 postings across 32 companies.

See salary data

Skills

Python Go Kubernetes Docker AWS Azure GCP LLMs Machine Learning NLP Information Retrieval Statistics Nvidia TensorRT-LLM DeepSpeed Nvidia Triton Server Containers

What you'll do

Build production-grade solutions to launch foundation models for real-time customer use.
Prototype and develop inference for cutting-edge model architectures with research teams.
Build tools to identify and remove performance bottlenecks across different hardware and use cases.
Write high-quality code to develop and maintain large-scale machine learning systems.
Deploy and operate high-throughput, low-latency services using containers and Kubernetes.
Optimize and serve large language, vision, and speech models at scale.

What we're looking for

Bachelor’s degree or higher in Computer Science or a related technical field.
2+ years of industry experience building and shipping production software and/or machine learning systems.
5+ years of industry experience in ML technologies including LLMs, NLP, Information Retrieval, and Statistics.
Proficiency in a modern programming language such as Go or Python.
Experience deploying and operating services on a cloud platform using containers and Kubernetes/Docker.
Experience building or operating high-throughput, low-latency services.
Strong communication and collaboration skills to partner across research and product teams.
Familiarity with Nvidia TensorRT-LLM, vLLM, DeepSpeed, or Nvidia Triton Server (preferred).

Save