Machine Learning Engineer, Foundation Model Services

Apple Inc

Confirmed live today Trusted

Quick summary

Work type: On-site
Location: Seattle, WA
Salary: $175,000–$308,500 / yr
Posted: 76 days ago
Freshness: Confirmed live today
Nearby: 99+ roles within 25 mi

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $229k

This role $242k

$159k $325k

below market most similar roles pay here above market

This role pays more than 62% of similar roles. Most pay $202,800–$254,750 — the blue band above. At the midpoint, this role pays about $242k versus about $229k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 3497 open roles on FindRole.

Listed pay typically runs $174,149–$277,600 across 2702 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Machine Learning Engineer, Foundation Model Services

Role Posting Log in to save

The Machine Learning Engineer, Foundation Model Services joins the Foundation Model Services team to build frameworks, services, and tools that run large foundation models in production. This role involves working closely with product teams to build production-grade solutions for real-time model serving and partnering with researchers to prototype inference for cutting-edge architectures. You will develop tools to identify and remove performance bottlenecks across various hardware and use cases. Key responsibilities include writing high-quality code and operating high-throughput, low-latency services. Required skills include proficiency in Go or Python, experience with cloud platforms like AWS, Azure, or GCP using containers and Kubernetes, and expertise in LLMs, NLP, and Information Retrieval. Preferred experience includes familiarity with Nvidia TensorRT-LLM, vLLM, DeepSpeed, and Nvidia Triton Server.

What does a Machine Learning Engineer earn in Washington?

Median $241750 from 69 postings across 15 companies.

See salary data

Skills

Python Go Kubernetes Docker AWS Azure GCP LLMs NLP TensorRT-LLM DeepSpeed Nvidia Triton Server Machine Learning Information Retrieval Statistics

What you'll do

Build production-grade solutions to launch foundation models for real-time customer use.
Prototype and develop inference for cutting-edge model architectures with foundation model researchers.
Build tools to identify and remove performance bottlenecks across different hardware and use cases.
Write high-quality code to optimize and serve large language, vision, and speech models.
Deploy and operate high-throughput, low-latency services using containers and Kubernetes.
Manage and operate machine learning services on cloud platforms.
Optimize model performance to serve millions of queries at incredibly low latency.

What we're looking for

Bachelor’s degree or higher in Computer Science or a related technical field.
2+ years of industry experience building and shipping production software and/or machine learning systems.
5+ years of industry experience in ML technologies including LLMs, NLP, Information Retrieval, and Statistics.
Proficiency in a modern programming language such as Go or Python.
Experience deploying and operating services on a cloud platform using containers and Kubernetes/Docker.
Experience building or operating high-throughput, low-latency services.
Strong communication and collaboration skills to partner across research and product teams.
Familiarity with Nvidia TensorRT-LLM, vLLM, DeepSpeed, or Nvidia Triton Server (preferred).

Save