Machine Learning Engineer, Foundation Model Services

Apple Inc

Confirmed live 2 days ago High trust

Quick summary

Work type
On-site
Location
Seattle, WA
Salary
$175,000–$308,500 / yr
Posted
30 days ago
Freshness
Confirmed live 2 days ago

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $227k
This role $242k
$159k most similar roles pay here $325k

This role pays more than 60% of similar roles. Most pay $197,925–$255,487 — the shaded band above. At the midpoint, this role pays about $242k versus about $227k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 1984 open roles on FindRole.

Listed pay typically runs $175,000–$277,600 across 1590 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Machine Learning Engineer, Foundation Model Services

As a Machine Learning Engineer, Foundation Model Services, you will join the team responsible for building the frameworks, services, and tools that run large foundation models in production. You will work closely with product teams to build production-grade solutions for real-time model serving while partnering with researchers to prototype inference for cutting-edge architectures. Your daily work involves developing tools to identify and remove performance bottlenecks across various hardware types and use cases. The role requires proficiency in Go or Python, along with experience in LLMs, NLP, Information Retrieval, Statistics, and deploying services on cloud platforms using containers and Kubernetes or Docker. You will focus on optimizing high-throughput, low-latency systems for large language, vision, and speech models. Preferred technical skills include familiarity with Nvidia TensorRT-LLM, vLLM, DeepSpeed, and Nvidia Triton Server.

What does a Machine Learning Engineer earn in Washington?

Median $241750 from 66 postings across 14 companies.

See salary data

What you'll do

  • Build production-grade solutions to serve large language, vision, and speech models to customers in real time.
  • Develop inference systems for cutting-edge model architectures in partnership with foundation model researchers.
  • Create tools to identify and remove performance bottlenecks across various hardware platforms and use cases.
  • Optimize and serve high-throughput, low-latency services at a massive scale.
  • Write high-quality code to build the frameworks and infrastructure that run large foundation models.
  • Deploy and operate machine learning services using containers and Kubernetes/Docker on cloud platforms.
  • Implement advanced ML technologies including LLMs, NLP, and information retrieval systems.

What we're looking for

  • Bachelor's degree or higher in Computer Science or a related technical field.
  • 2+ years of industry experience building and shipping production software and/or machine learning systems.
  • 5+ years of industry experience in ML technologies including LLMs, Machine Learning, NLP, Information Retrieval, and Statistics.
  • Proficiency in a modern programming language such as Go or Python.
  • Experience deploying and operating services on cloud platforms using containers and Kubernetes/Docker.
  • Experience building or operating high-throughput, low-latency services.
  • Strong communication and collaboration skills to partner across research and product teams.
  • Familiarity with Nvidia TensorRT-LLM, vLLM, DeepSpeed, or Nvidia Triton Server (preferred).

More like this

Similar roles

Machine Learning Engineer

Apple Inc

Sunnyvale, CA 8 days ago $216,200$324,800
LLM PyTorch TensorFlow JAX Transformers MoE Computer Vision Natural Language Processing Distributed Data Processing Machine Learning Deep Learning OCR Synthetic Data Generation Data Curation High Performance Computing

Machine Learning Engineer, Foundation Model Services

Apple Inc

Seattle, WA 113 days ago $175,000$308,500
LLMs Machine Learning NLP Python Golang Kubernetes Docker AWS Azure PyTorch TensorFlow Transformers Nvidia TensorRT-LLM DeepSpeed Nvidia Triton Server Information Retrieval Statistics
5+ yrs exp

Machine Learning Engineer, Foundation Model Services

Apple Inc

Santa Clara, CA 113 days ago $184,700$324,800
LLMs Machine Learning NLP Information Retrieval Python Golang Kubernetes Docker AWS Azure PyTorch TensorFlow Transformers Nvidia TensorRT-LLM DeepSpeed Nvidia Triton Server
5+ yrs exp

Machine Learning Engineer

Q2

Austin, TX 28 days ago
Machine Learning Python R Java TensorFlow PyTorch scikit-learn Statistics Probability Theory Optimization Experimental Methodologies
5+ yrs exp Hybrid