Senior Machine Learning Engineer, Foundation Models Inference

Apple Inc

Confirmed live yesterday High trust

Quick summary

Work type: On-site
Location: Seattle, WA
Salary: $175,000–$308,500 / yr
Posted: 28 days ago
Freshness: Confirmed live yesterday
Nearby: 99+ roles within 25 mi

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $230k

This role $242k

$159k most similar roles pay here $325k

This role pays more than 58% of similar roles. Most pay $204,450–$254,750 — the shaded band above. At the midpoint, this role pays about $242k versus about $230k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 1984 open roles on FindRole.

Listed pay typically runs $175,000–$277,600 across 1590 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Senior Machine Learning Engineer, Foundation Models Inference

Role Posting Log in to save

Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference joins the Foundation Model Inference team within the Cloud OS and AI Inference organization. This role sits at the intersection of research and production, where you will partner with research teams to move cutting-edge model architectures from prototype to large-scale deployment. You will be responsible for optimizing inference for language, vision, and speech models while building profiling tools, simulators, and high-throughput serving systems. The work involves solving complex problems in inference efficiency, hardware/software codesign, and systems architecture on purpose-built infrastructure designed for privacy-preserving AI workloads. Required skills include experience with LLM inference stacks, GPU or TPU programming, PyTorch, JAX, or TensorFlow, and deploying applications via Kubernetes and Docker. Preferred expertise includes Go, Python, CUDA C++, OpenAI Triton, and optimization frameworks like TensorRT-LLM or vLLM.

What does a Machine Learning Engineer earn in Washington?

Median $241750 from 66 postings across 14 companies.

See salary data

Skills

LLM Inference PyTorch JAX TensorFlow Python Go CUDA Triton Kubernetes Docker AWS GCP TensorRT-LLM vLLM SGLang TGI Nvidia Triton Server Transformers

What you'll do

Optimize inference for the latest language, vision, and speech model architectures.
Design and deploy production-grade inference systems serving millions of customers in real time.
Build profiling tools and simulators to identify and resolve performance bottlenecks across hardware configurations.
Drive technical decisions regarding high-throughput, low-latency serving at supercomputing scale.
Develop and optimize inference systems on privacy-preserving cloud infrastructure.
Lead the transition of cutting-edge model architectures from prototype to planetary-scale deployment.
Mentor and grow engineers across the organization.

What we're looking for

5+ years of experience leading complex, ambiguous technical projects from end to end.
Hands-on experience with LLM inference stacks.
Working knowledge of GPU or TPU programming concepts.
Proficiency with PyTorch, JAX, or TensorFlow.
Experience building and operating high-throughput services at large distributed scale.
Proficiency deploying applications on cloud platforms using Kubernetes and Docker.
BS in Computer Science, Machine Learning, Artificial Intelligence, Data Science, or a related field.
Experience with Go/Python, deep learning architectures, inference optimization frameworks, or custom CUDA kernels (preferred); MS degree (preferred).

Save