Senior Machine Learning Engineer, Foundation Models Inference

Apple Inc

Confirmed live today High trust

Quick summary

Work type: On-site
Location: Seattle, WA
Salary: $175,000–$308,500 / yr
Posted: 74 days ago
Freshness: Confirmed live today
Nearby: 99+ roles within 25 mi

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $229k

This role $242k

$159k $325k

below market most similar roles pay here above market

This role pays more than 65% of similar roles. Most pay $202,800–$254,750 — the blue band above. At the midpoint, this role pays about $242k versus about $229k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 3497 open roles on FindRole.

Listed pay typically runs $174,149–$277,600 across 2702 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Senior Machine Learning Engineer, Foundation Models Inference

Role Posting Log in to save

The Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference joins the Foundation Model Inference team within the Cloud OS and AI Inference organization. This role involves partnering with research teams to bring cutting-edge model architectures from prototype to planetary-scale deployment. You will own hard problems in inference efficiency, hardware/software codesign, systems architecture, and tooling while designing production-grade systems for language, vision, and speech models. Key responsibilities include building profiling tools, simulators, and high-throughput serving systems. Required skills include experience with LLM inference stacks, GPU or TPU programming, PyTorch, JAX, or TensorFlow, and deploying applications using Kubernetes and Docker. You will work within Private Cloud Compute to solve performance and privacy challenges for foundation models at supercomputing scale.

What does a Machine Learning Engineer earn in Washington?

Median $241750 from 69 postings across 15 companies.

See salary data

Skills

LLM Inference PyTorch JAX TensorFlow Python Go CUDA C++ OpenAI Triton TensorRT-LLM vLLM SGLang TGI Nvidia Triton Server Kubernetes Docker AWS GCP Transformers TPU Programming

What you'll do

Optimize inference for the latest language, vision, and speech model architectures.
Design and ship production-grade inference systems to serve millions of customers in real time.
Build profiling tools and simulators to identify and resolve performance bottlenecks across hardware configurations.
Drive technical decisions for high-throughput, low-latency serving at supercomputing scale.
Develop and optimize inference systems on top of privacy-preserving cloud infrastructure.
Mentor and grow engineers across the organization.

What we're looking for

5+ years of experience leading complex, ambiguous technical projects from end to end.
Hands-on experience with LLM inference stacks.
Working knowledge of GPU or TPU programming concepts.
Proficiency with PyTorch, JAX, or TensorFlow.
Experience building and operating high-throughput services at large distributed scale.
Proficiency deploying applications on cloud platforms using Kubernetes and Docker.
BS in Computer Science, Machine Learning, Artificial Intelligence, Data Science, or a related field.
MS in Computer Science, Machine Learning, Artificial Intelligence, Data Science, or a related field (preferred).

Save