Senior Machine Learning Engineer, Foundation Models Inference

Apple Inc

Confirmed live yesterday Trusted

Quick summary

Work type: On-site
Location: Santa Clara, CA
Salary: $184,700–$324,800 / yr
Posted: 11 days ago
Freshness: Confirmed live yesterday
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $229k

This role $255k

$157k $343k

below market most similar roles pay here above market

This role pays more than 87% of similar roles. Most pay $202,800–$254,750 — the blue band above. At the midpoint, this role pays about $255k versus about $229k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 3452 open roles on FindRole.

Listed pay typically runs $166,600–$277,600 across 2651 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Senior Machine Learning Engineer, Foundation Models Inference

Role Posting Log in to save

The Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference joins the Foundation Model Inference team within the Cloud OS and AI Inference organization. This role involves partnering with research teams to bring cutting-edge model architectures from prototype to planetary-scale deployment. You will own hard problems in inference efficiency, hardware/software codesign, systems architecture, and tooling while designing production-grade systems for real-time serving. Key responsibilities include building profiling tools, simulators, and optimizing inference for language, vision, and speech models. Required skills include experience with LLM inference stacks, GPU or TPU programming, PyTorch, JAX, or TensorFlow, and deploying applications using Kubernetes and Docker. You will work within the purpose-built, privacy-preserving cloud infrastructure for AI workloads to solve high-throughput, low-latency serving challenges at supercomputing scale.

What does a Machine Learning Engineer earn in California?

Median $231150 from 185 postings across 32 companies.

See salary data

Skills

LLM Inference PyTorch JAX TensorFlow Python Go CUDA C++ OpenAI Triton TensorRT-LLM vLLM SGLang TGI Nvidia Triton Server Kubernetes Docker AWS GCP Transformers TPU Programming

What you'll do

Optimize inference for the latest language, vision, and speech model architectures.
Design and ship production-grade inference systems to serve millions of customers in real time.
Build profiling tools and simulators to identify and resolve performance bottlenecks across hardware configurations.
Drive technical decisions for high-throughput, low-latency serving at supercomputing scale.
Develop and optimize inference systems on top of purpose-built, privacy-preserving cloud infrastructure.
Mentor and grow engineers across the organization.

What we're looking for

5+ years of experience leading complex, ambiguous technical projects from end to end.
Hands-on experience with LLM inference stacks.
Working knowledge of GPU or TPU programming concepts.
Proficiency with PyTorch, JAX, or TensorFlow.
Experience building and operating high-throughput services at large distributed scale.
Proficiency deploying applications on cloud platforms using Kubernetes and Docker.
BS in Computer Science, Machine Learning, Artificial Intelligence, Data Science, or a related field.
MS in Computer Science, Machine Learning, Artificial Intelligence, Data Science, or a related field (preferred).

Save