This role pays more than
86%
of similar roles. Most pay
$144,350–$241,750
— the shaded band above.
At the midpoint, this role pays about
$255k
versus about
$193k
for comparable roles.
Based on 240 similar postings.
Employer
About Apple Inc
Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software
Apple Inc currently has
1984 open roles
on FindRole.
Listed pay typically runs
$175,000–$277,600
across 1590 roles with salary data.
Staff/Sr. ML Infrastructure Engineer, Foundation Model Compute Infra joins the Foundation Model Compute Infrastructure team to design and build large-scale infrastructure powering foundation model training, fine-tuning, evaluation, and inference. The role involves developing model serving and fine-tuning services, onboarding and benchmarking new accelerators, and improving reliability, performance, scalability, and developer productivity for AI workloads. Key responsibilities include managing deployment, autoscaling, traffic management, container orchestration, and performance analysis while optimizing latency, throughput, and accelerator utilization. The candidate will work with technologies including Python, Go, C++, Kubernetes, TPU, GPU, JAX, PyTorch, TensorFlow, Ray, Pathways, and vLLM. This position addresses the technical challenges of managing large-scale distributed systems and multi-tenant infrastructure to support complex foundation model workloads through advanced performance engineering, fault tolerance, and resource efficiency in production environments.
Python
Go
C++
Kubernetes
PyTorch
JAX
TensorFlow
Ray
vLLM
Pathways
GPU
TPU
Distributed Systems
Container Orchestration
Performance Engineering
Cloud Infrastructure
Model Serving
Inference
Fine-tuning