Staff/Senior ML Infrastructure Engineer, Foundation Model Compute Infra

Apple Inc

Confirmed live today Trusted

Quick summary

Work type: On-site
Location: Cupertino, CA
Salary: $184,700–$324,800 / yr
Posted: 98 days ago
Freshness: Confirmed live today
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $195k

This role $255k

$122k $347k

below market most similar roles pay here above market

This role pays more than 91% of similar roles. Most pay $148,100–$241,750 — the blue band above. At the midpoint, this role pays about $255k versus about $195k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 3497 open roles on FindRole.

Listed pay typically runs $174,149–$277,600 across 2702 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Staff/Senior ML Infrastructure Engineer, Foundation Model Compute Infra

Role Posting Log in to save

JOB TITLE: Staff/Sr. ML Infrastructure Engineer, Foundation Model Compute Infra As a Staff/Sr. ML Infrastructure Engineer on the Foundation Model Compute Infrastructure team, you will design and build large-scale infrastructure to power foundation model training, fine-tuning, evaluation, and inference. Your daily responsibilities include developing model serving services, managing container orchestration, and benchmarking new accelerator technologies. You will optimize latency, throughput, and accelerator utilization while improving developer productivity for AI workloads. The role requires proficiency in Python, Go, and C++, along with experience in distributed ML training, Kubernetes, and systems like Ray, Pathways, and vLLM. You will solve complex technical problems regarding scalability and reliability for large-scale distributed systems. By collaborating with researchers, you will ensure the infrastructure supports high-performance model deployment, traffic management, and checkpoint loading across production-scale environments.

Skills

Python Go C++ Kubernetes Ray JAX PyTorch TensorFlow vLLM Pathways Beam GPU TPU Distributed Systems Container Orchestration Performance Engineering

What you'll do

Design and build large-scale model serving and fine-tuning services for foundation model workloads.
Develop infrastructure for deployment, autoscaling, traffic management, and container orchestration.
Optimize latency, throughput, and accelerator utilization for model serving and fine-tuning.
Onboard and benchmark new accelerator technologies into the compute infrastructure.
Integrate technologies like Pathways, Ray, and Beam as reliable and scalable services.
Improve workflows for launching, monitoring, debugging, and evaluating models.
Mentor engineers and influence the technical direction of foundation model compute infrastructure.

What we're looking for

Bachelor’s degree in Computer Science, Engineering, or a related field.
5+ years of industry experience building large-scale distributed systems or cloud infrastructure.
Experience with distributed ML training or inference systems.
Strong programming skills in Python, Go, C++, or similar systems languages.
Experience with accelerator infrastructure such as TPU or GPU.
Experience with Kubernetes, container orchestration, or large-scale cluster management systems.
Familiarity with frameworks such as JAX, PyTorch, TensorFlow, Ray, Pathways, or vLLM (preferred).
MS or PhD in Computer Science, Engineering, or a related field (preferred).

Save