Staff/Senior ML Infrastructure Engineer, Foundation Model Compute Infra

Apple Inc

Confirmed live today Trusted

Quick summary

Work type: On-site
Location: Seattle, WA
Salary: $175,000–$308,500 / yr
Posted: 83 days ago
Freshness: Confirmed live today
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $195k

This role $242k

$124k $328k

below market most similar roles pay here above market

This role pays more than 75% of similar roles. Most pay $148,100–$241,750 — the blue band above. At the midpoint, this role pays about $242k versus about $195k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 3497 open roles on FindRole.

Listed pay typically runs $174,149–$277,600 across 2702 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Staff/Senior ML Infrastructure Engineer, Foundation Model Compute Infra

Role Posting Log in to save

JOB TITLE: Staff/Sr. ML Infrastructure Engineer, Foundation Model Compute Infra As a Staff/Sr. ML Infrastructure Engineer on the Foundation Model Compute Infrastructure team, you will design and build large-scale infrastructure to power foundation model training, fine-tuning, evaluation, and inference. Your daily responsibilities include developing model serving services, managing container orchestration, and benchmarking new accelerator technologies. You will optimize latency, throughput, and accelerator utilization while improving developer productivity for AI workloads. The role requires proficiency in Python, Go, and C++, along with experience in distributed ML training, Kubernetes, and large-scale cluster management. You will work with technologies such as Pathways, Ray, Beam, JAX, PyTorch, TensorFlow, and vLLM. This position solves critical technical problems regarding reliability, scalability, and performance for production-scale foundation model compute infrastructure in cloud or hybrid environments.

Skills

Python Go C++ Kubernetes Ray PyTorch TensorFlow JAX vLLM Pathways Beam GPU TPU Distributed Systems Container Orchestration Performance Engineering

What you'll do

Design and build large-scale model serving and fine-tuning services for foundation model workloads.
Develop infrastructure for deployment, autoscaling, traffic management, and container orchestration.
Optimize latency, throughput, and accelerator utilization for model serving and fine-tuning.
Onboard and benchmark new accelerator technologies into the compute infrastructure.
Integrate technologies like Pathways, Ray, and Beam as reliable and scalable services.
Improve workflows for launching, monitoring, debugging, and evaluating models.
Mentor engineers and influence the technical direction of foundation model compute infrastructure.

What we're looking for

Bachelor’s degree in Computer Science, Engineering, or a related field.
5+ years of industry experience building large-scale distributed systems or cloud infrastructure.
Experience with distributed ML training or inference systems.
Strong programming skills in Python, Go, C++, or similar systems languages.
Experience with accelerator infrastructure such as TPU or GPU.
Experience with Kubernetes, container orchestration, or large-scale cluster management systems.
MS or PhD in Computer Science, Engineering, or related field (preferred).
Familiarity with frameworks such as JAX, PyTorch, TensorFlow, Ray, Pathways, or vLLM (preferred).

Save