Staff Senior ML Infrastructure Engineer, Foundation Model Compute Infra

Apple Inc

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Seattle, WA
Salary
$175,000–$308,500 / yr
Posted
38 days ago
Freshness
Confirmed live yesterday
Nearby
99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $193k
This role $242k
$117k most similar roles pay here $329k

This role pays more than 76% of similar roles. Most pay $144,350–$241,750 — the shaded band above. At the midpoint, this role pays about $242k versus about $193k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 1984 open roles on FindRole.

Listed pay typically runs $175,000–$277,600 across 1590 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Staff Senior ML Infrastructure Engineer, Foundation Model Compute Infra

Role Posting Log in to save

Staff/Sr. ML Infrastructure Engineer, Foundation Model Compute Infra joins the Foundation Model Compute Infrastructure team to design and build large-scale infrastructure supporting foundation model training, fine-tuning, evaluation, and inference. The role involves developing model serving and fine-tuning services, onboarding and benchmarking new accelerators, and improving reliability, performance, scalability, and developer productivity for AI workloads. Key responsibilities include managing deployment, autoscaling, traffic management, container orchestration, and performance analysis while optimizing latency, throughput, and accelerator utilization. Candidates should possess experience with distributed systems, cloud infrastructure, and hardware like GPUs or TPUs. Technical requirements include proficiency in Python, Go, or C++, along with familiarity with Kubernetes and frameworks such as JAX, PyTorch, TensorFlow, Ray, Pathways, or vLLM. The role focuses on solving complex technical challenges related to large-scale distributed systems for production-scale foundation model workloads.

Skills

Python Go C++ Kubernetes PyTorch JAX TensorFlow Ray vLLM Pathways GPU TPU Distributed Systems Container Orchestration Performance Engineering Cloud Infrastructure Model Serving Inference Fine-tuning

What you'll do

  • Design and evolve large-scale model serving and fine-tuning services for foundation model workloads.
  • Build infrastructure for deployment, autoscaling, traffic management, and container orchestration.
  • Optimize performance metrics including latency, throughput, availability, and accelerator utilization.
  • Improve developer productivity by optimizing workflows for launching, monitoring, debugging, and deploying models.
  • Onboard and benchmark new accelerator technologies into the existing compute infrastructure.
  • Integrate distributed systems technologies like Pathways, Ray, and Beam as reliable services.
  • Mentor engineers and influence the technical direction of foundation model compute infrastructure.

What we're looking for

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Master's or PhD in Computer Science or Engineering is preferred.
  • 5+ years of industry experience building large-scale distributed systems or cloud infrastructure.
  • Experience with distributed ML training or inference systems.
  • Strong programming skills in Python, Go, C++, or similar systems languages.
  • Experience with accelerator infrastructure such as TPU or GPU.
  • Experience with Kubernetes, container orchestration, or large-scale cluster management systems.
  • Familiarity with frameworks such as JAX, PyTorch, TensorFlow, Ray, Pathways, or vLLM.

Related searches

More Staff jobs Staff jobs in Seattle All jobs at Apple Inc

More like this

Similar roles

Senior ML Infrastructure Engineer

Apple Inc

Seattle, WA 141 days ago $175,000–$308,500
Machine Learning Generative AI LLMs Multi-threaded Programming Distributed Data Systems Feature Engineering Pipelines macOS iOS
Save

Senior ML Infrastructure Engineer

Apple Inc

Seattle, WA 148 days ago $175,000–$308,500
Machine Learning Generative AI LLMs Multi-threaded Programming Distributed Data Systems Feature Engineering Pipelines macOS iOS
Save

Senior ML Infrastructure Engineer

Apple Inc

Cupertino, CA 160 days ago $184,700–$324,800
Machine Learning Generative AI Large Language Models LLMs Multi-threaded Programming Distributed Data Systems Feature Engineering Pipelines macOS iOS
Save

Senior ML Infrastructure Engineer

Apple Inc

Cupertino, CA 141 days ago $184,700–$324,800
Machine Learning Generative AI LLMs Multi-threaded Programming Distributed Data Systems Feature Engineering Pipelines macOS iOS
Save