Staff/Senior ML Infrastructure Engineer, Foundation Model Compute Infra

Apple Inc

Confirmed live 2 days ago Trusted

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$184,700–$324,800 / yr
Posted
83 days ago
Freshness
Confirmed live 2 days ago

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $193k
This role $255k
$121k $347k
below market most similar roles pay here above market

This role pays more than 90% of similar roles. Most pay $144,350–$241,750 — the blue band above. At the midpoint, this role pays about $255k versus about $193k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 3544 open roles on FindRole.

Listed pay typically runs $166,600–$277,600 across 2734 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Staff/Senior ML Infrastructure Engineer, Foundation Model Compute Infra

Staff/Sr. ML Infrastructure Engineer, Foundation Model Compute Infra will join the Foundation Model Compute Infrastructure team to design and build large-scale infrastructure for foundation model training, fine-tuning, evaluation, and inference. The role involves developing model serving services, managing container orchestration, and benchmarking new accelerator technologies. Key responsibilities include optimizing latency, throughput, and accelerator utilization while improving developer productivity for AI workloads. The candidate will utilize technologies including Python, Go, C++, Kubernetes, and frameworks such as JAX, PyTorch, TensorFlow, Ray, Pathways, and vLLM. This position addresses the technical challenges of building reliable, scalable, and multi-tenant distributed systems for large-scale ML workloads. The engineer will collaborate with researchers to integrate complex systems like Pathways and Beam into production-scale infrastructure for model deployment and traffic management.

What you'll do

  • Design and build large-scale model serving and fine-tuning services for foundation model workloads.
  • Develop infrastructure for deployment, autoscaling, traffic management, and container orchestration.
  • Optimize latency, throughput, and accelerator utilization for model serving and fine-tuning workloads.
  • Onboard and benchmark new accelerator technologies into the compute infrastructure.
  • Integrate technologies like Pathways, Ray, and Beam as reliable and scalable services.
  • Improve workflows for launching, monitoring, debugging, and evaluating models.
  • Mentor engineers and influence the technical direction of foundation model compute infrastructure.

What we're looking for

  • Bachelor’s degree in Computer Science, Engineering, or a related field.
  • 5+ years of industry experience building large-scale distributed systems or cloud infrastructure.
  • Experience with distributed ML training or inference systems.
  • Strong programming skills in Python, Go, C++, or similar systems languages.
  • Experience with accelerator infrastructure such as TPU or GPU.
  • Experience with Kubernetes, container orchestration, or large-scale cluster management systems.
  • Strong communication and collaboration skills across engineering and research teams.
  • MS or PhD in Computer Science, Engineering, or related field (preferred).

More like this

Similar roles

Staff ML Infrastructure Engineer

Apple Inc

Cupertino, CA 32 days ago $184,700–$324,800
Python Rust C++ Go PyTorch JAX TensorFlow Kubernetes Docker Ray Data NVIDIA DALI Spark Parquet Iceberg Lance Arrow DataHub OpenLineage Unity Catalog Polars DuckDB Retrieval-Augmented Generation Transformers
10+ yrs exp