Senior AI Inference Platform Engineer

Apple Inc

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Seattle, WA
Salary
$175,000–$308,500 / yr
Posted
77 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $204k
This role $242k
$144k $326k
below market most similar roles pay here above market

This role pays more than 74% of similar roles. Most pay $162,000–$246,000 — the blue band above. At the midpoint, this role pays about $242k versus about $204k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 3497 open roles on FindRole.

Listed pay typically runs $174,149–$277,600 across 2702 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Senior AI Inference Platform Engineer

The Sr. AI Inference Platform Engineer joins the next-generation datacenter engineering team to build tooling, automation, and analysis capabilities for the AI inference platform. This role involves designing performance benchmarking systems, capacity projection models, and data analysis pipelines to inform infrastructure teams and capacity planners. You will develop automations to evaluate performance across hardware generations, identify bottlenecks, and create workflows to increase data reliability. Key technical requirements include proficiency in Python, Go, and C++, along with experience in distributed systems, GPU accelerator architecture, and statistical analysis. You will utilize tools such as Nsight, Triton, TensorRT-LLM, vLLM, Kubernetes, Prometheus, and Grafana. The work focuses on solving the technical challenges of scaling, optimizing, and forecasting capacity for large-scale AI inference workloads.

What you'll do

  • Design and build automations to evaluate AI inference performance across various hardware generations and configurations.
  • Develop tooling to surface performance trends, regressions, and insights for infrastructure and planning teams.
  • Build projection and forecasting models to support long-term capacity planning decisions.
  • Analyze performance and utilization data to identify bottlenecks and optimization opportunities.
  • Create and enhance performance analysis workflows to increase team velocity and data reliability.
  • Improve the accuracy, coverage, and usability of performance measurement and analysis systems.

What we're looking for

  • BS or MS in Computer Science or a related technical field.
  • 7 or more years of experience with performance and infrastructure engineering in distributed systems.
  • 7 years of experience coding in Python, Go, C++, or other programming languages.
  • Solid understanding of AI/ML inference architecture and the performance characteristics of serving systems.
  • Experience with automation engineering, tooling, and data pipelines to support engineering workflows.
  • Strong knowledge of GPU/accelerator architecture as it relates to AI workloads.
  • Practical statistical knowledge applicable to performance analysis and forecasting.
  • Experience with performance benchmarking and methodologies for AI/ML inference systems (preferred).

More like this

Similar roles

Senior AI Inference Platform Engineer

Apple Inc

Seattle, WA 76 days ago $175,000–$308,500
Python Go C++ Kubernetes Triton TensorRT-LLM vLLM Prometheus Grafana Splunk CI/CD GPU Profiling Nsight Distributed Systems Data Pipelines Performance Benchmarking
7+ yrs exp

Principal Software Engineer, AI Inference Cloud

Arm Holdings

Seattle, WA 48 days ago $262,700–$355,400
Kubernetes Go C++ Rust Python Distributed Systems Cloud Platforms Observability PyTorch Ray vLLM SGLang TensorRT-LLM APIs Networking Capacity Planning
8+ yrs exp Hybrid

Staff Software Engineer, AI Inference Cloud

Arm Holdings

Seattle, WA 48 days ago $209,100–$282,900
Kubernetes Go C++ Rust Python Distributed Systems Cloud Platforms Observability PyTorch Ray vLLM SGLang TensorRT-LLM APIs Networking Capacity Planning
5+ yrs exp Hybrid

Senior AI/ML Platform Engineer

Amd

Santa Clara, CA 97 days ago $204,000–$306,000
Python C++ Go Rust Kubernetes Ray Slurm vLLM SGLang Triton PyTorch JAX MLflow Weights & Biases ROCm HIP CUDA CI/CD Distributed Systems GPU Infrastructure Experiment Tracking Workflow Orchestration EDA Tools Compilers Profilers

Software Engineer, Inference

SpaceX

Palo Alto, CA 69 days ago $135,000–$175,000
Rust C++ Python Go SGLang vLLM TensorRT-LLM Triton Kubernetes Docker gRPC PostgreSQL ClickHouse MongoDB CI/CD GPU Kernels Quantization Speculative Decoding Distributed Systems Observability
2+ yrs exp