This role pays more than
64%
of similar roles. Most pay
$162,000–$246,271
— the shaded band above.
At the midpoint, this role pays about
$242k
versus about
$204k
for comparable roles.
Based on 240 similar postings.
Employer
About Apple Inc
Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software
Apple Inc currently has
1984 open roles
on FindRole.
Listed pay typically runs
$175,000–$277,600
across 1590 roles with salary data.
As a Sr. AI Inference Platform Engineer within the next-generation datacenter engineering team, you will build tooling, automation, and analysis capabilities to strengthen the AI inference platform. You will design systems to evaluate performance across hardware generations, develop tools to surface trends and regressions, and create projection models for long-term capacity planning. Your daily work involves analyzing performance and utilization data to identify bottlenecks and optimize infrastructure. The role requires expertise in Python, Go, or C++, along with a deep understanding of AI/ML inference architecture, GPU accelerator architecture, and distributed systems. You will utilize tools such as Nsight, Triton, TensorRT-LLM, vLLM, Kubernetes, Prometheus, and Grafana to solve complex problems regarding the scaling and reliability of large-scale infrastructure for serving models efficiently across diverse hardware configurations.
Python
Go
C++
Triton
TensorRT-LLM
vLLM
Kubernetes
Prometheus
Grafana
Splunk
CI/CD
Data Pipelines
Performance Benchmarking
Distributed Systems
Capacity Planning
Python
C++
Go
Rust
Kubernetes
Ray
Slurm
vLLM
SGLang
Triton
PyTorch
JAX
ROCm
HIP
CUDA
MLflow
Weights & Biases
CI/CD
Distributed Systems
GPU Infrastructure