This role pays more than
69%
of similar roles. Most pay
$197,750–$254,750
— the shaded band above.
At the midpoint, this role pays about
$246k
versus about
$226k
for comparable roles.
Based on 240 similar postings.
Employer
About Arm Holdings
Arm Holdings plc is a leading British semiconductor and software design firm, established in 1990 and recognized for developing energy-efficient processor architectures that power nearly all smartphones and a vast range of IoT and computing devices.
Arm Holdings currently has
48 open roles
on FindRole.
Listed pay typically runs
$209,100–$282,900
across 47 roles with salary data.
As a Staff Software Engineer, AI Inference Cloud, you will join the AI Inference Cloud team to shape technical direction and develop highly available, scalable services for running AI inference workloads. You will define architecture and build Kubernetes controllers and platform capabilities to support workload deployment, scheduling, recovery, scaling, and lifecycle management. Your daily work involves establishing production practices for health validation, observability, and service objectives while resolving complex issues across networking and compute infrastructure. The role requires deep experience with Kubernetes, distributed systems, and programming in Go, C++, Rust, or Python. You will also engage with technologies such as PyTorch, Ray, vLLM, SGLang, and TensorRT-LLM to optimize model serving and accelerator-backed workloads. This position focuses on solving the technical challenges of infrastructure for large-scale AI inference and improving resource efficiency across the platform.
What does a Software Engineer earn in Washington?
Median $202800 from 318 postings across 31 companies.
Python
Go
C++
Triton
TensorRT-LLM
vLLM
Kubernetes
Prometheus
Grafana
Splunk
CI/CD
Data Pipelines
Performance Benchmarking
Distributed Systems
Capacity Planning
Python
Go
C++
Triton
TensorRT-LLM
vLLM
Kubernetes
Prometheus
Grafana
Splunk
CI/CD
Data Pipelines
Performance Benchmarking
Distributed Systems
Capacity Planning