below marketmost similar roles pay hereabove market
This role pays more than
95%
of similar roles. Most pay
$174,600–$242,612
— the blue band above.
At the midpoint, this role pays about
$309k
versus about
$209k
for comparable roles.
Based on 240 similar postings.
Employer
About Arm Holdings
Arm Holdings plc is a leading British semiconductor and software design firm, established in 1990 and recognized for developing energy-efficient processor architectures that power nearly all smartphones and a vast range of IoT and computing devices.
Arm Holdings currently has
113 open roles
on FindRole.
Listed pay typically runs
$208,450–$282,050
across 112 roles with salary data.
As a Principal Software Engineer on the AI Inference Cloud team, you will shape the technical direction and develop highly available, scalable services for running AI inference workloads. You will define and build the architecture for cloud-based AI inference services, developing Kubernetes controllers and platform capabilities to support workload deployment, scheduling, recovery, scaling, and lifecycle management. You will establish production practices for health validation, progressive rollout, and observability while improving platform reliability and resource efficiency. The role requires deep production experience with Kubernetes, networking, and compute infrastructure, alongside hands-on programming skills in Go, C++, Rust, or Python. You will solve complex technical problems involving distributed systems, APIs, and capacity planning, potentially utilizing frameworks like PyTorch, Ray, vLLM, SGLang, or TensorRT-LLM to optimize inference performance and accelerator-backed workloads.
What does a Software Engineer earn in Washington?
Median $202800 from 409 postings across 38 companies.
Python
Go
Java
C++
Kubernetes
OCI
Distributed Systems
Machine Learning
LLMs
CI/CD
PyTorch
TensorFlow
Hugging Face Transformers
Microservices
Event-driven Systems
Infrastructure Automation
Service Mesh
APIs
Data Modeling
C++
Rust
Python
AI Inference
Kernel Development
ML Systems
Compilers
performance-engineering
Memory Management
Parallel Programming
Assembly
Graph Optimization
Collective Communication
High-Performance Networking
Benchmarking
Operator Fusion
Kubernetes
Go
Python
Linux
AWS
EKS
Terraform
Argo CD
Helm
Prometheus
Grafana
PyTorch
Ray
vLLM
SGLang
TensorRT-LLM
CUDA
NVLink
NVSwitch
NCCL
EFA
DCGM
Containers
HPC