This role pays more than
93%
of similar roles. Most pay
$174,600–$241,937
— the shaded band above.
At the midpoint, this role pays about
$309k
versus about
$208k
for comparable roles.
Based on 240 similar postings.
Employer
About Arm Holdings
Arm Holdings plc is a leading British semiconductor and software design firm, established in 1990 and recognized for developing energy-efficient processor architectures that power nearly all smartphones and a vast range of IoT and computing devices.
Arm Holdings currently has
48 open roles
on FindRole.
Listed pay typically runs
$209,100–$282,900
across 47 roles with salary data.
As a Principal Software Engineer on the AI Inference Cloud team, you will shape technical direction and develop highly available, scalable services for running AI inference workloads. You will define architecture and build Kubernetes controllers and platform capabilities to support workload deployment, scheduling, recovery, scaling, and lifecycle management. Your daily work involves establishing production practices for health validation, progressive rollouts, and observability while resolving complex issues across networking and compute infrastructure. The role requires extensive experience in distributed systems and deep expertise with Kubernetes operators and resource management. You will utilize programming languages such as Go, C++, Rust, or Python to build reliable services. Preferred technical skills include familiarity with PyTorch, Ray, vLLM, SGLang, or TensorRT-LLM. This role focuses on solving the technical challenges of model serving and accelerator-backed workloads within an AI inference platform.
What does a Software Engineer earn in Washington?
Median $202800 from 318 postings across 31 companies.
Python
Go
C++
Triton
TensorRT-LLM
vLLM
Kubernetes
Prometheus
Grafana
Splunk
CI/CD
Data Pipelines
Performance Benchmarking
Distributed Systems
Capacity Planning
Python
Go
C++
Triton
TensorRT-LLM
vLLM
Kubernetes
Prometheus
Grafana
Splunk
CI/CD
Data Pipelines
Performance Benchmarking
Distributed Systems
Capacity Planning
Python
Go
Java
C++
Kubernetes
OCI
LLM
Machine Learning
PyTorch
TensorFlow
Hugging Face
CI/CD
Microservices
Distributed Systems
Infrastructure Automation