Principal Software Engineer, AI Compute Infrastructure

Arm Holdings

Confirmed live today High trust
Hybrid

Quick summary

Work type
Hybrid
Location
Seattle, WA
Salary
$262,700–$355,400 / yr
Posted
7 days ago
Freshness
Confirmed live today
Nearby
99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $205k
This role $309k
$117k $381k
below market most similar roles pay here above market

This role pays more than 96% of similar roles. Most pay $174,600–$235,750 — the blue band above. At the midpoint, this role pays about $309k versus about $205k for comparable roles.

Based on 240 similar postings.

Employer

About Arm Holdings

Arm Holdings plc is a leading British semiconductor and software design firm, established in 1990 and recognized for developing energy-efficient processor architectures that power nearly all smartphones and a vast range of IoT and computing devices.

Arm Holdings currently has 111 open roles on FindRole.

Listed pay typically runs $207,800–$281,200 across 111 roles with salary data.

Most-posted roles

View all roles at Arm Holdings

At a glance

TL;DR · Principal Software Engineer, AI Compute Infrastructure

Role Posting Log in to save

As a Principal Software Engineer on the AI Compute Infra team, you will design, build, and operate large-scale infrastructure for AI training, fine-tuning, evaluation, and inference. You will manage Kubernetes clusters, accelerator enablement, workload scheduling, high-performance networking, storage, and capacity management to improve reliability and developer productivity. Your daily work involves integrating and validating drivers, networking, and health checks for new CPU and GPU systems while troubleshooting complex performance issues across cloud infrastructure and hardware. You will utilize Go, Python, Linux, and containers to support distributed machine-learning workloads. Preferred technical skills include experience with NVIDIA technologies like CUDA and NVLink, as well as tools such as Terraform, Argo CD, Prometheus, and frameworks like PyTorch, Ray, and vLLM to solve complex infrastructure scaling problems.

What does a Software Engineer earn in Washington?

Median $202800 from 413 postings across 39 companies.

See salary data

Skills

Kubernetes Go Python Linux AWS EKS Terraform Argo CD Helm Prometheus Grafana PyTorch Ray vLLM SGLang TensorRT-LLM CUDA NVLink NVSwitch NCCL EFA DCGM Containers HPC

What you'll do

  • Build and operate large-scale Kubernetes clusters for AI training, fine-tuning, and inference.
  • Improve workload scheduling, topology-aware placement, capacity utilization, and system recovery.
  • Integrate and validate drivers, networking, storage, and health checks for new CPU and GPU systems.
  • Investigate performance and reliability issues across applications, cloud infrastructure, clusters, and hardware.
  • Automate cluster provisioning, upgrades, monitoring, and maintenance for AI research workloads.
  • Develop reliable infrastructure software to support distributed machine-learning workloads.

What we're looking for

  • 8+ years of experience building or operating cloud, compute, HPC, or distributed infrastructure in a production environment.
  • Programming experience in Go, Python, or another systems language.
  • Practical knowledge of Kubernetes, containers, Linux, networking, and storage.
  • Experience supporting GPU, accelerator, or distributed machine-learning workloads.
  • Ability to troubleshoot complex systems and communicate clearly with engineers from different technical backgrounds.
  • Familiarity with Kubernetes scheduling, operators, quotas, or resource management (preferred).
  • Experience with NVIDIA technologies such as CUDA, NVLink, NVSwitch, NCCL, EFA, or DCGM (preferred).
  • Knowledge of AWS EKS, Terraform, Argo CD, Helm, Prometheus, or Grafana (preferred).

Related searches

More Principal Software Engineer jobs Principal Software Engineer jobs in Seattle All jobs at Arm Holdings

More like this

Similar roles

Staff Software Engineer, AI Compute Infrastructure

Arm Holdings

Seattle, WA 49 days ago $209,100–$282,900
Kubernetes Go Python Linux AWS EKS Terraform Argo CD Helm Prometheus Grafana PyTorch Ray vLLM SGLang TensorRT-LLM CUDA NVLink NVSwitch NCCL EFA DCGM HPC
5+ yrs exp Hybrid
Save

Principal Software Engineer, AI Inference Cloud

Arm Holdings

Seattle, WA 49 days ago $262,700–$355,400
Kubernetes Go C++ Rust Python Distributed Systems Cloud Platforms Observability PyTorch Ray vLLM SGLang TensorRT-LLM APIs Networking Capacity Planning
8+ yrs exp Hybrid
Save

Staff Software Engineer, AI Compute Platform

Arm Holdings

Seattle, WA 49 days ago $209,100–$282,900
Go Python Kubernetes Distributed Systems APIs PostgreSQL Kafka Prometheus Grafana OpenTelemetry PyTorch Ray vLLM GitOps RPC Containers Asynchronous Processing
5+ yrs exp Hybrid
Save

Senior Site Reliability Engineer

Nvidia

Remote (Santa Clara, CA) +3 40 days ago
Kubernetes Python Go Linux GitOps Terraform ArgoCD Prometheus Grafana OpenTelemetry ELK Stack Splunk PyTorch TensorRT-LLM CUDA NCCL vLLM SGLang SLOs SLIs Distributed Systems GPU Infrastructure
8+ yrs exp Remote
Save