Staff Software Engineer, AI Compute Infrastructure

Arm Holdings

Confirmed live yesterday High trust
Hybrid

Quick summary

Work type
Hybrid
Location
Seattle, WA
Salary
$209,100–$282,900 / yr
Posted
50 days ago
Freshness
Confirmed live yesterday
Nearby
99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $212k
This role $246k
$157k $296k
below market most similar roles pay here above market

This role pays more than 79% of similar roles. Most pay $183,837–$239,987 — the blue band above. At the midpoint, this role pays about $246k versus about $212k for comparable roles.

Based on 240 similar postings.

Employer

About Arm Holdings

Arm Holdings plc is a leading British semiconductor and software design firm, established in 1990 and recognized for developing energy-efficient processor architectures that power nearly all smartphones and a vast range of IoT and computing devices.

Arm Holdings currently has 112 open roles on FindRole.

Listed pay typically runs $207,800–$281,200 across 112 roles with salary data.

Most-posted roles

View all roles at Arm Holdings

At a glance

TL;DR · Staff Software Engineer, AI Compute Infrastructure

Role Posting Log in to save

As a Staff Software Engineer, AI Compute Infrastructure, you will join the AI Compute Infra team to design, build, and operate large-scale infrastructure for AI training, fine-tuning, evaluation, and inference. You will manage Kubernetes clusters, accelerator enablement, workload scheduling, high-performance networking, storage, and capacity management to improve reliability and developer productivity. Daily tasks include integrating and validating drivers for CPU and GPU systems, investigating performance issues across cloud infrastructure, and automating cluster provisioning. You will utilize Go, Python, Linux, and containers while leveraging technologies like CUDA, NVLink, NVSwitch, NCCL, EFA, DCGM, AWS EKS, Terraform, Argo CD, Helm, Prometheus, and Grafana. You will also work with frameworks such as PyTorch, Ray, vLLM, SGLang, and TensorRT-LLM to solve complex distributed machine-learning workload challenges.

What does a Software Engineer earn in Washington?

Median $202800 from 405 postings across 38 companies.

See salary data

Skills

Kubernetes Go Python Linux AWS EKS Terraform Argo CD Helm Prometheus Grafana PyTorch Ray vLLM SGLang TensorRT-LLM CUDA NVLink NVSwitch NCCL EFA DCGM HPC

What you'll do

  • Build and operate large-scale Kubernetes clusters for AI training, fine-tuning, and inference.
  • Improve workload scheduling, topology-aware placement, capacity utilization, and system recovery.
  • Integrate and validate drivers, networking, storage, and health checks for new CPU and GPU systems.
  • Investigate and resolve performance and reliability issues across applications, cloud infrastructure, and hardware.
  • Automate cluster provisioning, upgrades, monitoring, and maintenance for AI research workloads.
  • Develop reliable infrastructure software to support distributed machine-learning workloads.

What we're looking for

  • 5+ years of experience building or operating cloud, compute, HPC, or distributed infrastructure in a production environment.
  • Programming experience in Go, Python, or another systems language.
  • Practical knowledge of Kubernetes, containers, Linux, networking, and storage.
  • Experience supporting GPU, accelerator, or distributed machine-learning workloads.
  • Ability to troubleshoot complex systems and communicate clearly with engineers from different technical backgrounds.
  • Familiarity with Kubernetes scheduling, operators, quotas, or resource management (preferred).
  • Experience with NVIDIA technologies such as CUDA, NVLink, NVSwitch, NCCL, EFA, or DCGM (preferred).
  • Knowledge of AWS EKS, Terraform, Argo CD, Helm, Prometheus, or Grafana (preferred).

Related searches

More Staff Software Engineer jobs Staff Software Engineer jobs in Seattle All jobs at Arm Holdings

More like this

Similar roles

Principal Software Engineer, AI Compute Infrastructure

Arm Holdings

Seattle, WA 8 days ago $262,700–$355,400
Kubernetes Go Python Linux AWS EKS Terraform Argo CD Helm Prometheus Grafana PyTorch Ray vLLM SGLang TensorRT-LLM CUDA NVLink NVSwitch NCCL EFA DCGM Containers HPC
8+ yrs exp Hybrid
Save

Staff Software Engineer, AI Compute Platform

Arm Holdings

Seattle, WA 50 days ago $209,100–$282,900
Go Python Kubernetes Distributed Systems APIs PostgreSQL Kafka Prometheus Grafana OpenTelemetry PyTorch Ray vLLM GitOps RPC Containers Asynchronous Processing
5+ yrs exp Hybrid
Save

Staff Software Engineer, AI Inference Cloud

Arm Holdings

Seattle, WA 50 days ago $209,100–$282,900
Kubernetes Go C++ Rust Python Distributed Systems Cloud Platforms Observability PyTorch Ray vLLM SGLang TensorRT-LLM APIs Networking Capacity Planning
5+ yrs exp Hybrid
Save

Senior Site Reliability Engineer

Nvidia

Remote (Santa Clara, CA) +3 41 days ago
Kubernetes Python Go Linux GitOps Terraform ArgoCD Prometheus Grafana OpenTelemetry ELK Stack Splunk PyTorch TensorRT-LLM CUDA NCCL vLLM SGLang SLOs SLIs Distributed Systems GPU Infrastructure
8+ yrs exp Remote
Save

Staff Software Engineer, Core AI Infrastructure

Coinbase

Remote 15 days ago $218,025–$256,500
AWS Kubernetes Terraform Python Go Docker CI/CD Ansible Chef Puppet Salt Git Bash Ruby Distributed Systems Data Pipelines APIs Observability
8+ yrs exp Remote
Save