Staff Software Engineer, AI Compute Platform

Arm Holdings

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Seattle, WA
Salary
$209,100–$282,900 / yr
Posted
2 days ago
Freshness
Confirmed live today

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $213k
This role $246k
$163k most similar roles pay here $296k

This role pays more than 77% of similar roles. Most pay $184,649–$241,937 — the shaded band above. At the midpoint, this role pays about $246k versus about $213k for comparable roles.

Based on 240 similar postings.

Employer

About Arm Holdings

Arm Holdings plc is a leading British semiconductor and software design firm, established in 1990 and recognized for developing energy-efficient processor architectures that power nearly all smartphones and a vast range of IoT and computing devices.

Arm Holdings currently has 48 open roles on FindRole.

Listed pay typically runs $209,100–$282,900 across 47 roles with salary data.

Most-posted roles

View all roles at Arm Holdings

At a glance

TL;DR · Staff Software Engineer, AI Compute Platform

As a Staff Software Engineer, AI Compute Platform, you will join the AI Compute Platform team to design and build a secure, reliable platform for running AI workloads at scale. You will develop control-plane services, APIs, orchestration systems, and developer tools for distributed training and inference while improving reliability and scalability across Arm’s AI workloads. Your daily work involves building scalable backend services, Kubernetes controllers, and multi-tenant capabilities involving access, secrets, and auditability. The role requires expertise in Go, Python, Kubernetes, containers, asynchronous processing, and relational databases. You may also utilize tools like PostgreSQL, Kafka, OpenTelemetry, Prometheus, Grafana, PyTorch, Ray, or vLLM. This position focuses on solving complex infrastructure problems by simplifying systems for engineers and researchers to support distributed training, evaluation, and inference capabilities within the AI compute domain.

What does a Software Engineer earn in Washington?

Median $202800 from 318 postings across 31 companies.

See salary data

What you'll do

  • Build scalable backend services, APIs, and asynchronous workflows to manage AI workloads.
  • Develop Kubernetes controllers for workload submission, recovery, and service lifecycles.
  • Implement secure multi-tenant capabilities including access control, secrets management, and auditability.
  • Improve platform scalability, observability, reliability, and developer workflows.
  • Deliver distributed training, evaluation, and inference capabilities for AI workloads.
  • Create tools to simplify complex infrastructure for engineers and researchers.

What we're looking for

  • 5+ years of experience building distributed systems, cloud platforms, or production backend services.
  • Experience with distributed ML training or inference systems.
  • Strong programming skills in Go, Python, or similar systems languages.
  • Practical knowledge of APIs, Kubernetes, containers, asynchronous processing, and relational databases.
  • Ability to build clear interfaces and simplify infrastructure for engineers and researchers.
  • Clear communication and a collaborative approach to problem-solving.
  • Experience with Kubernetes operators, schedulers, resource management, GitOps, or equivalent experience (preferred).
  • Knowledge of RPC systems, PostgreSQL, Kafka, OpenTelemetry, Prometheus, Grafana, or familiarity with PyTorch, Ray, and vLLM (preferred).

More like this

Similar roles

Principal Software Engineer, AI Compute Platform

Arm Holdings

Seattle, WA 2 days ago $262,700$355,400
Kubernetes Go Python Distributed Systems APIs Containers PostgreSQL Kafka Prometheus Grafana OpenTelemetry PyTorch Ray vLLM GitOps RPC Asynchronous Processing
8+ yrs exp

Staff Software Engineer, AI Inference Cloud

Arm Holdings

Seattle, WA 2 days ago $209,100$282,900
Kubernetes Go C++ Rust Python AI Inference Distributed Systems PyTorch Ray vLLM SGLang TensorRT-LLM Observability Networking Capacity Planning
5+ yrs exp

Software Engineer - Compute

Apple Inc

Seattle, WA 5 days ago $142,300$263,300
Site Reliability Engineering Go Python Kubernetes Terraform Ansible Chef OpenStack KVM Infrastructure as Code Distributed Systems Unix Bare Metal VM Orchestration Automation
1+ yrs exp

Staff Software Engineer, AI Platform

JLL (Jones Lang LaSalle)

Remote (Chicago, IL) 4 days ago $160,000$260,000
LLM AI Engineering Distributed Systems Kubernetes Infrastructure as Code Observability Retrieval Guardrails
8+ yrs exp Remote