Staff Software Engineer, AI Compute Platform

Arm Holdings

Confirmed live 2 days ago High trust
Hybrid

Quick summary

Work type
Hybrid
Location
Seattle, WA
Salary
$209,100–$282,900 / yr
Posted
51 days ago
Freshness
Confirmed live 2 days ago
Nearby
99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $214k
This role $246k
$157k $296k
below market most similar roles pay here above market

This role pays more than 77% of similar roles. Most pay $183,062–$244,062 — the blue band above. At the midpoint, this role pays about $246k versus about $214k for comparable roles.

Based on 240 similar postings.

Employer

About Arm Holdings

Arm Holdings plc is a leading British semiconductor and software design firm, established in 1990 and recognized for developing energy-efficient processor architectures that power nearly all smartphones and a vast range of IoT and computing devices.

Arm Holdings currently has 112 open roles on FindRole.

Listed pay typically runs $207,800–$281,200 across 112 roles with salary data.

Most-posted roles

View all roles at Arm Holdings

At a glance

TL;DR · Staff Software Engineer, AI Compute Platform

Role Posting Log in to save

As a Staff Software Engineer on the AI Compute Platform team, you will design and build a secure, reliable, and easy-to-use platform for running AI workloads at scale. You will develop control-plane services, APIs, orchestration systems, and developer tools for distributed training and inference. Your daily work involves building scalable backend services, Kubernetes controllers for workload submission and recovery, and secure multi-tenant capabilities for access, secrets, and quotas. You will utilize Go, Python, containers, relational databases, and asynchronous processing to improve platform observability and reliability. The role requires experience with distributed ML training systems and tools like PostgreSQL, Kafka, OpenTelemetry, Prometheus, Grafana, PyTorch, Ray, or vLLM. You will solve complex infrastructure problems to simplify distributed training and inference for engineers and researchers.

What does a Software Engineer earn in Washington?

Median $202800 from 405 postings across 38 companies.

See salary data

Skills

Go Python Kubernetes Distributed Systems APIs PostgreSQL Kafka Prometheus Grafana OpenTelemetry PyTorch Ray vLLM GitOps RPC Containers Asynchronous Processing

What you'll do

  • Build scalable backend services, APIs, and asynchronous workflows for managing AI workloads.
  • Develop Kubernetes controllers to manage workload submission, recovery, and service lifecycles.
  • Deliver secure multi-tenant capabilities for access, secrets, quotas, and auditability.
  • Improve platform scalability, observability, reliability, and developer workflows.
  • Design and build a platform for running AI workloads at scale.
  • Develop control-plane services and orchestration systems for distributed training and inference.
  • Create developer tools to simplify infrastructure for engineers and researchers.

What we're looking for

  • 5+ years of experience building distributed systems, cloud platforms, or production backend services.
  • Experience with distributed ML training or inference systems.
  • Strong programming skills in Go, Python, or similar systems languages.
  • Practical knowledge of APIs, Kubernetes, containers, asynchronous processing, and relational databases.
  • Experience with Kubernetes operators, schedulers, resource management, or GitOps (preferred).
  • Knowledge of RPC systems, PostgreSQL, Kafka, OpenTelemetry, Prometheus, and Grafana (preferred).
  • Familiarity with distributed AI platforms, inference serving, or frameworks such as PyTorch, Ray, or vLLM (preferred).
  • Technical leadership, mentoring experience, or an advanced degree or equivalent experience in a related field (preferred).

Related searches

More Staff Software Engineer jobs Staff Software Engineer jobs in Seattle All jobs at Arm Holdings

More like this

Similar roles

Staff Software Engineer, AI Compute Infrastructure

Arm Holdings

Seattle, WA 51 days ago $209,100–$282,900
Kubernetes Go Python Linux AWS EKS Terraform Argo CD Helm Prometheus Grafana PyTorch Ray vLLM SGLang TensorRT-LLM CUDA NVLink NVSwitch NCCL EFA DCGM HPC
5+ yrs exp Hybrid
Save

Staff Software Engineer, AI Inference Cloud

Arm Holdings

Seattle, WA 51 days ago $209,100–$282,900
Kubernetes Go C++ Rust Python Distributed Systems Cloud Platforms Observability PyTorch Ray vLLM SGLang TensorRT-LLM APIs Networking Capacity Planning
5+ yrs exp Hybrid
Save

Principal Software Engineer, AI Compute Infrastructure

Arm Holdings

Seattle, WA 9 days ago $262,700–$355,400
Kubernetes Go Python Linux AWS EKS Terraform Argo CD Helm Prometheus Grafana PyTorch Ray vLLM SGLang TensorRT-LLM CUDA NVLink NVSwitch NCCL EFA DCGM Containers HPC
8+ yrs exp Hybrid
Save

Staff Software Engineer, AI Platform

JLL (Jones Lang LaSalle)

Remote (Chicago, IL) 50 days ago
LLM AI Engineering Distributed Systems Platform Engineering Kubernetes Infrastructure as Code Observability Retrieval Tool Calling Model Routing Guardrails Production Systems
8+ yrs exp Remote
Save

Staff Software Engineer, AI Platform & Infrastructure

Okta Inc

San Francisco, CA 7 days ago $194,000–$267,300
Python FastAPI AWS PostgreSQL Step Functions SQS EventBridge pgvector ClickHouse BigQuery Lambda API Gateway S3 KMS Secrets Manager CloudWatch CloudTrail React AWS Amplify OpenAI Anthropic Infrastructure as Code OAuth OIDC SAML SCIM LangGraph
Save