Principal Software Engineer, AI Compute Platform

Arm Holdings

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Seattle, WA
Salary
$262,700–$355,400 / yr
Posted
2 days ago
Freshness
Confirmed live today

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $203k
This role $309k
$117k most similar roles pay here $381k

This role pays more than 95% of similar roles. Most pay $169,550–$235,750 — the shaded band above. At the midpoint, this role pays about $309k versus about $203k for comparable roles.

Based on 240 similar postings.

Employer

About Arm Holdings

Arm Holdings plc is a leading British semiconductor and software design firm, established in 1990 and recognized for developing energy-efficient processor architectures that power nearly all smartphones and a vast range of IoT and computing devices.

Arm Holdings currently has 48 open roles on FindRole.

Listed pay typically runs $209,100–$282,900 across 47 roles with salary data.

Most-posted roles

View all roles at Arm Holdings

At a glance

TL;DR · Principal Software Engineer, AI Compute Platform

As a Principal Software Engineer on the AI Compute Platform team, you will design and build a secure, reliable platform for running AI workloads at scale. You will develop control-plane services, APIs, orchestration systems, and developer tools to support distributed training and inference. Your daily work involves building scalable backend services, Kubernetes controllers for workload management, and multi-tenant capabilities including access, secrets, and auditability. To succeed, you must possess strong programming skills in Go or Python and experience with distributed systems, cloud platforms, and production backend services. The role requires proficiency with Kubernetes, containers, asynchronous processing, relational databases, and tools like PostgreSQL, Kafka, OpenTelemetry, Prometheus, and Grafana. You will solve complex infrastructure problems by simplifying workflows for engineers and researchers while managing the technical challenges of scaling AI workloads across distributed systems.

What does a Software Engineer earn in Washington?

Median $202800 from 318 postings across 31 companies.

See salary data

What you'll do

  • Build scalable backend services, APIs, and asynchronous workflows to manage AI workloads.
  • Develop Kubernetes controllers for workload submission, recovery, and service lifecycle management.
  • Implement secure multi-tenant capabilities including access control, secrets, quotas, and auditability.
  • Improve platform scalability, observability, reliability, and developer experience.
  • Build infrastructure for distributed training, evaluation, and inference capabilities.
  • Create developer tools to simplify complex infrastructure for engineers and researchers.

What we're looking for

  • 8+ years of experience building distributed systems, cloud platforms, or production backend services.
  • Experience with distributed ML training or inference systems.
  • Strong programming skills in Go, Python, or similar systems languages.
  • Practical knowledge of APIs, Kubernetes, containers, asynchronous processing, and relational databases.
  • Ability to build clear interfaces and simplify infrastructure for engineers and researchers.
  • Clear communication and a collaborative approach to problem-solving.
  • Experience with Kubernetes operators, schedulers, resource management, GitOps, or equivalent experience (preferred).
  • Knowledge of RPC systems, PostgreSQL, Kafka, OpenTelemetry, Prometheus, Grafana, or familiarity with PyTorch, Ray, or vLLM (preferred).

More like this

Similar roles

Staff Software Engineer, AI Compute Platform

Arm Holdings

Seattle, WA 2 days ago $209,100$282,900
Kubernetes Go Python Distributed Systems APIs Containers PostgreSQL Kafka Prometheus Grafana OpenTelemetry PyTorch Ray vLLM GitOps RPC Asynchronous Processing
5+ yrs exp

Principal Platform Software Engineer, AI

Oracle

Nashville, TN 30 days ago $104,500$234,600
Python Go Java C++ Kubernetes OCI LLM Machine Learning PyTorch TensorFlow Hugging Face CI/CD Microservices Distributed Systems Infrastructure Automation
8+ yrs exp

Principal Software Engineer, Core AI Platform

JPMorgan Chase

Seattle, WA 13 days ago
Python AI Infrastructure Machine Learning Cloud Platforms Distributed Systems SRE Observability System Design SDKs Automated Testing Infrastructure Engineering Generative AI
10+ yrs exp