Principal Software Engineer, AI Compute Platform

Arm Holdings

Confirmed live yesterday High trust
Hybrid

Quick summary

Work type
Hybrid
Location
Seattle, WA
Salary
$262,700–$355,400 / yr
Posted
51 days ago
Freshness
Confirmed live yesterday
Nearby
99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $198k
This role $309k
$117k $381k
below market most similar roles pay here above market

This role pays more than 95% of similar roles. Most pay $169,550–$225,700 — the blue band above. At the midpoint, this role pays about $309k versus about $198k for comparable roles.

Based on 240 similar postings.

Employer

About Arm Holdings

Arm Holdings plc is a leading British semiconductor and software design firm, established in 1990 and recognized for developing energy-efficient processor architectures that power nearly all smartphones and a vast range of IoT and computing devices.

Arm Holdings currently has 112 open roles on FindRole.

Listed pay typically runs $207,800–$281,200 across 112 roles with salary data.

Most-posted roles

View all roles at Arm Holdings

At a glance

TL;DR · Principal Software Engineer, AI Compute Platform

Role Posting Log in to save

As a Principal Software Engineer on the AI Compute Platform team, you will design and build a secure, reliable, and easy-to-use platform for running AI workloads at scale. You will develop control-plane services, APIs, orchestration systems, and developer tools for distributed training and inference. Your daily work involves building scalable backend services, Kubernetes controllers for workload submission and recovery, and secure multi-tenant capabilities for access, secrets, and quotas. You will utilize Go, Python, containers, relational databases, and asynchronous processing to improve platform observability and reliability. The role requires expertise in distributed ML training systems and familiarity with tools like PostgreSQL, Kafka, OpenTelemetry, Prometheus, Grafana, PyTorch, Ray, and vLLM to solve complex infrastructure problems for distributed AI workloads.

What does a Software Engineer earn in Washington?

Median $202800 from 405 postings across 38 companies.

See salary data

Skills

Go Python Kubernetes PostgreSQL Kafka PyTorch Ray vLLM OpenTelemetry Prometheus Grafana GitOps RPC Distributed Systems APIs

What you'll do

  • Build scalable backend services, APIs, and asynchronous workflows for managing AI workloads.
  • Develop Kubernetes controllers to manage workload submission, recovery, and service lifecycles.
  • Deliver secure multi-tenant capabilities for access, secrets, quotas, and auditability.
  • Improve platform scalability, observability, reliability, and developer workflows.
  • Design and build a secure platform for running AI workloads at scale.
  • Develop control-plane services and orchestration systems for distributed training and inference.
  • Create developer tools to simplify infrastructure for engineers and researchers.

What we're looking for

  • 8+ years of experience building distributed systems, cloud platforms, or production backend services.
  • Experience with distributed ML training or inference systems.
  • Strong programming skills in Go, Python, or similar systems languages.
  • Practical knowledge of APIs, Kubernetes, containers, asynchronous processing, and relational databases.
  • Experience with Kubernetes operators, schedulers, resource management, or GitOps (preferred).
  • Knowledge of RPC systems, PostgreSQL, Kafka, OpenTelemetry, Prometheus, and Grafana (preferred).
  • Familiarity with distributed AI platforms, inference serving, or frameworks such as PyTorch, Ray, or vLLM (preferred).
  • Technical leadership, mentoring experience, or an advanced degree or equivalent experience in a related field (preferred).

Related searches

More Principal Software Engineer jobs Principal Software Engineer jobs in Seattle All jobs at Arm Holdings

More like this

Similar roles

Staff Software Engineer, AI Compute Platform

Arm Holdings

Seattle, WA 51 days ago $209,100–$282,900
Go Python Kubernetes Distributed Systems APIs PostgreSQL Kafka Prometheus Grafana OpenTelemetry PyTorch Ray vLLM GitOps RPC Containers Asynchronous Processing
5+ yrs exp Hybrid
Save

Principal Software Engineer, AI Compute Infrastructure

Arm Holdings

Seattle, WA 9 days ago $262,700–$355,400
Kubernetes Go Python Linux AWS EKS Terraform Argo CD Helm Prometheus Grafana PyTorch Ray vLLM SGLang TensorRT-LLM CUDA NVLink NVSwitch NCCL EFA DCGM Containers HPC
8+ yrs exp Hybrid
Save

Principal Software Engineer, AI Inference Cloud

Arm Holdings

Seattle, WA 51 days ago $262,700–$355,400
Kubernetes Go C++ Rust Python Distributed Systems Cloud Platforms Observability PyTorch Ray vLLM SGLang TensorRT-LLM APIs Networking Capacity Planning
8+ yrs exp Hybrid
Save

Principal Platform Software Engineer, AI

Oracle

Nashville, TN 76 days ago $104,500–$234,600
Python Go Java C++ Kubernetes OCI Distributed Systems Machine Learning LLMs CI/CD PyTorch TensorFlow Hugging Face Transformers Microservices Event-driven Systems Infrastructure Automation Service Mesh APIs Data Modeling
8+ yrs exp
Save

Principal Software Engineer, Developer Compute Platform

Nvidia

Remote (Canada) 11 days ago $248,000–$391,000
AWS Azure NVIDIA vGPU Amazon DCV PCoIP Omnissa Blast Extreme Amazon WorkSpaces Azure Virtual Desktop Windows 365 Citrix Omnissa Horizon EC2 VPC Azure VMs VNets Entra ID GPU Virtualization Zero-Trust Architecture VM Security Multi-tenant Isolation Systems Design
10+ yrs exp Remote
Save

Principal Software Engineer, AI Infra Compute

Oracle

Austin, TX +1 132 days ago $114,600–$234,600
Python Java TypeScript OCI AWS Azure GCP Kafka Docker Linux Bash Perl Ruby RESTful APIs Swagger OpenAPI NLP RoCE Infiniband Agile
6+ yrs exp
Save