Software Development Engineer, GPU Fleet Management & AI Infrastructure

Amd

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
San Jose, CA
Salary
$172,000–$258,000 / yr
Posted
55 days ago
Freshness
Confirmed live yesterday
Closes
Sep 10, 2027

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $203k
This role $215k
$154k $269k
below market most similar roles pay here above market

This role pays more than 60% of similar roles. Most pay $171,000–$235,750 — the blue band above. At the midpoint, this role pays about $215k versus about $203k for comparable roles.

Based on 240 similar postings.

Employer

About Amd

AMD (Advanced Micro Devices) is a semiconductor company that develops high-performance processors, graphics cards, and adaptive computing solutions for gaming, data centers, and embedded markets. Industry: Semiconductors

Amd currently has 496 open roles on FindRole.

Listed pay typically runs $172,000–$258,000 across 496 roles with salary data.

Most-posted roles

View all roles at Amd

At a glance

TL;DR · Software Development Engineer, GPU Fleet Management & AI Infrastructure

Software Development Engineer — GPU Fleet Management & AI Infrastructure joins a team at the intersection of systems software, cloud infrastructure, and accelerated computing. This role involves building Fleet Manager, a secure control plane for large-scale GPU infrastructure. You will design and develop distributed control-plane services, APIs, schedulers, and inference gateways while building reliable orchestration for GPU training and interactive development workloads. Key responsibilities include implementing durable reconciliation across PostgreSQL, integrating with Kubernetes, and developing GPU health diagnostics using ROCm and hardware telemetry. You will utilize Rust, C++, or Go to build multi-tenant infrastructure with strong authentication and workload isolation. The work addresses complex infrastructure problems, including topology-aware placement, multi-node workload coordination, and improving the reliability of AI inference services across distributed systems.

What does a Software Development Engineer earn in California?

Median $202800 from 77 postings across 10 companies.

See salary data

What you'll do

  • Design and develop distributed control-plane services, APIs, schedulers, and command-line tools for Fleet Manager.
  • Build reliable orchestration for GPU training, inference, and interactive development workloads.
  • Develop scalable scheduling capabilities including priority, fairness, topology-aware placement, and multi-node coordination.
  • Implement durable reconciliation, lifecycle management, and recovery across PostgreSQL and external execution systems.
  • Integrate Fleet Manager with Kubernetes, container runtimes, storage systems, and observability platforms.
  • Develop GPU health diagnostics and controlled-remediation capabilities using ROCm and hardware telemetry.
  • Build secure multi-tenant infrastructure with strong authentication, workload isolation, and auditing.
  • Improve AI inference service performance including routing, streaming, load shedding, and usage metering.

What we're looking for

  • Design and develop distributed control-plane services, APIs, schedulers, and command-line tools for large-scale GPU infrastructure.
  • Build reliable orchestration for GPU training, inference, and interactive development workloads.
  • Implement durable reconciliation, lifecycle management, and recovery across PostgreSQL and external execution systems.
  • Integrate systems with Kubernetes, container runtimes, storage systems, and observability platforms.
  • Develop GPU health diagnostics and remediation capabilities using ROCm and AMD hardware telemetry.
  • Build secure multi-tenant infrastructure with strong authentication, authorization, and workload isolation.
  • Strong systems-software development experience in Rust, C++, Go, or a comparable language (preferred).
  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field (preferred).

More like this

Similar roles

Software Engineer, GPU/AI/ML

Amd

Santa Clara, CA 131 days ago $204,000–$306,000
C++ HIP CUDA ROCm PyTorch TensorFlow JAX GPU Architecture Kernel Optimization Distributed Training Inference RLHF Quantization Verilog SystemVerilog RTL Nsight ROCm Profiler MoE SFT

Senior Software Engineer, GPU Local AI Platforms

Nvidia

Santa Clara, CA +4 103 days ago
Python C++ CUDA Triton LLM Inference GPU Computing Docker CI/CD NCCL RCCL Quantization Tensor Parallelism KV-cache Management NVIDIA Container Toolkit ML Systems
10+ yrs exp