Software Development Engineer, GPU Libraries

Amd

Confirmed live today High trust

Quick summary

Work type
On-site
Location
San Jose, CA
Salary
$240,000–$360,000 / yr
Posted
5 days ago
Freshness
Confirmed live today
Closes
Oct 29, 2027

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $215k
This role $300k
$127k $385k
below market most similar roles pay here above market

This role pays more than 97% of similar roles. Most pay $187,850–$241,750 — the blue band above. At the midpoint, this role pays about $300k versus about $215k for comparable roles.

Based on 240 similar postings.

Employer

About Amd

AMD (Advanced Micro Devices) is a semiconductor company that develops high-performance processors, graphics cards, and adaptive computing solutions for gaming, data centers, and embedded markets. Industry: Semiconductors

Amd currently has 496 open roles on FindRole.

Listed pay typically runs $172,000–$258,000 across 496 roles with salary data.

Most-posted roles

View all roles at Amd

At a glance

TL;DR · Software Development Engineer, GPU Libraries

Software Development Engineer - GPU Libraries will join the team to develop cutting-edge technology pushing performance and efficiency for next-generation GPU accelerators. The role involves contributing to open-source AI software, including ROCm, Verl, Ray, Triton Inference Server, and FlashInfer, while collaborating with partners to enable AI workloads on data center GPUs. Key responsibilities include architecting and deploying custom internal AI utilities, automated agents, and developer workflows. The position requires proficiency in C++, Python, or similar languages, alongside foundational knowledge of AI training, inference methodologies, and full-stack AI tool development. Candidates should possess familiarity with GPU programming using CUDA, HIP, or OpenCL and performance optimization techniques. This role focuses on solving technical challenges within the AI software ecosystem to enhance performance across high-performance computing environments.

What does a Software Development Engineer earn in California?

Median $202800 from 77 postings across 10 companies.

See salary data

What you'll do

  • Contribute to open-source projects including ROCm, Verl, Ray, and Triton Inference Server.
  • Develop cutting-edge software to improve performance and efficiency for next-generation GPU accelerators.
  • Collaborate with partners and open-source communities to enable AI workloads on data center GPUs.
  • Architect, build, and deploy custom internal AI utilities and automated agents.
  • Develop developer workflows to accelerate code generation and optimize custom kernels.
  • Automate the debugging of GPU performance bottlenecks using advanced LLMs.
  • Write efficient, maintainable, and scalable software for high-performance AI workloads.

What we're looking for

  • Bachelor’s or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent.
  • Proficiency in C++, Python, or similar programming languages (preferred).
  • Strong foundational knowledge of AI training, inference methodologies, and full-stack AI tool development/lifecycle integration (preferred).
  • Familiarity with GPU programming (CUDA, HIP, or OpenCL) and performance optimization techniques (preferred).
  • Experience contributing to open-source projects like ROCm, Verl, Ray, Triton Inference Server, or FlashInfer.
  • Ability to architect, build, and deploy custom internal AI utilities and automated agents.
  • Ability to leverage advanced LLMs to accelerate code generation and optimize custom kernels.
  • Ability to automate the debugging of GPU performance bottlenecks.

More like this

Similar roles

Software Engineer, GPU/AI/ML

Amd

Santa Clara, CA 131 days ago $204,000–$306,000
C++ HIP CUDA ROCm PyTorch TensorFlow JAX GPU Architecture Kernel Optimization Distributed Training Inference RLHF Quantization Verilog SystemVerilog RTL Nsight ROCm Profiler MoE SFT

Senior GPU Performance Software Engineer

Amd

Austin, TX 29 days ago $174,400–$261,600
C/C++ GPU Architecture Performance Analysis SW/HW Co-design AI Inference RCCL MPI GPU Kernel Development Profiling Debugging Tracing Multi-GPU AI/ML Workloads

Senior Software Development Engineer, GPU Kernel Development

Amd

Santa Clara, CA 127 days ago $240,000–$360,000
C++ Python PyTorch TensorFlow HIP CUDA ROCm LLVM Triton Assembly GPU Kernel Development Distributed Computing Compiler Optimization Linux High-Performance Computing CUTLASS Compute Kernel Graph Compilers