Senior Software Development Engineer, GPU Kernel Development

Amd

Confirmed live 2 days ago High trust

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$240,000–$360,000 / yr
Posted
74 days ago
Freshness
Confirmed live 2 days ago
Closes
Jun 29, 2027

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $204k
This role $300k
$136k most similar roles pay here $384k

This role pays more than 97% of similar roles. Most pay $171,337–$235,750 — the shaded band above. At the midpoint, this role pays about $300k versus about $204k for comparable roles.

Based on 240 similar postings.

Employer

About Amd

AMD (Advanced Micro Devices) is a semiconductor company that develops high-performance processors, graphics cards, and adaptive computing solutions for gaming, data centers, and embedded markets. Industry: Semiconductors

Amd currently has 367 open roles on FindRole.

Listed pay typically runs $166,400–$249,600 across 367 roles with salary data.

Most-posted roles

View all roles at Amd

At a glance

TL;DR · Senior Software Development Engineer, GPU Kernel Development

As a Sr. Software Development Engineer – GPU Kernel Development, you will join the team to optimize and develop deep learning frameworks specifically for AMD GPUs. You will be responsible for creating and optimizing GPU kernels, designing models for improved training and inference performance, and enhancing the full pipeline by integrating graph compilers. Your work involves collaborating with internal library teams and open-source maintainers to ensure seamless integration of optimizations across multi-GPU and multi-node systems. To succeed, you must possess expert proficiency in C++, Python, and Linux environments, alongside deep knowledge of HIP, CUDA, assembly (ASM), ROCm, and LLVM. You will utilize tools like Compute Kernel, CUTLASS, and Triton to solve complex performance challenges in high-performance computing environments while providing technical leadership and mentorship to junior team members through code reviews and guidance.

What does a Software Development Engineer earn in California?

Median $217725 from 77 postings across 8 companies.

See salary data

What you'll do

  • Optimize deep learning frameworks like TensorFlow and PyTorch specifically for AMD GPUs in open-source repositories.
  • Develop and optimize GPU kernels to maximize performance for specific AI operations.
  • Design and optimize deep learning models tailored for AMD GPU hardware.
  • Improve training and inference performance across multi-GPU and multi-node distributed computing systems.
  • Leverage advanced compiler technologies and LLVM to drive system-level optimizations from source to machine code.
  • Collaborate with open-source maintainers to ensure seamless integration of optimized code into upstream repositories.
  • Provide technical leadership, mentorship, and strategic direction to junior team members through code reviews and guidance.

What we're looking for

  • Master's or PhD degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
  • Expert proficiency in C++ and Python for performance tuning, debugging, and robust test design.
  • Experience developing and optimizing GPU kernels using HIP, CUDA, and assembly (ASM).
  • Expertise in deep learning framework integration with PyTorch and TensorFlow.
  • Knowledge of AMD architectures (GCN, RDNA) and tools like Compute Kernel, CUTLASS, and Triton.
  • Deep understanding of compiler internals, LLVM, and ROCm to drive system-level optimizations.
  • Experience optimizing AI workloads for multi-GPU and multi-node distributed computing environments.
  • Ability to provide technical leadership, mentorship, and guidance to junior team members.

More like this

Similar roles

GPU Kernel Development Engineer Fellow

Amd

Austin, TX 8 days ago $231,360$347,040
GPU ROCm Machine Learning HPC Transformer FlashAttention Quantization Speculative Decoding Algorithm Development Performance Analysis AI Software Stack
Hybrid

Software Engineer, GPU AI ML

Amd

Santa Clara, CA 77 days ago $204,000$306,000
C++ HIP CUDA ROCm PyTorch TensorFlow JAX GPU Architecture Kernel Optimization Distributed Systems LLMs SFT RLHF GRPO Quantization Verilog SystemVerilog RTL Design
Hybrid

Engineering Manager, Deep Learning Inference

Nvidia

Santa Clara, CA +4 37 days ago $184,000$287,500
CUDA Triton CUTLASS C++ Python vLLM SGLang FlashInfer TensorRT-LLM PyTorch NCCL NVSHMEM NIXL Multi-GPU Communication Deep Learning Inference Agile
6+ yrs exp Hybrid

Senior Deep Learning Compiler Engineer, XLA

Nvidia

Remote 28 days ago $152,000$241,500
C++ CUDA XLA MLIR LLVM OpenAI Triton JAX PyTorch TensorFlow TVM High-Performance Computing Distributed Programming Compiler Optimization Deep Learning
4+ yrs exp Remote

Engineering Manager, Deep Learning Inference

Nvidia

Santa Clara, CA 45 days ago $224,000$356,500
CUDA Triton CUTLASS C++ Python vLLM SGLang FlashInfer TensorRT-LLM PyTorch NCCL NVSHMEM NIXL Multi-GPU Distributed Inference Agile
6+ yrs exp Hybrid