Senior Software Development Engineer, GPU Kernel Development

Amd

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$240,000–$360,000 / yr
Posted
120 days ago
Freshness
Confirmed live today
Closes
Jun 29, 2027

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $200k
This role $300k
$127k $385k
below market most similar roles pay here above market

This role pays more than 97% of similar roles. Most pay $163,893–$235,750 — the blue band above. At the midpoint, this role pays about $300k versus about $200k for comparable roles.

Based on 240 similar postings.

Employer

About Amd

AMD (Advanced Micro Devices) is a semiconductor company that develops high-performance processors, graphics cards, and adaptive computing solutions for gaming, data centers, and embedded markets. Industry: Semiconductors

Amd currently has 496 open roles on FindRole.

Listed pay typically runs $172,000–$258,000 across 496 roles with salary data.

Most-posted roles

View all roles at Amd

At a glance

TL;DR · Senior Software Development Engineer, GPU Kernel Development

As a Sr. Software Development Engineer – GPU Kernel Development, you will join a core team focused on optimizing and developing deep learning frameworks for AMD GPUs. You will be responsible for creating and optimizing GPU kernels, designing deep learning models, and enhancing training and inference performance across multi-GPU and multi-node systems. Your daily work involves collaborating with internal library teams and open-source maintainers to integrate optimizations into frameworks like TensorFlow and PyTorch. You will utilize C++, Python, HIP, CUDA, assembly, and advanced compiler technologies including LLVM and ROCm. Key technical skills include experience with Compute Kernel, CUTLASS, and Triton to solve performance bottlenecks in distributed computing environments. You will provide technical leadership and mentorship while ensuring robust, maintainable solutions for AI workloads.

What does a Software Development Engineer earn in California?

Median $197750 from 81 postings across 10 companies.

See salary data

What you'll do

  • Optimize deep learning frameworks like TensorFlow and PyTorch for AMD GPUs in open-source repositories.
  • Create and optimize GPU kernels to maximize performance for specific AI operations.
  • Design and optimize deep learning models specifically for AMD GPU performance.
  • Optimize deep learning performance on multi-GPU and multi-node distributed computing systems.
  • Leverage advanced compiler technologies and LLVM to improve deep learning performance from source to machine code.
  • Enhance the full deep learning pipeline by integrating graph compilers.
  • Provide technical leadership and mentorship to junior team members through code reviews and knowledge sharing.

What we're looking for

  • Master’s or PhD degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
  • Industry leading expertise in C++ development within Linux environments.
  • Experience optimizing and developing deep learning frameworks like TensorFlow and PyTorch for AMD GPUs.
  • Experience developing and optimizing GPU kernels for specific AI operations.
  • Experience optimizing deep learning performance on multi-GPU and multi-node distributed systems.
  • Ability to provide technical leadership, guide teams, and mentor junior members.
  • Deep expertise in designing GPU kernels using HIP, CUDA, and assembly (ASM) (preferred).
  • Thorough understanding of compiler internals, LLVM, and ROCm (preferred).

More like this

Similar roles

Senior GPU Kernel Development Engineer

Amd

San Jose, CA 13 days ago $194,400–$291,600
GPU Programming C++ HIP CUDA LLVM MLIR GPU Kernels Performance Analysis Quantized Models LLM System Software Development Code Generation Memory Hierarchy Cache Hierarchy Synchronization

GPU Kernel Development Engineer - Fellow

Amd

Austin, TX 54 days ago $231,360–$347,040
ROCm Machine Learning HPC GPU Architecture Transformer FlashAttention Quantization Speculative Decoding KV Cache Algorithm Development Performance Analysis Compiler Software Optimization AI Software Stack

Software Engineer, GPU/AI/ML

Amd

Santa Clara, CA 123 days ago $204,000–$306,000
C++ HIP CUDA ROCm PyTorch TensorFlow JAX GPU Architecture Kernel Optimization Distributed Training Inference RLHF Quantization Verilog SystemVerilog RTL Nsight ROCm Profiler MoE SFT

Engineering Manager, Deep Learning Inference

Nvidia

Santa Clara, CA +5 83 days ago $184,000–$287,500
CUDA Triton CUTLASS C++ Python vLLM SGLang FlashInfer TensorRT-LLM PyTorch NCCL NVSHMEM NIXL Multi-GPU Communications Distributed Inference Agile GPU Programming
6+ yrs exp Hybrid

Senior Deep Learning Compiler Engineer, HW-SW Codesign

Nvidia

Remote (Santa Clara, CA) +2 42 days ago $152,000–$241,500
C++ CUDA XLA MLIR LLVM OpenAI Triton JAX PyTorch TensorFlow TVM OpenCL Distributed Programming High-Performance Computing Compiler Optimization Deep Learning Frameworks
4+ yrs exp Remote