Fellow Software Development Engineer, GEMM Optimization

Amd

Confirmed live yesterday High trust
Hybrid

Quick summary

Work type
Hybrid
Location
San Jose, CA
Salary
$268,000–$402,000 / yr
Posted
9 days ago
Freshness
Confirmed live yesterday
Closes
Sep 2, 2027

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $224k
This role $335k
$148k most similar roles pay here $429k

This role pays more than 98% of similar roles. Most pay $194,850–$253,750 — the shaded band above. At the midpoint, this role pays about $335k versus about $224k for comparable roles.

Based on 240 similar postings.

Employer

About Amd

AMD (Advanced Micro Devices) is a semiconductor company that develops high-performance processors, graphics cards, and adaptive computing solutions for gaming, data centers, and embedded markets. Industry: Semiconductors

Amd currently has 367 open roles on FindRole.

Listed pay typically runs $166,400–$249,600 across 367 roles with salary data.

Most-posted roles

View all roles at Amd

At a glance

TL;DR · Fellow Software Development Engineer, GEMM Optimization

Fellow Software Development Engineer, GEMM Optimization will join the team to architect and develop features in the tensile-lite assembly code generator for General Matrix Multiplication (GEMM) and GEMM + X. This role focuses on deep, hardware-aware optimization to improve AI workload efficiency by translating GPU architecture into high performance. Key responsibilities include analyzing GPU hardware specifications at the instruction and pipeline level, developing support for new ISA features in the code-generator, innovating algorithms for matrix multiplication, and profiling performance bottlenecks across the stack. The candidate will utilize C++, assembly-level programming, and Python for tooling while leveraging expertise in GPU computer architecture, memory hierarchies, and tiling techniques. This role addresses the critical challenge of maximizing throughput for AI workloads by optimizing kernel designs and influencing future hardware requirements through close collaboration with architects.

What does a Software Development Engineer earn in California?

Median $217725 from 77 postings across 8 companies.

See salary data

What you'll do

  • Architect and develop features in the tensile-lite assembly code generator for GEMM and GEMM+X operations.
  • Analyze GPU hardware specifications to align kernel designs with current silicon capabilities.
  • Influence future hardware requirements by partnering directly with hardware architects.
  • Develop support for new ISA and hardware/software optimization features in the code generator.
  • Innovate and implement new algorithms for GEMM and GEMM+X performance.
  • Profile and root-cause performance bottlenecks across the software and hardware stack.
  • Partner with customers to identify real-world workload requirements and resolve performance issues.

What we're looking for

  • Bachelor's, Master's, or PhD in Computer Science, Computer Engineering, or a related field.
  • Strong command of GPU computer architecture including compute units, memory hierarchies, and instruction scheduling.
  • Deep expertise in GEMM algorithms and their mapping onto GPU hardware.
  • Proficiency in C++ and assembly-level GPU programming.
  • Working knowledge of Python for tooling and automation.
  • Experience optimizing GPU compute kernels, specifically GEMM and attention.
  • Direct experience with any GPU compiler backend.
  • Experience with AMD GPU architectures (CDNA/RDNA) or comparable competitive architectures.

More like this

Similar roles

Fellow GPU Performance Optimization Engineer

Amd

San Jose, CA 167 days ago $268,000$402,000
GPU Distributed Training PyTorch JAX TensorFlow CUDA HIP ROCm Python C++ RDMA NCCL RCCL Megatron-LM Torchtitan MaxText Kernel Optimization Compiler Stack Performance Profiling
Hybrid

GPU Kernel Development Engineer Fellow

Amd

Austin, TX 8 days ago $231,360$347,040
GPU ROCm Machine Learning HPC Transformer FlashAttention Quantization Speculative Decoding Algorithm Development Performance Analysis AI Software Stack
Hybrid

Senior GPU Architect

Nvidia

Santa Clara, CA 32 days ago $184,000$287,500
GPU Architecture C++ Python Computer Architecture NoC Interconnect DFT VLSI ASIC Design System Architecture
10+ yrs exp

Principal Software Engineer, Compute Graph Compiler

Microsoft

14 days ago $165,600$296,400
C++ C C# Python Java JavaScript ML Compiler Graph Optimization Memory Management Code Generation Hardware Abstraction Windows DirectX Machine Learning Execution Engines System Software
8+ yrs exp