Fellow Software Development Engineer, GEMM Optimization

Amd

Confirmed live today High trust

Quick summary

Work type
On-site
Location
San Jose, CA
Salary
$268,000–$402,000 / yr
Posted
55 days ago
Freshness
Confirmed live today
Closes
Sep 2, 2027

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $225k
This role $335k
$141k $430k
below market most similar roles pay here above market

This role pays more than 99% of similar roles. Most pay $196,750–$253,500 — the blue band above. At the midpoint, this role pays about $335k versus about $225k for comparable roles.

Based on 240 similar postings.

Employer

About Amd

AMD (Advanced Micro Devices) is a semiconductor company that develops high-performance processors, graphics cards, and adaptive computing solutions for gaming, data centers, and embedded markets. Industry: Semiconductors

Amd currently has 496 open roles on FindRole.

Listed pay typically runs $172,000–$258,000 across 496 roles with salary data.

Most-posted roles

View all roles at Amd

At a glance

TL;DR · Fellow Software Development Engineer, GEMM Optimization

The Fellow Software Development Engineer, GEMM Optimization will join the team responsible for delivering best-in-class matrix-multiply performance across current and next-generation hardware. This role involves architecting and developing features in the tensile-lite assembly code generator for General Matrix Multiplication and GEMM + X, including attention. The engineer will perform deep, hardware-aware optimization by analyzing GPU hardware specifications at the instruction and pipeline level to influence future designs. Key responsibilities include developing support for new ISA features, implementing new algorithms, and profiling performance bottlenecks across the stack. Required skills include proficiency in C++, assembly-level GPU programming, and Python. The role requires expertise in GPU computer architecture, GEMM algorithms, tiling, blocking, and memory hierarchy utilization to solve AI workload efficiency problems.

What does a Software Development Engineer earn in California?

Median $197750 from 81 postings across 10 companies.

See salary data

What you'll do

  • Architect and develop features in the tensile-lite assembly code generator for GEMM and GEMM + X.
  • Analyze GPU hardware specifications to align kernel designs with current silicon capabilities.
  • Influence requirements for future hardware designs by partnering directly with hardware architects.
  • Develop support for new ISA and hardware/software optimization features in the code generator.
  • Innovate and implement new algorithms for GEMM and GEMM + X operations.
  • Profile and root-cause GEMM performance bottlenecks across the entire software and hardware stack.
  • Reproduce performance issues and deliver targeted optimizations based on customer workload requirements.

What we're looking for

  • Architect and develop features in the tensile-lite assembly code generator for GEMM and GEMM + X.
  • Analyze GPU hardware specifications to align kernel design with silicon capabilities and influence future designs.
  • Develop support for new ISA and HW/SW optimization features in the code-generator.
  • Innovate and implement new algorithms for GEMM and GEMM + X.
  • Profile and root-cause GEMM performance bottlenecks across the stack.
  • BS/MS/PHD in CS/CE or related field with deep relevant experience (preferred).
  • Strong command of GPU computer architecture, including compute units, cache hierarchies, and memory bandwidth (preferred).
  • Deep expertise in GEMM algorithms and mapping onto GPU hardware (preferred).
  • Proficiency in C++ and assembly-level GPU programming with working knowledge of Python (preferred).
  • Experience with AMD GPU architectures (CDNA/RDNA) or comparable competitive architectures (preferred).

More like this

Similar roles

GPU Kernel Development Engineer - Fellow

Amd

Austin, TX 54 days ago $231,360–$347,040
ROCm Machine Learning HPC GPU Architecture Transformer FlashAttention Quantization Speculative Decoding KV Cache Algorithm Development Performance Analysis Compiler Software Optimization AI Software Stack

ML Optimization Engineer, ASE Efficiency

Apple Inc

Seattle, WA 3 days ago $142,300–$214,300
Capacity Planning Resource Optimization Machine Learning Pipelines Platform Observability Forecasting Service Monitoring Systems Engineering Infrastructure Strategy

Senior ML Optimization Engineer, ASE Efficiency

Apple Inc

San Francisco, CA 166 days ago $184,700–$324,800
Machine Learning Time-series Forecasting Optimization Techniques Cloud Infrastructure Capacity Planning Platform Observability Distributed Systems Service Monitoring SRE Analytics
3+ yrs exp