Senior Software Engineer, AI Triton Kernels

Amd

Confirmed live 2 days ago High trust
Hybrid

Quick summary

Work type
Hybrid
Location
San Jose, CA
Salary
$145,600–$218,400 / yr
Posted
35 days ago
Freshness
Confirmed live 2 days ago
Closes
Aug 7, 2027

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $192k
This role $182k
$135k most similar roles pay here $243k

This role pays less than 52% of similar roles. Most pay $161,325–$222,000 — the shaded band above. At the midpoint, this role pays about $182k versus about $192k for comparable roles.

Based on 240 similar postings.

Employer

About Amd

AMD (Advanced Micro Devices) is a semiconductor company that develops high-performance processors, graphics cards, and adaptive computing solutions for gaming, data centers, and embedded markets. Industry: Semiconductors

Amd currently has 367 open roles on FindRole.

Listed pay typically runs $166,400–$249,600 across 367 roles with salary data.

Most-posted roles

View all roles at Amd

At a glance

TL;DR · Senior Software Engineer, AI Triton Kernels

Sr. Software Engineer - AI Triton Kernels will join the team to develop and optimize high-performance Triton and Gluon kernels for large-scale LLM and multimodal workloads. The role involves designing, implementing, and productionizing critical kernels such as matmul, flash attention, MoE, and fused transformer kernels within vLLM and SGL frameworks. You will collaborate with compiler and hardware architecture teams to improve the Triton AMD backend across ROCm and the LLVM AMDGPU stack for CDNA architectures. Key responsibilities include performing rigorous profiling using hardware counters, optimizing memory hierarchy utilization, and resolving performance issues across PyTorch and Triton IR. The position requires expertise in SIMT programming, GPU architecture, and performance engineering. Required skills include proficiency with Triton, LLVM, ROCm, MLIR, and experience with advanced techniques like occupancy tuning and instruction scheduling to maximize hardware efficiency.

What does a Software Engineer earn in California?

Median $214000 from 775 postings across 63 companies.

See salary data

What you'll do

  • Design, research, and optimize high-performance matmul, attention, MoE, and fused transformer kernels using Triton.
  • Productionize critical Triton/Gluon kernels within vLLM and SGL to ensure correctness and peak throughput.
  • Partner with compiler engineers to develop and maintain the Triton AMD backend across ROCm and LLVM stacks.
  • Execute kernel-level optimizations across memory hierarchies, wavefront execution, vectorization, and instruction scheduling.
  • Perform rigorous profiling and microbenchmarking on AMD Instinct GPUs using hardware counters and tracing tools.
  • Debug performance and correctness issues across PyTorch, vLLM/SGL runtimes, Triton IR, and ROCm.
  • Contribute to open-source ecosystems including Triton, LLVM, and ROCm.

What we're looking for

  • Expertise in SIMT programming, parallel algorithms, GPU architecture, and performance engineering.
  • Ability to perform rigorous quantitative analysis to drive measurable improvements across the full stack.
  • Experience designing and optimizing matmul, attention, MoE, and fused transformer kernels using Triton.
  • Proficiency in profiling and microbenchmarking on AMD Instinct GPUs using hardware counters and tracing tools.
  • Ability to debug issues across PyTorch, vLLM/SGL runtimes, Triton IR/MLIR, ROCm, and LLVM AMDGPU backends.
  • Experience in GPU kernel development, compiler backends, or performance engineering for AI/ML workloads (preferred).
  • Hands-on expertise with Triton, including custom kernels and understanding Triton IR lowering (preferred).
  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience (preferred).

More like this

Similar roles

Staff Engineer, Compiler

Samsung Semiconductor

San Jose, CA 101 days ago $163,000$253,000
PyTorch Triton MLIR Inductor XLA TVM IREE CUTLASS LLVM CUDA ROCm HPC Distributed Systems Kernel DSLs Compiler IR NUMA
10+ yrs exp

Senior Software Engineer

Adobe

San Jose, CA 179 days ago $177,900$257,550
Python Spark SQL Apache Airflow Databricks Snowflake DAX Tableau Power BI Adobe Analytics ETL Machine Learning Statistical Modeling Predictive Analytics A/B Testing Distributed Computing
3+ yrs exp

Senior Software Engineer

Alteryx

Remote 140 days ago $119,000$153,000
Python C++ gRPC CI/CD Git NumPy CPython SQLite OpenSSL WiX REST) API Node.js React JavaScript JSON Docker Kubernetes Rust AWS GCP Azure
Remote

Senior Software Engineer

Palo Alto Networks

Santa Clara, CA 91 days ago $106,000$170,500
Python Node.js TypeScript SQL MongoDB BigQuery GCP AWS Azure CI/CD REST APIs Kubernetes Docker AI/ML Pipelines Data Science Model Context Protocol
2+ yrs exp

Senior Software Engineer

Alkami

Remote 37 days ago $120,000$140,000
Kotlin Java Vue.js React Angular Tailwind CSS Spring Boot Hibernate RESTful APIs AWS Kubernetes Kafka SQL NoSQL Maven OpenTelemetry Agile UI Automation
8+ yrs exp Remote