Principal Software Development Engineer, Compiler & ML Acceleration

Amd

Confirmed live yesterday High trust
Hybrid

Quick summary

Work type
Hybrid
Location
San Jose, CA
Salary
$240,000–$360,000 / yr
Posted
53 days ago
Freshness
Confirmed live yesterday
Closes
Jul 20, 2027

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $208k
This role $300k
$125k most similar roles pay here $385k

This role pays more than 91% of similar roles. Most pay $180,618–$235,750 — the shaded band above. At the midpoint, this role pays about $300k versus about $208k for comparable roles.

Based on 240 similar postings.

Employer

About Amd

AMD (Advanced Micro Devices) is a semiconductor company that develops high-performance processors, graphics cards, and adaptive computing solutions for gaming, data centers, and embedded markets. Industry: Semiconductors

Amd currently has 367 open roles on FindRole.

Listed pay typically runs $166,400–$249,600 across 367 roles with salary data.

Most-posted roles

View all roles at Amd

At a glance

TL;DR · Principal Software Development Engineer, Compiler & ML Acceleration

Principal Software Development Engineer – Compiler & ML Acceleration joins the team to lead technical development in compiler technology, MLIR-based infrastructure, and model-to-hardware optimization. This role focuses on building the next generation of compiler and software infrastructure to accelerate Large Language Models and machine learning workloads on emerging accelerator architectures like NPUs. Key responsibilities include designing compiler components, implementing MLIR-based flows to lower high-level representations into optimized hardware code, and driving data movement optimizations for inference workloads. The position requires expertise in C++, LLVM-based infrastructure, and graph-level optimizations for neural network workloads. Working cross-functionally with hardware and systems teams, the engineer will define strategies for operator fusion, memory planning, and scheduling to solve complex performance challenges within advanced acceleration pipelines for specialized compute engines and high-performance AI execution environments.

What does a Software Development Engineer earn in California?

Median $217725 from 77 postings across 8 companies.

See salary data

What you'll do

  • Lead the architecture design and development of compiler components and optimization pipelines for machine learning.
  • Design and implement MLIR-based compiler flows to lower high-level representations into optimized hardware-specific code.
  • Drive model compilation and data movement optimizations specifically for ML inference workloads.
  • Implement compiler strategies for operator fusion, memory planning, scheduling, and performance optimization.
  • Align compiler capabilities with evolving accelerator architectures by collaborating with hardware, runtime, and systems teams.
  • Provide technical leadership and mentorship to influence compiler direction and best practices across the organization.
  • Contribute to long-term roadmap decisions for compiler and ML acceleration software.

What we're looking for

  • Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent.
  • Strong experience in compiler development across front-end, middle-end, and/or back-end.
  • Hands-on expertise with MLIR and/or LLVM-based compiler infrastructure.
  • Proven experience working on neural network workloads and graph-level optimizations for ML models.
  • Strong C++ development skills within large, complex codebases.
  • Experience targeting or optimizing for NPUs or specialized AI accelerators.
  • Familiarity with model compilation stacks and custom lowering pipelines.
  • Ability to provide technical leadership and influence architecture at a Principal level.

More like this

Similar roles

Machine Learning Compiler Engineer

Qualcomm

New York, NY +3 102 days ago $200,800$301,200
MLIR LLVM PyTorch Triton TVM Generative AI Polyhedral Optimization High-Performance Computing GPU Programming Parallel Programming Vectorization Compiler Development Machine Learning Computer Architecture
8+ yrs exp

Principal Software Engineer, Compute Graph Compiler

Microsoft

14 days ago $165,600$296,400
C++ C C# Python Java JavaScript ML Compiler Graph Optimization Memory Management Code Generation Hardware Abstraction Windows DirectX Machine Learning Execution Engines System Software
8+ yrs exp

Senior AI Compiler Engineer, MLIR

Nvidia

Remote (Santa Clara, CA) +1 28 days ago $152,000$241,500
MLIR LLVM XLA C++ Python CUDA OpenCL PyTorch JAX GPU Architecture Kernel Generation Compiler Optimization Performance Analysis Deep Learning
3+ yrs exp Remote

Senior GPU Compiler Development Engineer

Nvidia

Remote 135 days ago $184,000$287,500
C++ PTX ISA CUDA LLVM IR MLIR OpenCL Linkers Programming Language Design GPU Architecture Deep Learning Generative AI Code Generation Compiler Infrastructure
6+ yrs exp Remote