Principal AI Software Engineer

Amd

Confirmed live 2 days ago High trust

Quick summary

Work type
On-site
Location
San Jose, CA
Salary
$240,000–$360,000 / yr
Posted
142 days ago
Freshness
Confirmed live 2 days ago
Closes
Apr 22, 2027

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $202k
This role $300k
$117k most similar roles pay here $386k

This role pays more than 92% of similar roles. Most pay $172,350–$231,000 — the shaded band above. At the midpoint, this role pays about $300k versus about $202k for comparable roles.

Based on 240 similar postings.

Employer

About Amd

AMD (Advanced Micro Devices) is a semiconductor company that develops high-performance processors, graphics cards, and adaptive computing solutions for gaming, data centers, and embedded markets. Industry: Semiconductors

Amd currently has 367 open roles on FindRole.

Listed pay typically runs $166,400–$249,600 across 367 roles with salary data.

Most-posted roles

View all roles at Amd

At a glance

TL;DR · Principal AI Software Engineer

Principal AI Software Engineer The Principal AI Software Engineer joins the AMD AI Group to serve as a technical leader for OneROCm, driving a unified software stack across a diverse product portfolio including Instinct, Radeon, Ryzen, and Autonomous Driving platforms. This role involves influencing the full software stack, encompassing compilers, kernels, runtime, libraries, models, frameworks, and performance optimization layers. The engineer will perform hardware-software co-design to maximize performance, lead workload performance engineering for large-scale models like LLMs and MoE, and develop advanced tools for performance estimation. Key technical requirements include expertise in GPU architectures, the AI/ML software stack, and programming standards such as ROCm, CUDA, or OpenCL. The role focuses on solving complex hardware-software integration challenges to ensure high-performance execution across various products while contributing to open-source projects and mentoring other engineers within the organization.

What you'll do

  • Drive a unified ROCm software stack across AMD's diverse product portfolio including Instinct, Radeon, and Ryzen platforms.
  • Influence future silicon features by collaborating on hardware-software co-design based on evolving AI workload trends.
  • Deliver the roadmap and innovations for the AI software stack to ensure performance excellence for top-tier customers.
  • Lead the profiling, analysis, and tuning of large-scale models like LLMs and Diffusion models for "out-of-the-box" performance.
  • Develop advanced tools and frameworks for performance estimation, modeling, and automated reporting within the ecosystem.
  • Partner with hyperscalers and top customers to deliver tailored architectural wins and software optimizations.
  • Contribute to ROCm open-source projects and mentor other engineers in the organization.

What we're looking for

  • Candidates must possess a Bachelor of Science, Master's, or PhD degree in Electrical Engineering, Computer Architecture, or Computer Science.
  • Experience in the AI/ML software stack including compilers, kernels, runtime, libraries, models, frameworks, and performance optimization is required.
  • Knowledge of GPU architectures and basic knowledge of CPU architecture is required.
  • Proficiency in GPU programming languages such as ROCm, CUDA, or OpenCL is required.
  • Experience in hardware/software co-design to build high-performance products across the full product lifecycle is preferred.
  • Experience with operating systems and device driver development is a plus.
  • Ability to lead performance engineering for large-scale models including LLMs, Diffusion, Multimodal, and MoE.
  • Proven ability to collaborate across silicon, system software, AI/ML frameworks, and application enablement teams.

More like this

Similar roles

Fellow AI Software Architecture

Amd

San Jose, CA 142 days ago $268,000$402,000
ROCm CUDA OpenCL GPU Architecture CPU Architecture AI/ML Frameworks Compilers Runtime Operating Systems MoE Performance Optimization Hardware-Software Co-design

Principal Modeling Architect, DC GPU

Amd

Remote (San Francisco, CA) 142 days ago $229,600$344,400
GPU AI/ML HPC Workload Modeling Performance Engineering ROCm CUDA Graph Neural Networks Simulation Benchmarking Profiling Kernel Libraries Data Analytics
10+ yrs exp Remote

Principal Software Engineer

Autodesk

Atlanta, GA 29 days ago $139,000$249,260
Distributed Systems Data Pipelines NoSQL Serverless API Design ETL Cloud Platform Schema Validation Search Relevance
8+ yrs exp Hybrid

Principal Software Engineer

CVS Health

Remote (Massachusetts) +4 63 days ago $144,200$288,400
Python GCP Vertex AI LLM MLOps Microservices RAG Vector Search React Angular CI/CD Pub/Sub BigQuery GKE Cloud Run FHIR HL7 SRE
10+ yrs exp Remote

Principal Software Engineer

Oracle

73 days ago $114,600$234,600
C Distributed Systems Cloud Architecture Python Kernel Programming Network Programming Unix Linux Elastic File System OCI HPC AI/ML
6+ yrs exp