Fellow AI Software Architecture

Amd

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
San Jose, CA
Salary
$268,000–$402,000 / yr
Posted
142 days ago
Freshness
Confirmed live yesterday
Closes
Apr 22, 2027

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $206k
This role $335k
$137k most similar roles pay here $430k

This role pays more than 97% of similar roles. Most pay $173,800–$238,950 — the shaded band above. At the midpoint, this role pays about $335k versus about $206k for comparable roles.

Based on 240 similar postings.

Employer

About Amd

AMD (Advanced Micro Devices) is a semiconductor company that develops high-performance processors, graphics cards, and adaptive computing solutions for gaming, data centers, and embedded markets. Industry: Semiconductors

Amd currently has 367 open roles on FindRole.

Listed pay typically runs $166,400–$249,600 across 367 roles with salary data.

Most-posted roles

View all roles at Amd

At a glance

TL;DR · Fellow AI Software Architecture

Fellow, AI Software Architecture will join the AMD AI Group as a technical leader driving a unified ROCm software stack across a diverse product portfolio including Instinct, Radeon, Ryzen, Embedded, Game Consoles, and Autonomous Driving platforms. The role involves defining end-to-end software strategy, leading hardware/software co-design to maximize performance, and overseeing the development of compilers, kernels, runtimes, libraries, models, and frameworks. Key responsibilities include workload performance engineering for large-scale models like LLMs and Diffusion, as well as developing tools for performance estimation and automated reporting. The ideal candidate possesses expertise in GPU architectures, ROCm, CUDA, or OpenCL, alongside experience in AI/ML software stacks and operating systems. This role solves the challenge of optimizing high-performance products across the full lifecycle by aligning architecture with product goals and evolving AI workload trends.

What you'll do

  • Define the end-to-end ROCm software strategy across compilers, kernels, runtimes, libraries, and models.
  • Lead hardware/software co-design to influence future silicon features based on AI workload trends.
  • Perform profiling, analysis, and tuning of large-scale models like LLMs and Diffusion for performance excellence.
  • Develop advanced tools and frameworks for performance estimation, modeling, and automated reporting.
  • Partner with hyperscalers and top customers to deliver tailored architectural wins and software optimizations.
  • Act as a technical ambassador in industry forums and open-source communities.
  • Mentor and inspire the next generation of AMD engineers and technical leaders.

What we're looking for

  • An undergraduate degree in Electrical Engineering, Computer Architecture, or Computer Science is required.
  • A Master's or PhD degree with relevant experience is preferred.
  • Experience in the AI/ML software stack including compilers, kernels, runtime, libraries, models, frameworks, and performance optimization.
  • Knowledge of GPU architectures and basic knowledge of CPU architecture.
  • Understanding of GPU programming such as ROCm, CUDA, or OpenCL.
  • Experience in hardware/software co-design to build high-performance products across the full product lifecycle.
  • Experience with operating systems and device driver development is a plus.
  • Proven ability to provide technical leadership and influence cross-functional teams and long-term roadmaps.

More like this

Similar roles

Agentic AI Systems Architecture Fellow

Amd

Austin, TX +1 31 days ago $233,600$350,400
Agentic AI Heterogeneous Computing ROCm AMD Enterprise AI AMD Zen Software Studio LLM Inference RAG SGLang LMCache x86 ARM Distributed Systems Confidential Computing Performance Engineering Multi-agent Systems Networking
Hybrid

Principal AI Software Engineer

Amd

San Jose, CA 142 days ago $240,000$360,000
ROCm CUDA OpenCL GPU Architecture CPU Architecture Diffusion MoE Compiler Operating Systems Performance Engineering Hardware/Software Co-design AI/ML Frameworks Open Source

Advanced AI Architect

Accenture

Remote (Morristown, NJ) +4 85 days ago $94,400$293,800
Generative AI LLMOps AgentOps Knowledge Graphs Data Engineering AI Security Semantic Layers
10+ yrs exp Remote