Principal Engineer, Efficient GenAI

Amd

Confirmed live yesterday High trust
Hybrid

Quick summary

Work type
Hybrid
Location
San Jose, CASeattle, WAAustin, TX
Salary
$240,000–$360,000 / yr
Posted
2 days ago
Freshness
Confirmed live yesterday
Closes
Sep 25, 2027

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $204k
This role $300k
$125k most similar roles pay here $385k

This role pays more than 91% of similar roles. Most pay $162,000–$246,150 — the shaded band above. At the midpoint, this role pays about $300k versus about $204k for comparable roles.

Based on 240 similar postings.

Employer

About Amd

AMD (Advanced Micro Devices) is a semiconductor company that develops high-performance processors, graphics cards, and adaptive computing solutions for gaming, data centers, and embedded markets. Industry: Semiconductors

Amd currently has 409 open roles on FindRole.

Listed pay typically runs $164,080–$246,120 across 409 roles with salary data.

Most-posted roles

View all roles at Amd

At a glance

TL;DR · Principal Engineer, Efficient GenAI

As a Principal Engineer on the AI Models and Applications team, you will focus on enabling innovative and efficient Generative AI training and inference at scale. You will be responsible for proposing and implementing advanced techniques such as transformer architectures, parallelism strategies for large clusters, speculative decoding, and optimal KV-caching strategies. Your daily work involves developing efficient architectures for models like LLMs, 3D World and Action Models, or image/video generation models while collaborating with hardware and software teams to co-optimize performance on AMD platforms. You will utilize tools and frameworks including PyTorch, JAX, vLLM, SGLang, and MuJoCo to integrate optimized models and publish training recipes. This role addresses the technical challenge of scaling distributed training and inference for cutting-edge generative AI applications across various industries while promoting innovation through research collaborations and publications at major conferences.

What does a Engineer earn in California?

Median $212200 from 90 postings across 26 companies.

See salary data

What you'll do

  • Propose and apply innovative techniques for transformer architectures, parallelism strategies, and inference optimization like speculative decoding.
  • Implement novel, efficient architectures for Generative AI models to showcase performance benefits on AMD platforms.
  • Integrate AMD-optimized models and libraries into open-source frameworks such as PyTorch, JAX, vLLM, and SGLang.
  • Publish training recipes and promote technical work at major industry conferences and external venues.
  • Co-optimize end-to-end performance for Generative AI on current and future AMD hardware and software solutions.
  • Increase the adoption of agentic workflows to optimize and deploy Generative AI applications at scale.
  • Collaborate with internal researchers and academic partners to drive innovation on AMD platforms.

What we're looking for

  • PhD or master's degree in computer science, Electrical Engineering, Mathematics, or a related field.
  • Deep technical understanding and hands-on experience with LLMs, 3D World and Action Models, or image/video generation models.
  • Experience training models at scale and developing efficient approaches for distributed training and inference on AMD devices.
  • Several years of experience in AI, deep learning, and related software development (preferred).
  • Strong technical expertise in Generative AI model training and inference with familiarity in PyTorch, JAX, vLLM, SGLang, and MuJoCo (preferred).
  • Expertise and publications in efficient model architectures, optimized training, parallelism strategies, or low-precision training (preferred).
  • Experience productizing Generative AI models and training foundation models at scale (preferred).
  • Excellent written, verbal, and presentation skills to coordinate internally and externally (preferred).

More like this

Similar roles

Principal Engineer, AI Platform

Pinterest

Remote (Palo Alto, CA) +1 5 days ago $242,634–$499,541
AI/ML Infrastructure Distributed Systems Generative AI Recommender Systems C++ Java Rust Data Orchestration Model Training Fine-tuning Inference Feature Stores Multimodal Data Management
Remote

Tech Engagement Lead, Model Builder

Nvidia

Santa Clara, CA 150 days ago $184,000–$287,500
Generative AI Transformers Diffusion Models PyTorch JAX CUDA cuDNN NCCL TensorRT NeMo InfiniBand Kubernetes Distributed Training High-Performance Computing Cloud Native GPU Cluster Management Parallel File Systems
7+ yrs exp

Lead Engineer, GenAI

Target

Brooklyn Park, MN 16 days ago $132,000–$238,000
AI Machine Learning LLMOps LangChain LangGraph Huggingface Google ADK Cybersecurity Distributed Systems Software Development Application Architecture Rapid Prototyping Data Lifecycle Management Automation
7+ yrs exp Hybrid

GenAI Engineering Manager

Motorola Solutions

Richardson, TX 6 days ago $150,000–$185,000
GenAI LLM RAG ASR TTS Speech-to-Text Text-to-Speech AI Agent Orchestration Software Development Multimodal AI Product Roadmap Data Science
8+ yrs exp

Senior GenAI Engineer, AI Enablement & Agentic Systems

Samsung Electronics

New York, NY 4 days ago
Generative AI Agentic AI AWS Bedrock Anthropic Claude Python RAG LangGraph CrewAI Model Context Protocol AnythingLLM Vector Databases Prompt Engineering Multi-agent Orchestration Data Transformation SAP ServiceNow Workday
5+ yrs exp