Software Development Engineer, AI Workload Optimization

Amd

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Bellevue, WA
Salary
$240,000–$360,000 / yr
Posted
1 day ago
Freshness
Confirmed live today
Closes
Oct 28, 2027

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $199k
This role $300k
$125k $385k
below market most similar roles pay here above market

This role pays more than 96% of similar roles. Most pay $163,125–$235,750 — the blue band above. At the midpoint, this role pays about $300k versus about $199k for comparable roles.

Based on 240 similar postings.

Employer

About Amd

AMD (Advanced Micro Devices) is a semiconductor company that develops high-performance processors, graphics cards, and adaptive computing solutions for gaming, data centers, and embedded markets. Industry: Semiconductors

Amd currently has 500 open roles on FindRole.

Listed pay typically runs $172,000–$258,000 across 500 roles with salary data.

Most-posted roles

View all roles at Amd

At a glance

TL;DR · Software Development Engineer, AI Workload Optimization

The Software Development Engineer - AI Workload Optimization joins the AI Software group as a Fellow. This technical leadership role involves defining the end-to-end software optimization strategy to achieve industry-leading performance for top-tier customers. The successful candidate will lead the profiling, analysis, and tuning of large-scale models including LLMs, Diffusion, Multimodal, and MoE models. Key responsibilities include hardware-software co-design, driving ecosystem innovation, and partnering with hyperscalers to solve critical performance needs. Required expertise includes the ROCm software stack, PyTorch, JAX, vLLM, and SGLang. The role requires mastery of performance profiling tools like TorchProfiler, ROCm Profiler, and Nsight, alongside deep knowledge of Transformer architectures, quantization, speculative decoding, and FlashAttention to optimize distributed inference and training across multi-node environments.

What does a Software Development Engineer earn in Washington?

Median $169050 from 134 postings across 7 companies.

See salary data

What you'll do

  • Define and drive the end-to-end software optimization strategy for top-tier AI customers.
  • Lead the profiling, analysis, and tuning of large-scale models like LLMs and Diffusion models.
  • Partner with hyperscalers to deliver tailored architectural wins and software optimizations for unique workload requirements.
  • Collaborate across hardware and compiler teams to influence future silicon features based on AI trends.
  • Drive the development of advanced tools for performance estimation, modeling, and automated reporting.
  • Act as a technical ambassador in industry forums and open-source communities.
  • Mentor and inspire the next generation of AMD’s technical leaders and engineers.

What we're looking for

  • Deep software development experience with experience in a high-level technical leadership role (preferred).
  • Deep expertise in AI Frameworks (PyTorch, JAX, vLLM, SGLang) and the ROCm software stack (preferred).
  • Proven history of optimizing distributed inference and training at scale across multi-node/multi-GPU environments (preferred).
  • Mastery of performance profiling tools and hardware-level performance modeling (preferred).
  • Strong understanding of modern model architectures and optimization techniques like quantization and FlashAttention (preferred).
  • Ability to drive cross-functional initiatives in fast-paced, ambiguous environments (preferred).
  • PhD or Master’s degree in Computer Science, Electrical Engineering, or a related field, or equivalent experience (preferred).
  • Demonstrated research or applied experience in AI/ML, including deep learning and model training/inference optimization (preferred).

More like this

Similar roles

Software Engineer, GPU/AI/ML

Amd

Santa Clara, CA 126 days ago $204,000–$306,000
C++ HIP CUDA ROCm PyTorch TensorFlow JAX GPU Architecture Kernel Optimization Distributed Training Inference RLHF Quantization Verilog SystemVerilog RTL Nsight ROCm Profiler MoE SFT

Lead Software Engineer, AI Developer

JPMorgan Chase

Plano, TX 121 days ago
Java Python Node.js RAG LangChain LlamaIndex Semantic Kernel CrewAI AWS Bedrock Anthropic Claude Pinecone OpenSearch pgvector FAISS Lambda Step Functions API Gateway S3 DynamoDB SQS Docker ECS EKS CI/CD infrastructure-as-code REST GraphQL Microservices Event-driven systems Prompt Engineering Conversational AI Speech-to-Text Text-to-Speech
10+ yrs exp