Senior Software Engineer, AI Inference Performance
Nvidia
Quick summary
Market check
How this pay compares to similar roles
This role pays more than 98% of similar roles. Most pay $165,375–$235,750 — the shaded band above. At the midpoint, this role pays about $335k versus about $201k for comparable roles.
Based on 240 similar postings.
Employer
AMD (Advanced Micro Devices) is a semiconductor company that develops high-performance processors, graphics cards, and adaptive computing solutions for gaming, data centers, and embedded markets. Industry: Semiconductors
Amd currently has 367 open roles on FindRole.
Listed pay typically runs $166,400–$249,600 across 367 roles with salary data.
Most-posted roles
At a glance
Fellow Software Engineer — AI Performance & Reliability will join the AI Infrastructure team to improve the performance, efficiency, and reliability of AI workloads across model training and inference. This role involves profiling and optimizing large language models, diffusion models, and recommendation systems while identifying bottlenecks across frameworks, compilers, runtimes, operating systems, and hardware. The engineer will develop performance tooling, benchmarks, and observability systems while collaborating with customers to resolve complex production issues and translate feedback into infrastructure improvements. Key technical requirements include proficiency in Python or C++, experience with PyTorch, TensorFlow, or JAX, and a strong foundation in computer architecture and distributed communication. Candidates should possess expertise in GPU environments and tools like ROCm, HIP, CUDA, Triton, XLA, MLIR, and NCCL to solve challenges related to throughput, latency, and memory efficiency at scale.
What does a Software Engineer earn in California?
Median $214000 from 775 postings across 63 companies.
Skills
What you'll do
What we're looking for
More like this
Nvidia
Amd
Amd
Amd
JPMorgan Chase
Coinbase