Senior Solutions Architect, GPU Performance and LLM

Nvidia

Confirmed live yesterday Low trust

Quick summary

Work type
On-site
Location
Santa Clara, CASeattle, WA
Salary
$184,000–$287,500 / yr
Posted
126 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $207k
This role $236k
$154k most similar roles pay here $302k

This role pays more than 77% of similar roles. Most pay $177,775–$235,750 — the shaded band above. At the midpoint, this role pays about $236k versus about $207k for comparable roles.

Based on 239 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 896 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 876 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Solutions Architect, GPU Performance and LLM

As a Senior Solutions Architect, GPU Performance and LLM - Cloud Service Providers, you will join the Solutions Architecture team to help large customers build AI/ML and HPC software solutions at scale. You will serve as the primary technical point of contact for clients developing complex AI infrastructure, providing end-to-end technology solutions, performance advice, and debugging sessions. Your daily work involves collaborating with internal teams to identify business opportunities, conducting technical meetings, and building Proofs of Concept to address critical needs like large scale LLM training and inference. You will utilize technologies including PyTorch, JAX, Triton, XLA, TensorRT, NeMo, NCCL, and RAPIDS while navigating environments involving Docker, Kubernetes, and cloud platforms like AWS, GCP, Azure, or OCI. The role focuses on solving performance issues for AI and systems within the hyperscaler domain.

What does a Solutions Architect earn in California?

Median $235750 from 45 postings across 8 companies.

See salary data

What you'll do

  • Develop and demonstrate technical solutions using NVIDIA software and hardware for major technology customers.
  • Identify and secure new business opportunities in partnership with Sales and Developer Relations teams.
  • Serve as the primary technical point of contact for customers building complex AI infrastructure.
  • Provide expert advice on performance optimization for large-scale LLM training and inference.
  • Conduct technical meetings to discuss product features, provide performance advice, and lead debugging sessions.
  • Build Proofs of Concept (PoCs) to address critical customer needs and support cloud service integration.
  • Analyze and resolve complex performance issues related to AI and system infrastructure.

What we're looking for

  • BS/MS/PhD in Electrical Engineering, Computer Science, Physics, or another engineering field or equivalent experience.
  • 8+ years of engineering experience in performance, systems, or solutions.
  • Hands-on experience building performance benchmarks for data center systems, including large-scale AI training and inference.
  • Understanding of systems architecture including AI accelerators and networking as it relates to application performance.
  • Experience with Deep Learning frameworks (PyTorch, JAX), compilers (Triton, XLA), and NVIDIA libraries (TRTLLM, TensorRT, etc.).
  • Experience deploying solutions in cloud environments (AWS, GCP, Azure, OCI) and knowledge of DevOps/MLOps technologies like Docker and Kubernetes.
  • Ability to communicate complex ideas clearly through documents, presentations, and in customer-facing environments.
  • Proficiency with command line tools.

More like this

Similar roles

Senior Solutions Architect

Nvidia

Santa Clara, CA 149 days ago $184,000$287,500
Generative AI LLMs GPU HPC NCCL DCGM UFM Mission Control Base Command Manager SLURM Networking Compute Infrastructure Performance Analysis AI Benchmarking Data Center Design Accelerated Computing Deep Learning
8+ yrs exp

Senior Solutions Architect

Nvidia

Remote 14 days ago $184,000$287,500
Python PyTorch TensorFlow CUDA NVIDIA Triton Inference Server TensorRT TensorRT-LLM MLOps SLURM AWS Azure GCP Deep Learning LLMs HPC NCCL DCGM UFM
10+ yrs exp Remote

Senior Solutions Architect, Supercomputing

Nvidia

Remote (TX) +1 157 days ago $184,000$287,500
GPU CUDA Machine Learning Deep Learning High-Performance Computing Generative AI Agentic AI Docker Kubernetes Slurm GPGPU Parallel Computing Data Science Networking
8+ yrs exp Remote

Senior Solutions Architect, Supercomputing

Nvidia

Remote (TX) +1 157 days ago $184,000$287,500
GPU CUDA Machine Learning Deep Learning High-Performance Computing Generative AI Agentic AI Docker Kubernetes Slurm GPGPU Data Science Parallel Computing Networking
8+ yrs exp Remote

Senior Solutions Architect, Cloud Partners - Telco

Nvidia

Remote (Santa Clara, CA) +4 57 days ago $152,000$241,500
Python PyTorch TensorFlow CUDA TensorRT TensorRT-LLM NVIDIA NeMo Triton Inference Server MLOps SLURM AWS Azure GCP Deep Learning LLMs HPC Cloud Architecture
6+ yrs exp Remote

Solutions Architect

Nvidia

Remote 15 days ago $184,000$287,500
GPU AI HPC GenAI Networking Data Center Design NCCL DCGM UFM Mission Control Base Command Manager SLURM Performance Testing AI Benchmarking
7+ yrs exp Remote