Senior Solutions Architect, Generative AI Deployment and AIOps

Nvidia

Confirmed live today High trust
Remote

Quick summary

Work type
Remote
Location
Santa Clara, CANYILCAMAMD
Salary
$184,000–$287,500 / yr
Employment
Full-time
Posted
41 days ago
Freshness
Confirmed live today

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $199k
This role $236k
$136k $304k
below market most similar roles pay here above market

This role pays more than 85% of similar roles. Most pay $162,000–$235,750 — the blue band above. At the midpoint, this role pays about $236k versus about $199k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Solutions Architect, Generative AI Deployment and AIOps

As a Senior Solutions Architect, Generative AI Deployment and AIOps, you will join the team to serve as a trusted technical advisor for customers building solutions with accelerated computing and deep learning platforms. You will partner with engineering, product, and business teams to define high-value solutions, engage with researchers and data scientists, and help customers adopt MLOps solutions. Your daily work involves analyzing performance and power efficiency of AI inference workloads on Kubernetes, conducting proof-of-concepts for Large Language Models, and modeling inference software. Required skills include proficiency in Python, C/C++, PyTorch, and TensorFlow. You must demonstrate expertise in GPU orchestration, Multi-Instance GPU management, and libraries like TensorRT-LLM. This role focuses on the technical challenges of deploying and optimizing deep learning inference in production environments.

What does a Solutions Architect earn in California?

Median $235750 from 57 postings across 11 companies.

See salary data

What you'll do

  • Define high-value solutions by understanding the technical needs and strategies of customers.
  • Engage with developers, scientific researchers, and data scientists to address diverse technical areas.
  • Partner with lighthouse customers to build creative solutions using NVIDIA technology and MLOps.
  • Analyze the performance and power efficiency of AI inference workloads on Kubernetes.
  • Execute projects and proof-of-concepts focused on inference for Generative AI and Large Language Models.
  • Perform performance analysis and modeling of inference software with internal engineering teams.
  • Help customers adopt and build production-ready solutions using NVIDIA hardware and software platforms.

What we're looking for

  • BS, MS, or PhD in Computer Science, Electrical/Computer Engineering, Physics, Mathematics, or a related field (or equivalent experience).
  • 8+ years of hands-on experience with Deep Learning frameworks such as PyTorch and TensorFlow.
  • Strong fundamentals in programming, optimizations, and software design, especially in Python.
  • Proficiency in problem-solving and debugging skills in GPU orchestration and Multi-Instance GPU (MIG) management within Kubernetes environments.
  • Experience with containerization and orchestration technologies, monitoring, and observability solutions for AI deployments.
  • Excellent knowledge of the theory and practice of LLM and DL inference.
  • Excellent presentation, communication, and collaboration skills.
  • Prior experience with DL training at scale, deploying or optimizing DL inference in production (preferred).

More like this

Similar roles

Senior Solutions Architect, Generative AI Deployment and AIOps

Nvidia

Remote (Santa Clara, CA) +5 60 days ago
Generative AI LLMs Deep Learning Python PyTorch TensorFlow Kubernetes NVIDIA GPUs TensorRT TensorRT-LLM C/C++ MLOps GPU Orchestration Multi-Instance GPU (MIG) Distributed Computing Parallel Programming Performance Analysis Containerization
Remote

Senior Solutions Architect, Generative AI

Nvidia

Remote (Santa Clara, CA) +2 89 days ago $184,000–$287,500
GPU Architecture InfiniBand RoCE RDMA NCCL NVLink NVSwitch Kubernetes Slurm Python Linux Distributed Computing High-Performance Computing DGX HGX Spectrum-X DCGM Nsight Systems Shell Scripting
6+ yrs exp Remote

Senior Solutions Architect, Gen AI

Nvidia

Remote (Canada) 11 days ago $184,000–$287,500
Generative AI LLM PyTorch TensorFlow Hugging Face vLLM TRT-LLM SGLang LangChain LangGraph Docker Kubernetes GitLab Linux Shell AWS Azure GCP
8+ yrs exp Remote

Senior Solutions Architect, AI Inference

Nvidia

Remote (Santa Clara, CA) 61 days ago $184,000–$287,500
Kubernetes TensorRT-LLM vLLM SGLang NVIDIA Dynamo Triton Inference Server Quantization Speculative Decoding KV Cache Management SFT DPO GRPO RLVR Distributed Systems Observability NIXL Grove
6+ yrs exp Remote

Senior Solutions Architect, AI Cloud Services

Nvidia

Remote (Santa Clara, CA) +2 13 days ago
AI Machine Learning Deep Learning GPU CUDA Triton TensorRT-LLM Python AWS GCP Azure OCI Kubernetes Docker MLOps DevOps System Design Data Analytics
4+ yrs exp Remote

Senior Solutions Architect, AI Infrastructure Enterprise ISVs

Nvidia

Remote (Santa Clara, CA) +4 103 days ago
AI Infrastructure Accelerated Computing Distributed Systems High-Performance Computing Cloud Infrastructure CI/CD InfiniBand Ethernet RDMA MLPerf OpenMPI NCCL RAG LLM Training Cluster Orchestration Containers Observability Storage Performance
8+ yrs exp Remote