below marketmost similar roles pay hereabove market
This role pays more than
71%
of similar roles. Most pay
$177,250–$244,500
— the blue band above.
At the midpoint, this role pays about
$236k
versus about
$211k
for comparable roles.
Based on 240 similar postings.
Employer
About Nvidia
Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing
Nvidia currently has
1623 open roles
on FindRole.
Listed pay typically runs
$184,000–$287,500
across 1110 roles with salary data.
The Senior Product Architect, K8s-Based AI Infrastructure joins the team to design and shape architectures connecting powerful AI clusters. This role involves transforming ideas into functional products by defining detailed architectures for performance, scalability, and datacenter deployment. You will lead prototyping, validate designs, and iterate based on testing results while collaborating with hardware, software, security, and systems teams to integrate networking, compute, and storage ecosystems. Key responsibilities include building proof-of-concepts, developing technical specifications, and creating whitepapers. Required expertise includes datacenter-scale HPC or AI infrastructure, DevOps solutions like Python, Ansible, Container Runtimes, and Kubernetes, and experience with AI workloads such as agentic and RAG-based workflows, inference at scale, large scale training, and model evaluation to solve complex infrastructure management problems.
Lead prototyping and testing processes to validate product functionality and diagnose performance bottlenecks.
Iterate and refine designs based on testing results, feedback, and evolving technical requirements.
Ensure flawless integration of networking, compute, and storage ecosystems with internal hardware and software teams.
Build proof-of-concepts and minimum viable products with partners and customers to demonstrate product vision.
Provide comprehensive technical specifications, user guides, and whitepapers for customers and partners.
What we're looking for
8+ years of experience architecting datacenter-scale HPC or AI infrastructure as a Principal Architect, Solutions Architect, Principal Engineer, or equivalent.
Bachelor's degree in computer science or related field, or equivalent experience.
Strong background in technologies for large scale infrastructure management of complex systems, networks, and storage.
Extensive experience with DevOps solutions, including Python, Ansible, Container Runtimes, Kubernetes, and data center deployments.
Familiarity with AI workloads, including agentic & RAG-based workflows, inference at scale, large scale training & fine-tuning, and model evaluation.
Exceptional communication skills to translate complex technical details for diverse audiences.
Prior first-hand experience building large scale AI infrastructure (preferred).
Advanced certifications or publications in AI, deep learning, or related fields (preferred).