Senior System Architect, Enterprise Reference Architectures

Nvidia

Confirmed live 2 days ago High trust

Quick summary

Work type
On-site
Location
Santa Clara, CAWestford, MAAustin, TXBoulder, CO
Salary
$208,000–$327,750 / yr
Posted
105 days ago
Freshness
Confirmed live 2 days ago

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $199k
This role $268k
$131k most similar roles pay here $349k

This role pays more than 88% of similar roles. Most pay $161,850–$235,750 — the shaded band above. At the midpoint, this role pays about $268k versus about $199k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 896 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 876 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior System Architect, Enterprise Reference Architectures

Senior System Architect, Enterprise Reference Architectures joins the Enterprise Platforms Group to define, design, and validate enterprise AI factory reference architectures. This role involves creating full-stack baseline architectures across compute, networking, storage, virtualization, orchestration, security, and observability to deliver on-prem cloud-native platforms. The architect will develop scalable cluster designs for training, fine-tuning, inference, agentic AI, physical AI, and HPC workloads while evaluating trade-offs in performance, scalability, resiliency, and cost. Key technical requirements include expertise in GPU-accelerated systems, high-density servers, PCIe, NVLink, and data center deployment realities. The role requires deep knowledge of Ethernet, InfiniBand, RDMA, RoCE, and container orchestration tools like Kubernetes and Docker. Additionally, the candidate must possess skills in microservices, event-driven architectures using Kafka or RabbitMQ, and integrating third-party vendor products into distributed enterprise software systems.

What you'll do

  • Define and drive full-stack enterprise AI factory baseline architectures across compute, networking, storage, and orchestration.
  • Design scalable cluster architectures for training, fine-tuning, inference, and HPC workloads in hybrid-cloud environments.
  • Create reference builds for end-to-end software systems based on scalable, portable, and resilient infrastructure.
  • Evaluate technical trade-offs regarding performance, scalability, security, power, cooling, and total cost of ownership.
  • Develop comprehensive API strategies, middleware integrations, and orchestration workflows for distributed enterprise software.
  • Translate ambiguous customer requirements into clear architecture patterns, validation plans, and field-ready technical specifications.
  • Conduct research on platform behavior under different workloads to inform product direction and roadmap inputs.

What we're looking for

  • Bachelor's degree or equivalent experience.
  • 12+ years of software or infrastructure architecture experience.
  • 3+ years of experience with micro-services architectures.
  • Experience in system architecture, performance, and networking for distributed solutions.
  • Proven experience designing and maintaining complex AI, HPC, or cloud-native infrastructure from rack-scale to data center deployments.
  • Expertise in crafting and deploying software platforms across edge, on-premises, and cloud environments.
  • Deep knowledge of GPU-accelerated systems, high-density servers, PCIe, NVLink, and data center physical constraints.
  • Deep networking knowledge including Ethernet, InfiniBand, RDMA, RoCE, and high-performance cluster fabrics.

More like this

Similar roles

Senior Software and System Architect

Nvidia

Remote 15 days ago $152,000$241,500
C Python Linux DPUs NICs Networking Protocols cloud-networking Security Virtualization Orchestration Data Center Technologies DPDK OVS OVN Docker Containers Kubernetes
5+ yrs exp Remote

Senior Solutions Architect, Generative AI

Nvidia

Remote (Santa Clara, CA) +1 43 days ago $184,000$287,500
GPU InfiniBand RoCE RDMA NCCL NVLink NVSwitch Kubernetes Slurm Python Linux High-Performance Computing Distributed Systems Shell Scripting DCGM Nsight Systems
6+ yrs exp Remote

Senior Enterprise Architect

Cardinal Health

65 days ago $123,400$176,300
Enterprise Architecture Google Cloud AWS Microsoft Azure RESTful APIs HTML JavaScript ETL ELT EAI IaaS PaaS SaaS TOGAF Zachman HIPAA GDPR
4+ yrs exp Hybrid

Senior Enterprise Architect

Humana

Remote (KY) +4 3 days ago $117,600$161,700
Enterprise Architecture IaaS PaaS SaaS Mainframe Agile Observability Portfolio Rationalization Application Modernization
10+ yrs exp Remote

Senior Enterprise Application Architect

PNC

Pittsburgh, PA +4 93 days ago $80,000$185,150
Enterprise Architecture TOGAF Service Oriented Architecture Machine Learning Planview ServiceNow Aris Security Management Enterprise IT Architecture
8+ yrs exp