Principal Software Engineer - Rack Scale Systems Infrastructure

Nvidia

Remote

Quick summary

Work type
Remote
Location
Santa Clara, CA
Salary
$272,000–$431,250 / yr
Posted
10 days ago

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $193k
This role $352k
$115k most similar roles pay here $465k

This role pays more than 99% of similar roles. Most pay $165,825–$219,425 — the shaded band above. At the midpoint, this role pays about $352k versus about $193k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 563 open roles on FindRole.

Listed pay typically runs $168,000–$264,500 across 556 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Principal Software Engineer - Rack Scale Systems Infrastructure

Apply Now Log in to save

As a Principal Rack Scale Systems Infrastructure Engineer at NVIDIA, you will lead the development of software systems that transform complex rack-scale hardware into reliable, manageable infrastructure for global clients. Your daily tasks include defining comprehensive software architectures, integrating Kubernetes and cloud-native primitives, and bridging hardware and software teams to ensure seamless integration. You will work closely with hyperscalers, CSPs, and enterprise customers to align infrastructure capabilities with real-world needs, while also mentoring senior engineers and making critical technical decisions. The role requires expertise in Go, C++, or Rust, knowledge of Kubernetes, Linux-based infrastructure, data center networking technologies, and experience with AI-assisted development tools. You will contribute to open source projects and manage the full product lifecycle from inception to operations, ensuring robustness and scalability across diverse deployment models.

Skills

Kubernetes Rust Go C++ Linux InfiniBand Ethernet RDMA BMCs Redfish IPMI Raspberry Pi OS Git API design Documentation AI-assisted development tools CI/CD Docker Prometheus Grafana

What you'll do

  • Define comprehensive software architecture for rack-scale infrastructure products and services.
  • Develop open source infrastructure software using Kubernetes and cloud-native primitives.
  • Bridge hardware and software teams to translate roadmaps into formal requirements.
  • Partner with hyperscalers, CSPs, and enterprise customers to align capabilities.
  • Mentor senior engineers in large-scale networked systems and control plane development.

What we're looking for

  • 15+ years of experience in systems architecture, system software, distributed systems, or infrastructure engineering.
  • Expertise in Kubernetes or similar orchestration systems for managing large-scale infrastructure services.
  • Strong architectural knowledge of coordination frameworks, state machines, declarative APIs, and lifecycle orchestration.
  • Practical coding skills in Go, C++, or Rust, with experience writing production-quality infrastructure software.
  • Deep understanding of data center networking technologies, including Ethernet, InfiniBand, RDMA, and fabric-level manageability.
  • Experience crafting open source software with API stability, modularity, documentation, and community usability.

Related searches

More Principal Software Engineer jobs Principal Software Engineer jobs in Santa Clara Remote Principal Software Engineer jobs All jobs at Nvidia

More like this

Similar roles

Principal Software Engineer, Distributed Systems

Alteryx

Remote (Northern California, Usa - Remote, US) 8 days ago $215,000–$300,000
Kubernetes Java Python Node.js Kafka Redis API design Docker AWS Azure GCP Terraform CI/CD Prometheus Grafana GitOps Service Mesh Observability SRE DevOps Scalability Security Architecture Review Board
Remote
Save

Principal Application Software Engineer

Oracle

Nashville, TN 31 days ago $99,600–$223,400
Oracle APEX PL/SQL Oracle Database OpenAI Anthropic AI JavaScript REST APIs JSON CI/CD DevOps Oracle AI Data Platform Oracle AI Database RAG Prompt Engineering API Integration
Save

Principal Software Engineer, Data Platform

Salesforce

Remote (San Francisco, CA) 40 days ago $197,300–$313,700
Snowflake dbt Informatica Airflow Neo4j TopQuadrant Terraform Helm Python Java Go Kafka CI/CD SRE AWS GCP Kubernetes SQL Jinja Cypher Vector databases LLMs RAG architectures
Remote
Save

Principal Software Engineer, Data Architecture

Mastercard

O'Fallon, Missouri 78 days ago $170,000–$281,000
AWS Azure GCP Databricks Snowflake Delta Lake Apache Spark Kafka Flink NiFi CI/CD Data Mesh GDPR ISO 20022 Agile SAFe Python Java SQL PostgreSQL
Save

Principal Software Engineer

Intuit

New York, NY 50 days ago $261,000–$353,000
Python Java JavaScript React Node.js Docker Kubernetes AWS Azure CI/CD Git PostgreSQL MongoDB Agile Scrum
Hybrid
Save