Senior Systems Software Engineer, Accelerated Kubernetes Performance and Scale

Nvidia

Confirmed live today Trusted
Remote

Quick summary

Work type
Remote
Location
Santa Clara, CASeattle, WA
Employment
Full-time
Posted
120 days ago
Freshness
Confirmed live today

Market check

Salary context

How this pay compares to similar roles

Similar $193k
$141k $246k
below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $151,000–$235,750.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Systems Software Engineer, Accelerated Kubernetes Performance and Scale

The Senior Systems Software Engineer, Accelerated Kubernetes Performance and Scale joins the DGX Cloud organization to manage the performance and scalability of the Kubernetes-based accelerated runtime stack. You will lead end-to-end analysis of control and data planes, including components like GPU Operator and Network Operator, while designing upstream architectural changes for hyperscale cluster sizes. Key responsibilities include improving container startup latency, advancing confidential containers, and using DSX simulation infrastructure to model AI-factory deployments. You will utilize Golang, Python, and expertise in distributed systems, networking, and storage to optimize AI workloads. The role focuses on minimizing total cost of ownership and reducing cost per token by ensuring the AI runtime stack scales reliably across thousands of GPU nodes for production inference and training.

What you'll do

  • Lead performance and scalability analysis across the Kubernetes-based accelerated runtime stack from orchestration down to the metal.
  • Design and contribute upstream architectural changes to the Kubernetes control plane for hyperscale cluster operations.
  • Improve container startup and cold-start latency to enable low-latency inference scaling across thousands of GPU nodes.
  • Contribute to open-source projects to optimize Kubernetes for multi-node AI training and inference workloads.
  • Advance the scalability and performance of confidential containers to meet production efficiency and latency requirements.
  • Use large-scale simulation infrastructure to model AI-factory deployments and validate scalability across thousands of simulated GPUs.
  • Design automated workload tests and integrate continuous performance testing into modern CI/CD workflows.
  • Document technical findings and engage with upstream communities to influence AI workload performance and scalability directions.

What we're looking for

  • Bachelor’s or Master’s degree in Engineering or equivalent experience, ideally in Electrical, Computer Engineering, or Computer Science.
  • 5+ years of experience in computer architecture, networking, storage systems, and accelerator-based platforms.
  • Expertise in Kubernetes and familiarity with the broader CNCF ecosystem.
  • Deep experience with large-scale, parallel, distributed accelerator systems and performance optimization of AI workloads.
  • Experience with performance modeling and benchmarking for large-scale systems.
  • Proficiency in Golang and/or Python.
  • Strong familiarity with the NVIDIA software stack across training and inference.
  • Expertise with at least one major public cloud provider (e.g., AWS, Azure, GCP, or OCI).
  • Strong operational experience with any one of the Kubernetes distributions (preferred).
  • Prior experience scaling Kubernetes clusters to ultra-large node and object counts (preferred).
  • Demonstrated history of working in the open-source community (preferred).
  • Excellent communication and interpersonal abilities (preferred).
  • PhD or equivalent experience in relevant areas (preferred).

More like this

Similar roles

Senior Systems Software Engineer, Kubernetes Node Lifecycle

Nvidia

Santa Clara, CA +1 139 days ago
Kubernetes Cluster API Golang Python NVIDIA Kubernetes Engine CI/CD OS Image Packaging Cloud Infrastructure Containerd Cloud-init Packer AWS GCP Azure OCI Kubelet CVE Remediation CIS Benchmarks SBOM Flatcar Bottlerocket Azure Linux
8+ yrs exp

Senior Systems Software Engineer, Containers and Kubernetes

Nvidia

Remote (Santa Clara, CA) +2 55 days ago $184,000–$287,500
Go C Kubernetes Container Orchestration Linux Distributed Systems Cloud Computing K8s Operator framework Container Device Interface (CDI) Dynamic Resource Allocation (DRA) Systems Programming Data Structures and Algorithms Cloud Native
8+ yrs exp Remote

Senior Software Engineer, Distributed Systems Engineering

Nvidia

Remote (Santa Clara, CA) 19 days ago
Kubernetes Go Python Distributed Systems Slurm Bright Cluster Manager Cluster Operations Operator Development Monitoring Telemetry Data Structures Algorithms Systems Programming Incident Management
5+ yrs exp Remote

Senior Software Engineer, Distributed Systems Engineering

Nvidia

Remote (Santa Clara, CA) 25 days ago $184,000–$287,500
Kubernetes Go Python Distributed Systems Slurm Bright Cluster Manager Cluster Operations Operator Development Node Health Monitoring Data Structures Algorithms Systems Programming Network Telemetry Incident Management
8+ yrs exp Remote

Senior Software Engineer

Nvidia

Remote (Seattle, WA) +1 26 days ago
Kubernetes Go Linux Terraform Ansible CI/CD Gitlab Argo Flux Cloud Native Distributed Systems Observability Telemetry Container Orchestration Unix Data Structures and Algorithms
5+ yrs exp Remote