Senior Software Engineer, Distributed Systems

Nvidia

Confirmed live yesterday High trust
Remote

Quick summary

Work type
Remote
Location
Santa Clara, CATXNYCA
Salary
$184,000–$287,500 / yr
Employment
Full-time
Posted
4 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $178k
This role $236k
$101k $307k
below market most similar roles pay here above market

This role pays more than 93% of similar roles. Most pay $149,500–$206,462 — the blue band above. At the midpoint, this role pays about $236k versus about $178k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1805 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1196 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Software Engineer, Distributed Systems

As a Senior Software Engineer, Distributed Systems - NIM Factory, you will join the team responsible for designing and building factory infrastructure and automation for NVIDIA Inference Microservices. You will develop a factory pipeline that transforms AI models into deployable services validated across Cloud, On-prem, and Kubernetes environments. Your daily work involves designing interfaces, data modeling, schema design, and expanding observability over compute infrastructure. You will build pipelines, backends, Docker builds, test harnesses, and metrics systems. The role requires advanced programming skills in distributed systems, microservices, and cloud technologies, specifically using Docker, K8s, Cloud Endpoints, Helm, and Prometheus. You will solve the technical challenge of optimizing and serving performant inferencing for AI models across heterogeneous hardware and software environments while mentoring colleagues and collaborating with multiple AI model teams.

What does a Software Engineer earn in California?

Median $214500 from 1140 postings across 73 companies.

See salary data

What you'll do

  • Design and build a factory pipeline to convert AI models into deployable NIM services.
  • Develop infrastructure for Docker builds, test harnesses, metrics, and log ingestion.
  • Design interfaces, data models, and schemas for the factory pipeline and compute infrastructure.
  • Validate NIM performance and accuracy across Cloud, On-prem, and Kubernetes environments.
  • Expand observability over the factory pipeline and underlying compute infrastructure.
  • Define performance metrics and drive improvements based on user feedback.
  • Build scalable and reliable backend components for distributed containerized applications.
  • Mentor team members and collaborate with AI model teams to define technical roadmaps.

What we're looking for

  • BS or MS in Computer Science, Computer Engineering, or a related field (or equivalent experience).
  • 8+ years of experience developing performant microservices, cloud software, and/or tooling.
  • Advanced programming skills to build distributed systems, backend services, microservices, and cloud technologies.
  • Deep technical expertise in distributed containerized applications using Docker, K8s, Cloud Endpoints, Helm, and Prometheus.
  • Proven experience debugging and analyzing the performance of distributed microservices or cloud systems.
  • Experience working with multi-functional teams, principals, and architects across organizational boundaries.
  • Experience delivering event-driven applications using services such as Temporal, Kafka, or Redis (preferred).
  • Prior experience in large scale full stack development (preferred).

More like this

Similar roles

Senior Software Engineer, Distributed Systems

Apple Inc

San Diego, CA 3 days ago $142,300–$263,300
Kubernetes Kafka Flink CI/CD Presto Trino Athena GCP EC2 Distributed Systems Stream Processing Data Pipelines Agentic Development
3+ yrs exp

Senior Software Engineer, Distributed Systems Engineering

Nvidia

Remote (Santa Clara, CA) 7 days ago $184,000–$287,500
Kubernetes Go Python Distributed Systems Slurm Bright Cluster Manager Cluster Operations Operator Development Node Health Monitoring Data Structures Algorithms Systems Programming Network Telemetry Incident Management
8+ yrs exp Remote

Senior Software Engineer, Distributed Systems Engineering

Nvidia

Remote (Santa Clara, CA) 29 days ago
Kubernetes Go Python Distributed Systems Slurm Bright Cluster Manager Cluster Operations Operator Development Monitoring Telemetry Data Structures Algorithms Systems Programming Incident Management
5+ yrs exp Remote

Software Engineer, Distributed Systems

Apple Inc

Cupertino, CA 26 days ago $150,400–$277,600
Java Kotlin Scala Spring REST gRPC Docker Kubernetes AWS CI/CD Infrastructure as Code Prometheus Grafana OpenTelemetry Datadog Cassandra DynamoDB PKI JWT SQL NoSQL