Senior Software Engineer - NIM Platform SDK and Framework

Nvidia

Actively hiring
Remote (Us, Ca, Santa Clara, US) Posted 58 days ago $184,000–$287,500 / year
View original post Log in to save

At a glance

AI generated

TL;DR

NVIDIA is hiring a senior engineer to lead the development and evolution of its NIM Platform SDK and microservice framework, which powers AI inference at scale. This role involves hands-on technical work such as designing high-performance systems programming, multi-cloud abstractions, and API frameworks while collaborating with various product teams to deliver production-grade software. Key responsibilities include advancing the inference microservice framework, architecting new features in open-source codebases, building optimized model download pipelines, implementing model profile systems for NVIDIA GPUs, and developing robust cloud microservice patterns. The ideal candidate has a strong background in cloud-native architecture, high-performance data pipelines, containerized application delivery, and application security principles, with expertise in Python and Rust. Experience with technologies like Docker, Kubernetes, and Helm, as well as involvement in open-source inference backends and multi-cloud deployment strategies, is highly valued.

Skills

Python Rust Kubernetes Docker Helm vLLM TensorRT-LLM SGLang NVIDIA Dynamo AWS GCP Azure OCI CI/CD API gateways Service mesh Load balancing Distributed systems High-performance data pipelines Parallel I/O Caching strategies Integrity verification Containerized application delivery Application security principles Secure coding practices Vulnerability mitigation Secrets management Supply chain integrity Test-driven development Code review Cross-team collaboration

What you'll do

  • Develop and advance the inference microservice framework for high-performance AI inference.
  • Architect new features in open-source codebases and shepherd them into production.
  • Build and optimize model download and caching pipelines across multiple cloud storage backends.
  • Implement a model profile system to ensure optimal performance on NVIDIA GPU platforms.
  • Develop reliable cloud microservice patterns for diverse deployment environments at scale.
  • Mentor teammates and establish high engineering standards for container quality and security.

What we're looking for

  • 8+ years experience developing performant cloud-native microservice architecture.
  • Expertise in high-performance data pipelines with parallel I/O and caching strategies.
  • Solid understanding of containerized application delivery using Docker, Kubernetes, Helm.
  • Excellent programming skills in Python and Rust, with strong software engineering principles.
  • Direct involvement in open-source inference backends like vLLM, TRTLLM, or SGLang.
  • Experience building and operating production microservices at scale across multiple clouds.

Market check

Salary context

This $184,000–$287,500 range sits above 92% of similar postings on FindRole.

Peer median band

$119,032–$209,330

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$142,400–$204,650

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 802 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 798 roles with salary data.

Most-posted roles

View all roles at Nvidia

More like this

Similar roles

Senior Software Engineer, Platform

T-Mobile

US 84 days ago $116,000–$209,300
AWS Agile Methodologies Technical Leadership Problem Solving Security Cloud computing Automation Go Python Java Scala JavaScript Kubernetes Certified Kubernetes Administrator (CKA) AWS Certified Solutions Architect

Senior Software Engineer: Platform

LogicGate

Remote (US) 37 days ago $125,000–$165,000
Spring Boot Java Kotlin Go AWS Terraform Kubernetes Docker CI/CD PostgreSQL Neo4j Redis RabbitMQ JUnit GitLab Jira Sass Angular Webpack TypeScript
Remote

Senior Software Engineer (Backend APIs/Platform)

T-Mobile

US 9 days ago $113,600–$205,000
Spring Boot Java SQL PostgreSQL AWS Kubernetes Docker Apache Kafka CI/CD Swagger 3.0 WebClient RESTful API SonarQube Git Splunk Grafana

Senior Software Application Engineer

Qualcomm

San Diego, Ca,Us, US 14 days ago $108,300–$162,500
C C++ Python Java Android OS Linux kernel ARM architecture CPU GPU DDR DSP BSP Profiling tools Analysis tools Debugging techniques Performance analysis Power analysis Thermal analysis System performance optimization Customer-facing experience Technical presentations Training sessions

Senior Software Engineer

Apex

US 121 days ago
Java Python PostgreSQL jOOQ Bazel gRPC Protobuf Flyway PubSub Datadog AWS CI/CD SQL Agile Jira