Senior AI-Native Systems Software Engineer, TensorRT

Nvidia

Hybrid

Quick summary

Work type
Hybrid
Location
Santa Clara, CA
Salary
$152,000–$241,500 / yr
Posted
46 days ago

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $203k
This role $197k
$140k most similar roles pay here $265k

This role pays less than 60% of similar roles. Most pay $169,625–$236,900 — the shaded band above. At the midpoint, this role pays about $197k versus about $203k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 985 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 971 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior AI-Native Systems Software Engineer, TensorRT

Join NVIDIA’s TensorRT team as a senior C++ engineer to lead an innovative initiative that leverages AI agents for large-scale software development. You will architect an AI-native framework, scale agentic workflows, and rapidly prototype with state-of-the-art models while ensuring seamless user experiences and extreme performance optimization. The role requires strong modern C++ skills, deep learning expertise, systems thinking, and the ability to translate customer needs into technical solutions efficiently. Experience with CUDA programming, high-velocity prototyping, and performance profiling is a plus. This initiative aims to redefine software development in the era of Generative AI by enabling unprecedented scalability and efficiency in producing high-performance C++ code for global inference use cases.

What you'll do

  • Architect an AI-native framework supporting parallel work by large numbers of AI agents.
  • Scale development workflows using AI-native tools to enhance compute-to-software output ratios.
  • Rapidly prototype with state-of-the-art deep learning models and integrate new capabilities.
  • Ensure seamless, high-performance onboarding paths for the latest model families in production.
  • Optimize performance at the intersection of Python orchestration and C++ engine-level code.

What we're looking for

  • 4+ years of relevant software development experience in C++.
  • Strong proficiency with modern C++ standards (C++11/14/17) and STL.
  • Deep understanding of deep learning frameworks and model architectures.
  • Experience with AI agent orchestrators or custom agentic coding harnesses.
  • Ability to rapidly prototype state-of-the-art models into working software.
  • Expertise in performance profiling, analysis, and optimization for CPU/GPU.

More like this

Similar roles

AI Software Engineer, Senior

Booz Allen Hamilton

Laurel, Maryland 50 days ago $86,800$198,000
Python Java C++ JavaScript TypeScript LLM-powered developer tools CI/CD DevOps VS Code Kubernetes Docker GitHub GitLab Jenkins Agentic AI frameworks Orchestration systems Cloud services PostgreSQL MongoDB

AI Software Engineer, Senior

Booz Allen Hamilton

Laurel, MD 50 days ago $86,800$198,000
Python Rust Go Scala Java GitLab CI Jenkins Git Linux Docker Podman AWS LocalStack ESXi Ansible Kubernetes SIEM Security+ Linux+

Senior Software Engineer, AI Platforms

JLL (Jones Lang LaSalle)

Boston, MA 4 days ago $120,000$200,000
Python Node.js React Azure AWS GCP Docker Kubernetes CI/CD Git GitHub SQL Server CosmosDB Vector databases RAG systems Prompt engineering LLM integration Automated testing frameworks
Hybrid

Senior Applied AI Software Engineer ( AI)

Humana

New York, NY 1 day ago $141,100$194,000
Python React Vue Solid Angular LangChain LlamaIndex Semantic Kernel Prompt engineering Model selection Context management Generative AI deployment Claude Code Cursor Replit AI system evaluation Observability Reliability Fallback strategies Safety guardrails Latency optimization Rate-limit management
Hybrid

Senior Software Engineer, AI Frameworks

Nvidia

Remote (Santa Clara, CA) 68 days ago $152,000$241,500
Kubernetes Docker CI/CD Python Go C++ PyTorch Ray llm-d Dynamo Helm Kustomize Terraform AWS Grafana Prometheus GitOps OpenAPI Swagger
Remote