Principal Software Engineer, Profiling Services

Nvidia

Quick summary

Work type
On-site
Location
Santa Clara, CAAustin, TX
Salary
$272,000–$431,250 / yr
Posted
126 days ago

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $186k
This role $352k
$104k most similar roles pay here $466k

This role pays more than 99% of similar roles. Most pay $157,400–$214,500 — the shaded band above. At the midpoint, this role pays about $352k versus about $186k for comparable roles.

Based on 239 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 980 open roles on FindRole.

Listed pay typically runs $168,000–$270,250 across 966 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Principal Software Engineer, Profiling Services

As a senior software engineer on the GPU profiling team, you will design and implement an Always-On, low-overhead GPU profiling service that runs seamlessly in production environments. Your responsibilities include architecting system interfaces, data flows, and scalability for multi-GPU systems while ensuring high reliability through C/C++ development with strict performance constraints. You’ll lead feature delivery across user-mode components, driver layers, and trace providers, integrating with ML workflows like PyTorch to provide actionable insights from profiling data. Additionally, you will mentor engineers, set technical direction, and align roadmaps with internal and external partners. The ideal candidate has extensive experience in system-level C/C++ development, CUDA programming, and GPU architecture, along with a track record of building scalable profiling systems for ML workloads.

What you'll do

  • Design architecture for Always-On profiling service ensuring scalability across multi-GPU systems.
  • Implement low-overhead, high-reliability features using C/C++ with strict CPU/memory budgets.
  • Lead feature delivery from user-mode components to driver/platform layers and performance providers.
  • Establish profiling models that integrate with ML workflows like PyTorch/XLA for actionable insights.
  • Set technical direction and mitigate architectural risks by aligning roadmaps across internal and external partners.

What we're looking for

  • Extensive system-level C/C++ development experience with concurrency and performance engineering.
  • Proven track record of designing and shipping production-quality system software or drivers.
  • Demonstrated technical leadership in defining architecture and translating product visions into roadmaps.
  • Deep hands-on knowledge of CUDA, GPU architecture, and profiling/tracing stacks for CPU/GPU.
  • Experience building continuous, always-on profiling systems with predictable overhead at scale.
  • Strong communication skills to influence across organizations and build trust with external collaborators.

More like this

Similar roles

Principal Software Engineer

The Walt Disney Company

Remote (Santa Monica, CA) +1 68 days ago $184,300$247,100
Python Java AWS DynamoDB S3 SQS SNS Kinesis Kafka MySQL PostgreSQL Springboot Django CI/CD
Remote

Principal Software Engineer

Intuit

New York, NY 60 days ago $261,000$353,000
Python Java JavaScript React Node.js Docker Kubernetes AWS Azure CI/CD Git PostgreSQL MongoDB Agile Scrum
Hybrid

Principal Software Engineer

Oracle

Santa Clara, CA +1 60 days ago $96,800$223,400
Java Python Linux Docker Kubernetes Terraform CI/CD Prometheus Grafana PostgreSQL AWS Azure Oracle Cloud Infrastructure BMCs NICs SmartNICs ILOMs GPUs Microservices Observability High Availability Security Networking Compute Distributed Systems Firmware Development Testing

Principal Software Engineer

Intuit

Mountain View, CA 60 days ago $261,500$353,500
Python Java JavaScript Docker Kubernetes AWS CI/CD PostgreSQL MongoDB Redis Git Jenkins Swagger RESTful_APIs

Principal Software Engineer

Highnote

San Francisco, CA 101 days ago $190,000$240,000
Java JPA SQL SpringBoot Docker Kubernetes GCP AWS BigQuery RedShift
Hybrid

Principal Software Engineer

CVS Health

Remote (Work At Home-Rhode Island, US) 48 days ago $144,200$288,400
Flutter Angular React GCP Azure CI/CD Python PostgreSQL Docker Kubernetes Terraform AWS AI Generative AI APIs Observability Security Scalability Performance
Remote