Principal Perception Engineer, Obstacle Foundation Models

Nvidia

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$272,000–$431,250 / yr
Posted
13 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $213k
This role $352k
$139k most similar roles pay here $463k

This role pays more than 98% of similar roles. Most pay $170,487–$254,750 — the shaded band above. At the midpoint, this role pays about $352k versus about $213k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 896 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 876 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Principal Perception Engineer, Obstacle Foundation Models

Principal Perception Engineer, Obstacle Foundation Models - Autonomous Vehicles is a senior individual contributor role focused on the design and productization of an autonomous driving perception stack. You will lead the technical vision, architecture, and roadmap for 3D obstacle perception to support end-to-end autonomous functionalities. Day-to-day responsibilities include developing advanced 3D perception models using multi-camera inputs or multi-sensor fusion, including radar and lidar, while managing data strategies like active learning and auto-labeling. You will build production-grade deep learning models utilizing CNNs, transformers, and vision-language techniques. The role requires expertise in PyTorch, Python, C++, and CUDA to optimize for latency and memory on embedded platforms. You will solve complex problems in 3D computer vision, including multi-view geometry and BEV perception, while ensuring systems meet stringent safety and performance requirements for real-world autonomous vehicle deployment.

What you'll do

  • Define the technical vision, architecture, and roadmap for 3D obstacle perception in autonomous driving systems.
  • Develop advanced 3D perception models using multi-camera inputs and multi-sensor fusion like radar and lidar.
  • Build production-grade deep learning models using CNNs, transformers, large-scale pretraining, and parameter-efficient fine-tuning.
  • Establish KPI frameworks to analyze real and synthetic datasets to improve model accuracy and robustness.
  • Lead the data strategy by defining labeling requirements and implementing model-assisted workflows like active learning.
  • Ensure perception solutions meet strict product requirements for safety, latency, and resource usage on embedded platforms.
  • Provide technical leadership and mentorship to engineers across the broader perception and autonomy teams.

What we're looking for

  • 15+ years of hands-on experience developing deep learning-based perception systems for complex real-world problems.
  • Proven technical leadership as a senior or principal-level individual contributor owning features and architectural decisions.
  • Proficiency in PyTorch and a track record of taking models from prototype to production.
  • Strong programming skills in Python and/or C++ to build high-performance, production-quality software.
  • Experience in data-driven development including collaboration on data strategy, labeling quality, and iterative model improvement.
  • Expertise in 3D computer vision fundamentals, multi-sensor fusion, and transformer-based or BEV perception pipelines.
  • Knowledge of advanced techniques like large-scale pretraining, distillation, LoRA, and vision-language models.
  • BS/MS/PhD in Computer Science, Electrical Engineering, or a related field.

More like this

Similar roles

Senior Radar Perception Engineer, Obstacle Foundation Models

Nvidia

Santa Clara, CA 13 days ago $224,000$356,500
Deep Learning PyTorch Python C++ CUDA Transformers Radar Signal Processing Multi-sensor Fusion Bird’s-Eye-View (BEV LoRA Active Learning Digital Signal Processing FMCW Beamforming CVPR ICCV NeurIPS
10+ yrs exp

Director, Engineering, Autonomous Vehicles

Nvidia

Santa Clara, CA 14 days ago $320,000$488,750
Autonomous Driving Machine Learning Foundation Models CUDA GPU Computing Robotics Embodied AI Generative AI VLA Frameworks Scalable AI Systems
10+ yrs exp

Senior Research Engineer, Autonomous Vehicles

Nvidia

Santa Clara, CA 37 days ago $184,000$287,500
PyTorch JAX TensorFlow Python C++ CUDA Kubernetes SLURM Deep Learning Reinforcement Learning LLMs MLOps HPC Distributed Training Sim-to-Real Natural Language Processing Graphics
10+ yrs exp