Principal Perception Engineer, Obstacle Foundation Models

Nvidia

Confirmed live yesterday High trust
Remote

Quick summary

Work type
Remote
Location
Santa Clara, CA
Salary
$272,000–$431,250 / yr
Employment
Full-time
Posted
25 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $224k
This role $352k
$154k $461k
below market most similar roles pay here above market

This role pays more than 98% of similar roles. Most pay $193,935–$254,750 — the blue band above. At the midpoint, this role pays about $352k versus about $224k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Principal Perception Engineer, Obstacle Foundation Models

JOB TITLE: Principal Perception Engineer, Obstacle Foundation Models - Autonomous Vehicles As a senior individual contributor, the Principal Perception Engineer will lead the design and productization of the next-generation autonomous driving perception stack. You will own the technical vision, architecture, and roadmap for 3D obstacle perception, driving cross-functional execution and mentoring other engineers. Daily responsibilities include developing production-grade deep learning models for obstacle detection and tracking using multi-camera inputs and multi-sensor fusion from camera, radar, and lidar. You will utilize PyTorch, Python, and C++ to implement CNN, transformer-based, and vision-language techniques. Key tasks involve large-scale pretraining, distillation, and parameter-efficient fine-tuning like LoRA. You will also manage data strategies, including active learning and auto-labeling, to solve complex 3D computer vision problems and ensure software robustness for real-time autonomous vehicle deployment.

What you'll do

  • Own the technical vision, architecture, and roadmap for 3D obstacle perception to support end-to-end autonomous driving.
  • Design and develop advanced 3D perception models using multi-camera inputs and multi-sensor fusion for obstacle detection and tracking.
  • Lead the development of production-grade deep learning models by defining objectives, selecting architectures, and establishing training best practices.
  • Define and drive KPI frameworks to quantify perception performance and analyze large-scale datasets to identify and fix failure modes.
  • Lead the data strategy by specifying labeling requirements and prioritizing data collection for model-assisted workflows like active learning.
  • Partner with safety and systems teams to ensure perception solutions meet strict requirements for latency, resource usage, and software robustness.
  • Provide technical leadership and mentorship to other engineers while influencing design and implementation across the broader autonomy teams.

What we're looking for

  • 15+ years of hands-on experience developing deep learning–based perception or closely related systems for complex real-world problems.
  • Proficiency in frameworks such as PyTorch with a track record of taking models from prototype to production.
  • Demonstrated technical leadership as a senior or principal-level individual contributor owning features or subsystems end-to-end.
  • Proven experience in data-driven development, including collaboration with data, labeling, and ground-truth teams on data strategy.
  • Strong programming skills in Python and/or C++ for building reliable, high-performance, production-quality software.
  • BS/MS/PhD in Computer Science, Electrical Engineering, or related fields (or equivalent experience).
  • Proven track record leading the design and deployment of perception solutions for autonomous driving or robotics using camera-based deep learning at scale (preferred).
  • Hands-on experience architecting and deploying DNN-based perception pipelines on embedded or real-time platforms (preferred).

More like this

Similar roles

Senior Perception Engineer, Obstacle Foundation Models

Nvidia

Remote (Santa Clara, CA) +4 25 days ago $184,000–$287,500
PyTorch Python C++ CUDA Deep Learning Computer Vision Transformers CNN 3D Perception BEV Multi-sensor Fusion LoRA Vision-Language Models Active Learning Model-in-the-loop Data Strategy
8+ yrs exp Remote

Senior Radar Perception Engineer, Obstacle Foundation Models

Nvidia

Remote (Santa Clara, CA) 25 days ago $224,000–$356,500
Deep Learning PyTorch Python C++ Radar Signal Processing Multi-Sensor Fusion Transformers CUDA BEV LoRA Active Learning FMCW Beamforming CFAR Micro-Doppler Embedded Optimization DNN Data Strategy
10+ yrs exp Remote

Senior Machine Learning Engineer, Perception, Autonomous Driving

Nvidia

Remote (Santa Clara, CA) +5 21 days ago $184,000–$287,500
Machine Learning Computer Vision C++ Python PyTorch TensorFlow Deep Learning LiDAR Multi-sensor Fusion TensorRT Transformers Data Pipelines Object Detection Semantic Segmentation Model Optimization NVIDIA DRIVE AV
8+ yrs exp Remote

Senior Context Fusion AI Engineer, Autonomous Vehicles

Nvidia

Remote (Santa Clara, CA) +3 39 days ago $184,000–$287,500
Python C++ PyTorch CUDA Transformer sensor-fusion 3D Perception BEV VLM Distributed Training Quantization point-cloud Voxel Semantic Segmentation Motion Prediction Simulation
8+ yrs exp Remote