Principal Perception Engineer, Obstacle Foundation Models - Autonomous Vehicles

Nvidia

Actively hiring
Us, Ca, Santa Clara, US Posted 77 days ago $272,000$431,250 / year

At a glance

AI generated

TL;DR

As a Principal Perception Engineer at NVIDIA, you will lead the design and productization of next-generation autonomous driving perception systems, setting technical direction for 3D obstacle detection and tracking. Your day-to-day involves developing advanced multi-modal models using CNNs and transformers, defining objectives and best practices for training deep learning models, and collaborating with data teams to improve model accuracy and efficiency. You will also ensure that perception solutions meet stringent safety requirements and mentor other engineers while working closely with cross-functional teams. The ideal candidate has over 15 years of experience in developing deep learning systems, proficiency in PyTorch, strong programming skills in Python or C++, and a track record of leading the deployment of camera-based perception pipelines for autonomous driving at scale. Familiarity with CUDA development and modern architectures like transformers is essential.

Skills

PyTorch Python C++ CNN Transformer CUDA BEV LoRA VLMs CVPR ICCV NeurIPS IROS 3D_Computer_Vision Multi_Sensor_Fusion Deep_Learning Computer_Vision Autonomous_Driving

What you'll do

  • Own the technical vision for 3D obstacle perception to support autonomous driving functionalities.
  • Design advanced 3D perception models using multi-camera inputs and sensor fusion techniques.
  • Develop efficient, production-grade deep learning models with best practices for training and evaluation.
  • Define KPI frameworks to quantify perception performance and improve model accuracy and robustness.
  • Lead data strategy for perception, including data collection, annotation, and model-assisted workflows.
  • Ensure perception solutions meet safety and deployment requirements across multidisciplinary teams.

What we're looking for

  • Over 15 years of hands-on experience developing deep learning-based perception systems for real-world applications.
  • Proven technical leadership in designing, implementing, and deploying complex perception solutions at scale.
  • Strong proficiency with PyTorch and experience moving models from prototype to production.
  • Expertise in data-driven development, including collaboration on data strategy and iterative model improvement.
  • Hands-on experience with modern deep learning architectures like CNNs and transformers for autonomous driving.
  • Deep understanding of 3D computer vision fundamentals and transformer-based 3D perception pipelines.
  • Experience optimizing DNN-based perception pipelines for embedded or real-time platforms using CUDA.

Market check

Salary context

This $272,000–$431,250 range sits above 97% of similar postings on FindRole.

Peer median band

$184,000$262,400

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$189,430$261,237

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 802 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 798 roles with salary data.

Most-posted roles

View all roles at Nvidia

More like this

Similar roles

Senior Perception Engineer - Autonomous Vehicles

Nvidia

Us, Ca, Santa Clara, US 22 days ago $184,000$287,500
PyTorch Python C++ CUDA DeepLearning MultiSensorFusion 3DComputerVision CameraCalibration SensorFusion DataVerification LossFunctionEngineering MLOps EmbeddedSystems RealTimeApplications KPIBuilding LargeScaleBenchmarking DataCollectionPrioritization LabelingPrioritization

Principal Deep Learning Engineer – Perception, Autonomous Driving

Nvidia

Us, Ca, Santa Clara, US 71 days ago $272,000$431,250
Python PyTorch C++ TensorRT NVIDIA DRIVE Deep Learning Computer Vision Object Detection Semantic Segmentation Temporal Tracking Data Labeling Automated Pipelines Model Optimization Multi-Modal Perception Systems CVPR ICCV ECCV NeurIPS

Senior Research Engineer - Autonomous Vehicles

Nvidia

Us, Ca, Santa Clara, US 139 days ago $184,000$287,500
PyTorch TensorFlow JAX Python C++ CUDA Kubernetes SLURM Reinforcement_Learning PPO SAC Q-learning GPU_Cluster HPC Distributed_Training_Systems Multimodal_Datasets Simulation_Infrastructure LLMs Policy_Learning Curriculum_Learning Domain_Randomization Reward_Shaping

Senior Integration Engineer - Autonomous Vehicles

Nvidia

Us, Ca, Santa Clara, US 45 days ago $152,000$241,500
C++ CUDA Linux QNX Git CMake Bazel OpenCV MATLAB Android Multithreaded programming Distributed systems Version control Build systems Image processing APIs Heterogeneous architectures GPGPU programming Real-time operating systems MISRA standards