Senior Perception Engineer, Obstacle Foundation Models, Autonomous Vehicles

Nvidia

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$184,000–$287,500 / yr
Posted
13 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $213k
This role $236k
$158k most similar roles pay here $301k

This role pays more than 63% of similar roles. Most pay $172,000–$254,750 — the shaded band above. At the midpoint, this role pays about $236k versus about $213k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 896 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 876 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Perception Engineer, Obstacle Foundation Models, Autonomous Vehicles

As a Senior Perception Engineer on the Obstacle Foundation Models team, you will design and productize the next-generation autonomous driving perception stack. You will be responsible for the core 3D obstacle perception pipeline, where you will develop technical architectures, define roadmaps, and implement advanced models using multi-camera inputs or multi-sensor fusion from radar and lidar. Your daily work involves building production-grade deep learning models, managing data strategies including active learning and auto-labeling, and evaluating performance against KPI frameworks. You will utilize technologies such as PyTorch, Python, C++, and CUDA to develop CNN and transformer-based architectures, including BEV and vision-language models. The role focuses on solving complex 3D perception challenges for autonomous vehicles by improving accuracy and robustness while ensuring solutions meet strict requirements for safety, latency, and resource efficiency in real-world environments.

What you'll do

  • Develop and improve the technical design, architecture, and roadmap for 3D obstacle perception in autonomous driving systems.
  • Design and implement advanced 3D perception models using multi-camera inputs and multi-sensor fusion like radar and lidar.
  • Build production-grade deep learning models using CNNs, transformers, large-scale pretraining, and parameter-efficient fine-tuning techniques.
  • Define and maintain KPI frameworks to quantify performance and analyze large datasets to identify and fix failure modes.
  • Develop data strategies by specifying labeling requirements and prioritizing data collection for model improvement.
  • Implement model-assisted workflows including active learning, auto-labeling, and vision-language models.
  • Ensure perception solutions meet strict product requirements for safety, latency, resource usage, and software robustness.

What we're looking for

  • PhD with 4+ years, MS with 6+ years, or BS with 8+ years of experience in Computer Science, Computer Engineering, or a related field.
  • Hands-on experience developing deep learning-based perception systems for complex real-world problems.
  • Proficiency in PyTorch and a track record of moving models from prototype to production.
  • Experience in data-driven development including collaboration on data strategy, labeling quality, and iterative model improvement.
  • Strong programming skills in Python and/or C++ to build high-performance, production-quality software.
  • Expertise in 3D computer vision fundamentals, including camera modeling, calibration, multi-view geometry, and 3D representations.
  • Experience with CNNs, transformers, large-scale pretraining, and parameter-efficient fine-tuning like LoRA.
  • Experience deploying DNN-based perception pipelines on embedded or real-time platforms optimized for latency and memory.

More like this

Similar roles

Principal Perception Engineer, Obstacle Foundation Models

Nvidia

Santa Clara, CA 13 days ago $272,000$431,250
Deep Learning PyTorch Python C++ CUDA CNN Transformers 3D Computer Vision BEV Multi-sensor Fusion LoRA Vision-Language Models Active Learning Autonomous Driving Computer Vision
10+ yrs exp

Senior Radar Perception Engineer, Obstacle Foundation Models

Nvidia

Santa Clara, CA 13 days ago $224,000$356,500
Deep Learning PyTorch Python C++ CUDA Transformers Radar Signal Processing Multi-sensor Fusion Bird’s-Eye-View (BEV LoRA Active Learning Digital Signal Processing FMCW Beamforming CVPR ICCV NeurIPS
10+ yrs exp

Senior Research Engineer, Autonomous Vehicles

Nvidia

Santa Clara, CA 37 days ago $184,000$287,500
PyTorch JAX TensorFlow Python C++ CUDA Kubernetes SLURM Deep Learning Reinforcement Learning LLMs MLOps HPC Distributed Training Sim-to-Real Natural Language Processing Graphics
10+ yrs exp