Senior Perception Engineer, Obstacle Foundation Models

Nvidia

Confirmed live today Trusted
Remote

Quick summary

Work type
Remote
Location
Santa Clara, CANYWACAMA
Salary
$184,000–$287,500 / yr
Employment
Full-time
Posted
25 days ago
Freshness
Confirmed live today

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $215k
This role $236k
$157k $302k
below market most similar roles pay here above market

This role pays more than 69% of similar roles. Most pay $175,625–$254,750 — the blue band above. At the midpoint, this role pays about $236k versus about $215k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Perception Engineer, Obstacle Foundation Models

The Senior Perception Engineer joins the team to design and productize the next-generation autonomous driving perception stack. This role focuses on the core 3D obstacle perception pipeline, where the engineer will develop technical architectures and roadmaps to support end-to-end autonomous driving functionalities. Daily responsibilities include designing and implementing advanced 3D perception models using multi-camera inputs and multi-sensor fusion from camera, radar, and lidar. The engineer will build production-grade deep learning models using CNN and transformer-based architectures, leveraging techniques like large-scale pretraining, distillation, and LoRA. Key skills include proficiency in PyTorch, Python, and C++, along with experience in 3D computer vision, BEV perception, and CUDA development. The work involves solving complex real-world problems by analyzing large-scale real and synthetic datasets to improve accuracy and robustness.

What you'll do

  • Develop the technical design, architecture, and roadmap for 3D obstacle perception in autonomous driving.
  • Design and implement 3D perception models using multi-camera inputs and multi-sensor fusion.
  • Build production-grade deep learning models using large-scale pretraining, distillation, and parameter-efficient fine-tuning.
  • Maintain KPI frameworks to quantify performance and analyze large-scale datasets to identify and fix failure modes.
  • Define data and labeling requirements and prioritize data collection for perception model training.
  • Implement model-assisted workflows including active learning, auto-labeling, and vision-language models.
  • Optimize perception solutions for safety, latency, and resource usage to ensure production readiness.

What we're looking for

  • PhD with 4+ years, MS with 6+ years, or BS with 8+ years of experience in Computer Science, Computer Engineering, or a related field.
  • Hands-on experience developing deep learning-based perception systems for complex real-world problems.
  • Proficiency in PyTorch and a track record of taking models from prototype to production.
  • Experience in data-driven development, including collaboration on data strategy, labeling quality, and iterative model improvement.
  • Strong programming skills in Python and/or C++ to build high-performance, production-quality software.
  • Experience designing and deploying perception solutions for autonomous driving or robotics using camera-based deep learning at scale (preferred).
  • Experience architecting DNN-based perception pipelines on embedded or real-time platforms with optimization for latency and memory (preferred).
  • Strong publication record or recognized contributions in deep learning, computer vision, or autonomous systems at leading conferences (preferred).

More like this

Similar roles

Principal Perception Engineer, Obstacle Foundation Models

Nvidia

Remote (Santa Clara, CA) 25 days ago $272,000–$431,250
Deep Learning PyTorch Python C++ CUDA Computer Vision Transformers CNN 3D Perception BEV Multi-sensor Fusion LoRA Active Learning Model-in-the-loop Representation Learning Distillation Large-scale Pretraining
10+ yrs exp Remote

Senior Radar Perception Engineer, Obstacle Foundation Models

Nvidia

Remote (Santa Clara, CA) 25 days ago $224,000–$356,500
Deep Learning PyTorch Python C++ Radar Signal Processing Multi-Sensor Fusion Transformers CUDA BEV LoRA Active Learning FMCW Beamforming CFAR Micro-Doppler Embedded Optimization DNN Data Strategy
10+ yrs exp Remote

Senior Machine Learning Engineer, Perception, Autonomous Driving

Nvidia

Remote (Santa Clara, CA) +5 21 days ago $184,000–$287,500
Machine Learning Computer Vision C++ Python PyTorch TensorFlow Deep Learning LiDAR Multi-sensor Fusion TensorRT Transformers Data Pipelines Object Detection Semantic Segmentation Model Optimization NVIDIA DRIVE AV
8+ yrs exp Remote

Senior Context Fusion AI Engineer, Autonomous Vehicles

Nvidia

Remote (Santa Clara, CA) +3 39 days ago $184,000–$287,500
Python C++ PyTorch CUDA Transformer sensor-fusion 3D Perception BEV VLM Distributed Training Quantization point-cloud Voxel Semantic Segmentation Motion Prediction Simulation
8+ yrs exp Remote