Senior Vision Language Model Engineer

Nvidia

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$184,000–$287,500 / yr
Employment
Full-time
Posted
2 days ago
Freshness
Confirmed live today

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $224k
This role $236k
$164k $301k
below market most similar roles pay here above market

This role pays more than 68% of similar roles. Most pay $193,225–$254,750 — the blue band above. At the midpoint, this role pays about $236k versus about $224k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1814 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1204 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Vision Language Model Engineer

The Senior Vision Language Model Engineer joins the team to design and build agentic data and training workflows for Autonomous Vehicles, Robotics, and Medical applications. This role involves partnering with researchers to develop and evaluate prototypes for vision language models and vision language action models focused on video search and understanding. Key responsibilities include designing agentic workflows to automate data discovery, labeling, and retraining while curating high-quality multimodal datasets involving video, sensor, and language traces. The position requires building and productizing new data sources like simulation and synthetic data. Candidates must possess expertise in transformer-based architectures, deep learning frameworks, and Python. The work addresses technical problems in physical AI, specifically improving dataset search platforms and model training capabilities for autonomous driving, healthcare, and robotics.

What you'll do

  • Develop and evaluate prototypes of vision language models (VLMs) and vision-language-action models (VLAs).
  • Design and implement agentic data workflows to automate data discovery, labeling, evaluation, and retraining.
  • Build, curate, and maintain high-quality multimodal datasets for autonomous driving, healthcare, and robotics.
  • Explore and productize new data sources, including simulation and synthetic data.
  • Apply agentic AI workflows across the full applied research lifecycle to improve development velocity.
  • Contribute to the development of NVIDIA Cosmos Dataset Search and other core platform products.
  • Train and deploy deep learning models using distributed training, data preprocessing, and iterative debugging.

What we're looking for

  • PhD with 4+ years, MS with 6+ years, or BS with 8+ years of experience in Computer Science, Computer Engineering, or a related technical field.
  • Strong background in modern deep learning, including transformer-based architectures, video modeling, and multimodal VLM/VLA or foundation models.
  • Excellent experience training and deploying deep learning models on real-world datasets, including data preprocessing, distributed training, evaluation, and debugging.
  • Excellent experience with Python and at least one deep learning framework.
  • Current with the latest research on image and video search in autonomous vehicles, healthcare, robotics, or related physical AI applications.
  • Fluent with agentic AI workflows across the full applied research lifecycle, including prototyping novel algorithms and search pipelines.
  • Clear and effective communication skills with experience working in a dynamic, product- and research-focused team.
  • Strong track record publishing in top-tier conferences, patents in video retrieval, or experience in robotic systems (preferred).

More like this

Similar roles

Senior ML Engineer, Computer Vision

Anduril Industries

Remote (Irvine, CA) 32 days ago $220,000–$292,000
Machine Learning Computer Vision Deep Learning Python C++ PyTorch JAX TensorFlow TensorRT ONNX Linux Object Detection SLAM LIDAR Sensor Fusion Model Pruning System Profiling
6+ yrs exp Remote

Senior Applied AI ML Engineer

JPMorgan Chase

Jersey City, NJ +1 65 days ago
Python Java PyTorch TensorFlow Huggingface Transformers NeMo Databricks AWS SQL NoSQL MLOps NLP LLM s Microservices Distributed Systems Vector Databases Information Retrieval
8+ yrs exp

Senior Research Scientist, Vision-Language-Action (VLA) Models

Bosch

Sunnyvale, CA 38 days ago $185,000–$215,000
Python C++ Rust PyTorch TensorFlow Reinforcement Learning Computer Vision Natural Language Processing Multimodal Transformers Diffusion Models NeRF Gaussian Splatting Object Detection Segmentation 3D Scene Understanding PPO DQN DDPG Distributed Computing
5+ yrs exp

Senior AI/ML Engineer

Abbott

Alameda, CA 23 days ago $114,000–$228,000
Python PyTorch TensorFlow scikit-learn CI/CD Time-series Modeling Kafka Azure Event Hubs Kinesis Spark Streaming Containers Version Control Anomaly Detection Agentic AI
8+ yrs exp

Senior ML Engineer

Salesforce

Bellevue, WA +2 67 days ago
Python MLOps Apache Kafka Flink Ray Spark Pyspark Docker Kubernetes Apache Airflow CI/CD Graph Analytics Supervised Learning Anomaly Detection Clustering Feature Stores MITRE ATT&CK OCSF
3+ yrs exp Hybrid