Senior Deep Learning Scientist, Multimodal Agentic RL

Nvidia

Confirmed live yesterday High trust
Remote

Quick summary

Work type
Remote
Location
Santa Clara, CA
Salary
$184,000–$287,500 / yr
Employment
Full-time
Posted
4 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $220k
This role $236k
$159k $301k
below market most similar roles pay here above market

This role pays more than 66% of similar roles. Most pay $185,900–$254,750 — the blue band above. At the midpoint, this role pays about $236k versus about $220k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1463 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1096 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Deep Learning Scientist, Multimodal Agentic RL

The Senior Deep Learning Scientist, Multimodal Agentic RL joins the Nemotron LLM team to advance streaming and agentic multimodal AI. You will develop, train, fine-tune, and deploy large language models for agentic systems capable of audio-visual reasoning, tool usage, and document understanding. Key responsibilities include advancing post-training and alignment methods like instruction tuning, preference optimization, and RLHF/RLVR/MOPD to improve multimodal agents for complex use cases. You will research agentic reasoning, grounded perception, and long-horizon task completion. Required skills include Python, PyTorch, and expertise in Transformers, mixture-of-experts models, and reinforcement learning algorithms like MDPs and reward design. You will work on the Nemotron Omni and VoiceChat platforms to build models that perform planning and tool execution across digital and physical environments.

What you'll do

  • Develop, train, fine-tune, and deploy large language models for agentic systems with audio-visual reasoning and tool usage.
  • Advance post-training and alignment methods including instruction tuning, preference optimization, and RLHF/RLVR/MOPD.
  • Research and develop agentic reasoning and grounded perception capabilities for planning and long-horizon task completion.
  • Lead the collection, development, and benchmarking of high-quality multimodal datasets.
  • Evaluate model accuracy, safety, and task completion success across diverse digital and physical environments.
  • Manage the full model development life cycle, including dataset versioning, experiment tracking, and evaluation pipelines.

What we're looking for

  • Master’s degree or PhD in Computer Science, AI, or Applied Math with 8+ years of relevant work experience.
  • Excellent programming skills in Python with strong fundamentals in scalable model development and deep learning frameworks like PyTorch.
  • Strong knowledge of ML/DL techniques and modern foundation model architectures, including Transformers and mixture-of-experts models.
  • Foundational understanding of reinforcement learning algorithms and implementation, including MDPs, policies, and reward design.
  • Hands-on experience in post-training multimodal models for omni-modality reasoning, full-duplex voice chat, and human-AI interaction.
  • Proven ability to manage model development life cycles, including dataset versioning, experiment tracking, and evaluation pipelines.
  • Strong record of publications in top-tier AI and machine learning venues such as NeurIPS, ICML, ICLR, or CVPR (preferred).
  • Validated experience training and deploying multimodal foundation models using large-scale distributed infrastructure (preferred).

More like this

Similar roles

Senior Deep Learning Scientist, Multimodal Agentic RL

Nvidia

Santa Clara, CA 9 days ago $184,000–$287,500
Python PyTorch Deep Learning Reinforcement Learning Large Language Models Transformers Mixture-of-Experts RLHF Multimodal AI Instruction Tuning Preference Optimization Dataset Versioning Experiment Tracking Speech AI
8+ yrs exp

Senior Deep Learning Scientist, Multimodal Agentic RL

Nvidia

Santa Clara, CA 9 days ago $152,000–$241,500
Python PyTorch Deep Learning Reinforcement Learning Large Language Models Transformers Mixture-of-Experts RLHF RLVR MOPD Multimodal AI Distributed Infrastructure Dataset Versioning Experiment Tracking Speech AI
5+ yrs exp

Senior Research Scientist, Multimodal Foundation Models and Robotics

Nvidia

Santa Clara, CA 163 days ago $192,000–$304,750
Multimodal Foundation Models LLMs Large Vision-Language Models Diffusion Algorithms Action-based Transformers PyTorch Jax TensorFlow Python C++ CUDA Reinforcement Learning Imitation Learning ROS Robot Kinematics Model Predictive Control MuJoCo Isaac Sim Whole-body Control
5+ yrs exp

Senior High Performance AI Engineer, Agentic AI

Nvidia

Remote (Santa Clara, CA) +5 30 days ago $152,000–$241,500
CUDA Python C++ Rust Deep Learning Reinforcement Learning TRT-LLM SGLang vLLM Transformer Engine GPU Programming High-Performance Computing Compilers Inference Systems Agentic AI Multi-Agent Systems
4+ yrs exp Remote

Senior Machine Learning Engineer, AI Safety

Nvidia

Remote (Santa Clara, CA) 5 days ago $184,000–$287,500
Large Language Models (LLMs) Deep Learning PyTorch Python Reinforcement Learning (RLHF/RLAIF) Supervised Fine-Tuning (SFT) Vision-Language Models (VLMs) Machine Learning Agentic Safety AI Safety ML Fairness Instruction Hierarchy Risk Detection
8+ yrs exp Remote