Applied Researcher 4, AI Safety & Multimodal

Capital One Financial

Confirmed live today High trust

Quick summary

Work type
On-site
Location
New York, NYMcLean, VACambridge, MASan Jose, CA
Salary
$218,700–$249,600 / yr
Employment
Full-time
Posted
2 days ago
Freshness
Confirmed live today

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $222k
This role $234k
$191k $256k
below market most similar roles pay here above market

This role pays more than 77% of similar roles. Most pay $210,600–$234,150 — the blue band above. At the midpoint, this role pays about $234k versus about $222k for comparable roles.

Based on 240 similar postings.

Employer

About Capital One Financial

Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking

Capital One Financial currently has 2276 open roles on FindRole.

Listed pay typically runs $197,300–$225,100 across 1147 roles with salary data.

Most-posted roles

View all roles at Capital One Financial

At a glance

TL;DR · Applied Researcher 4, AI Safety & Multimodal

The Applied Researcher 4 (AI Safety & Multimodal) joins the AI Foundations team to develop trustworthy and reliable artificial intelligence systems. This role involves partnering with cross-functional teams to build AI foundation models through all development phases, including design, training, evaluation, validation, and implementation. You will perform high-impact applied research to translate complex AI developments into tangible business goals and customer experiences. Key responsibilities include building large deep learning models for language, images, events, or graphs, and deploying safety guardrails for multimodal systems like VLMs and MLLMs. You will utilize a technical stack including Pytorch, AWS Ultraclusters, Huggingface, and Lightning. The work focuses on solving technical problems in training optimization, self-supervised learning, robustness, explainability, and RLHF to improve how customers interact with their money.

What you'll do

  • Build AI foundation models through all phases of development including design, training, evaluation, and implementation.
  • Leverage Pytorch, AWS Ultraclusters, and Huggingface to extract insights from large volumes of numeric and textual data.
  • Conduct high-impact applied research to integrate the latest AI developments into next-generation customer experiences.
  • Develop and deploy safety guardrails for multimodal systems including VLMs, MLLMs, and MM-RAG architectures.
  • Perform red teaming and vulnerability assessments for multimodal applications using image, video, and text modalities.
  • Translate complex technical research into tangible business goals for product and technology leaders.
  • Author internal technical reports or conference submissions summarizing novel methods and research findings.
  • Own and pursue a research agenda by identifying impactful problems and autonomously carrying out long-running projects.

What we're looking for

  • Must have a PhD in Electrical Engineering, Computer Engineering, Computer Science, AI, Mathematics, or a related field.
  • Must have an M.S. in Electrical Engineering, Computer Engineering, Computer Science, AI, Mathematics, or a related field plus 2 years of experience in Applied Research.
  • Must have hands-on experience developing AI foundation models and solutions using open-source tools and cloud computing platforms.
  • Must have a deep understanding of the foundations of AI methodologies.
  • Must have experience building large deep learning models for language, images, events, or graphs.
  • Must have expertise in one or more of the following: training optimization, self-supervised learning, robustness, explainability, or RLHF.
  • Must have experience with red teaming and deploying safety guardrails for multimodal systems, including VLMs, MLLMs, and MM-RAG architectures.
  • Must have an engineering mindset with a track record of delivering models at scale for training data and inference volumes.
  • Must have experience delivering libraries, platform-level code, or solution-level code to existing products.
  • Must have a track record of producing high-quality machine learning ideas, such as first-author publications or projects.
  • Must possess the ability to own a research agenda and autonomously carry out long-running projects.
  • PhD in Computer Science, Machine Learning, Computer Engineering, Applied Mathematics, or Electrical Engineering (preferred).
  • LLM PhD focus on NLP or Masters with 5 years of industrial NLP research experience (preferred).
  • Multiple publications on pre-training large language models, SSL techniques, or model pre-training optimization (preferred).
  • Member of a team that has trained a large language model from scratch with 10B+ parameters and 500B+ tokens (preferred).
  • Publications in deep learning theory or at major conferences like ACL, NAACL, EMNLP, Neurips, ICML, or ICLR (preferred).
  • PhD focused on optimizing training of very large deep learning models (preferred).
  • Multiple years of experience or publications in model sparsification, quantization, training parallelism, or model compression (preferred).
  • Deep knowledge of deep learning algorithmic and/or optimizer design (preferred).
  • Experience with compiler design (preferred).
  • PhD focused on guiding LLMs through supervised finetuning, instruction-tuning, or dialogue-finetuning (preferred).
  • Demonstrated knowledge of transfer learning, model adaptation, and model guidance (preferred).
  • Experience deploying a fine-tuned large language model (preferred).
  • Demonstrated ability to reproduce and extend peer-reviewed AI research using modern open-source frameworks (preferred).
  • Experience in AI Safety, LLM safety alignment, and guardrail development (preferred).
  • Experience in safety and vulnerability assessment of multimodal applications using image/video and text (preferred).
  • Experience designing controlled experiments and documenting reproducibility results for research (preferred).

More like this

Similar roles

Applied Researcher 4, AI Foundations: Multimodal Guardrails and VLM's

Capital One Financial

Cambridge, MA +3 29 days ago $218,700–$249,600
Pytorch AWS Huggingface Lightning Deep Learning LLM NLP RLHF Self-Supervised Learning Quantization Model Sparsification Training Parallelism Supervised Finetuning Instruction-Tuning Transfer Learning Compiler Design
2+ yrs exp

Applied Researcher 4

Capital One Financial

New York, NY +3 38 days ago $218,700–$249,600
Pytorch AWS Huggingface Lightning LLM NLP Deep Learning RLHF Self-Supervised Learning Quantization Model Sparsification Training Parallelism Gradient Checkpointing Model Compression Transfer Learning Supervised Finetuning Instruction-Tuning Compiler Design
2+ yrs exp

Applied Researcher 4

Capital One Financial

San Jose, CA +4 2 days ago $218,700–$249,600
PyTorch AWS Huggingface Lightning Deep Learning LLM NLP RLHF Self-Supervised Learning Quantization Model Sparsification Training Parallelism Compiler Design Supervised Finetuning Instruction-Tuning Transfer Learning
2+ yrs exp

Applied Researcher 4, AI Foundations: Recommendation Systems

Capital One Financial

McLean, VA +3 21 days ago $218,700–$249,600
Pytorch AWS Huggingface Lightning Deep Learning NLP LLM RLHF Self-Supervised Learning Quantization Model Sparsification Training Parallelism Compiler Design Supervised Finetuning Instruction-Tuning Transfer Learning
2+ yrs exp

Applied Researcher 4

Capital One Financial

New York, NY +3 46 days ago $218,700–$249,600
Pytorch AWS Huggingface Lightning Deep Learning LLM NLP RLHF Quantization Model Compression Training Parallelism Self-Supervised Learning Transfer Learning Cloud Computing
2+ yrs exp

Applied Researcher 4

Capital One Financial

McLean, VA +3 17 days ago $218,700–$249,600
Pytorch AWS Huggingface Lightning Deep Learning Graph Neural Networks RLHF Self-Supervised Learning Training Optimization Representation Learning
2+ yrs exp