AI Engineer 5, Gen AI Platform Services: Agentic Systems

Capital One Financial

Confirmed live today High trust

Quick summary

Work type
On-site
Location
New York, NYSan Francisco, CAMcLean, VACambridge, MASan Jose, CA
Salary
$229,900–$262,400 / yr
Employment
Full-time
Posted
1 day ago
Freshness
Confirmed live today

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $210k
This role $246k
$164k most similar roles pay here $273k

This role pays more than 85% of similar roles. Most pay $174,175–$246,150 — the shaded band above. At the midpoint, this role pays about $246k versus about $210k for comparable roles.

Based on 240 similar postings.

Employer

About Capital One Financial

Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking

Capital One Financial currently has 1783 open roles on FindRole.

Listed pay typically runs $197,300–$225,100 across 942 roles with salary data.

Most-posted roles

View all roles at Capital One Financial

At a glance

TL;DR · AI Engineer 5, Gen AI Platform Services: Agentic Systems

The AI Engineer 5 (Gen AI Platform Services: Agentic Systems) joins the Intelligent Foundations and Experiences team to develop proprietary AI solutions for banking. You will partner with cross-functional teams to design, develop, test, and deploy AI software components, including foundation model training, large language model inference, agents, multi-agent workflows, similarity search, and guardrails. Key responsibilities involve inventing optimization techniques for scalability, cost, and latency, while leading cost-performance governance reviews and mentoring other engineers. You will utilize a technical stack including AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, Python, Go, Scala, CUDA, and Java. The role focuses on building scalable, responsible AI infrastructure and multi-model orchestration pipelines to solve complex production problems, ensuring technical consistency and compliance with engineering standards across the enterprise.

What does a AI Engineer earn in New York?

Median $246150 from 64 postings across 10 companies.

See salary data

What you'll do

  • Design, develop, test, deploy, and support AI software components including foundation model training and LLM inference.
  • Build and optimize multi-agent workflows, similarity search, guardrails, and model evaluation systems.
  • Implement state-of-the-art optimization techniques to improve scalability, cost, latency, and throughput of production AI systems.
  • Design and optimize multi-model orchestration pipelines integrating LLMs, vector search, and domain-specific models.
  • Lead cost-performance governance reviews to track GPU utilization, model throughput, and inference cost efficiency.
  • Lead design councils to ensure technical consistency and compliance with AI engineering standards.
  • Mentor Principal and Manager-level AI engineers to foster cross-domain learning and elevate technical maturity.

What we're looking for

  • Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related field plus 6 years of AI/ML experience.
  • Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related field plus 4 years of AI/ML experience.
  • At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java.
  • Experience leading development of AI systems with tradeoff decisions around cost, latency, throughput, and accuracy (preferred).
  • 7+ years of experience deploying scalable and responsible AI solutions on cloud platforms (preferred).
  • Experience designing, developing, delivering, and supporting complex AI systems (preferred).
  • Experience developing AI and ML algorithms using Python, C++, C#, Java, CUDA, or Golang (preferred).
  • Experience developing and applying state-of-the-art techniques for optimizing training and inference software (preferred).

More like this

Similar roles

AI Engineer V

Capital One Financial

New York, NY +4 20 days ago
Python Go CUDA PyTorch Huggingface AWS VectorDBs LLM Inference Agentic AI Multi-agent Workflows Similarity Search Model Evaluation Model Optimization C++ Scala Java C#
6+ yrs exp

AI Engineer V

Capital One Financial

McLean, VA +4 16 days ago $229,900–$262,400
Python Go CUDA PyTorch Huggingface AWS VectorDBs LLM Inference Agentic AI Multi-agent Workflows Similarity Search C++ Scala Java C# Model Optimization
6+ yrs exp

AI Engineer V

Capital One Financial

San Jose, CA +4 20 days ago $229,900–$262,400
Python Go CUDA PyTorch Huggingface AWS VectorDBs LLM Inference Agentic AI Multi-agent Workflows Similarity Search Model Optimization C++ Scala Java C#
6+ yrs exp

AI Engineer V

Capital One Financial

San Jose, CA +4 20 days ago $229,900–$262,400
Python Go CUDA PyTorch Huggingface AWS VectorDBs LLM Inference Agentic AI Multi-agent Workflows Similarity Search Model Optimization C++ Scala Java C#
6+ yrs exp

AI Engineer V

Capital One Financial

San Jose, CA +4 20 days ago $229,900–$262,400
Python Go CUDA PyTorch Huggingface AWS VectorDBs LLM Inference Agentic AI Multi-agent Workflows Similarity Search Model Optimization C++ Scala Java C#
6+ yrs exp

AI Engineer V

Capital One Financial

San Jose, CA +3 20 days ago $229,900–$262,400
Python Go CUDA PyTorch Huggingface AWS VectorDBs LLM Inference Agentic Workflows C++ Java Scala C# Model Optimization Machine Learning
6+ yrs exp