Senior Manager, AI Engineer, Gen AI Platform Services: Agentic AI, Guardrails, Evaluation

Capital One Financial

Confirmed live today Low trust

Quick summary

Work type: On-site
Location: New York, NYSan Francisco, CAMcLean, VACambridge, MASan Jose, CA
Employment: Full-time
Posted: 55 days ago
Freshness: Confirmed live today
Nearby: 99+ roles within 25 mi

Market check

Salary context

How this pay compares to similar roles

Similar $205k

$139k $273k

below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $163,125–$246,150.

Based on 240 similar postings.

Employer

About Capital One Financial

Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking

Capital One Financial currently has 2107 open roles on FindRole.

Listed pay typically runs $197,300–$225,100 across 1107 roles with salary data.

Most-posted roles

View all roles at Capital One Financial

At a glance

TL;DR · Senior Manager, AI Engineer, Gen AI Platform Services: Agentic AI, Guardrails, Evaluation

Role Posting Log in to save

The Senior Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) joins the Intelligent Foundations and Experiences team to build and deploy proprietary AI solutions. You will oversee the design, development, testing, and support of AI software components, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability. The role involves making build-vs-buy decisions using technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch. You will also invent LLM optimization techniques to improve performance, scalability, cost, latency, and throughput. Key requirements include proficiency in Python, C++, C#, or Golang, and experience developing AI and ML algorithms. This role solves the technical challenge of creating responsible, scalable, and high-performance production AI systems.

Skills

LLM PyTorch Python C++ Java Golang C# AWS Huggingface VectorDB Nemo Guardrails Similarity Search Model Evaluation Observability Machine Learning

What you'll do

Oversee the design, development, testing, deployment, and support of AI software components.
Manage foundation model training, LLM inference, similarity search, guardrails, and model evaluation.
Make build-vs-buy decisions for open-source and SaaS AI technologies like AWS Ultraclusters and VectorDBs.
Invent and introduce LLM optimization techniques to improve performance, scalability, cost, and latency.
Contribute to the technical vision and long-term roadmap of foundational AI systems.
Attract, retain, and nurture the professional development of a high-performing AI engineering team.
Apply novel AI research techniques to production environments to solve complex business problems.

What we're looking for

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus 6 years of AI/ML experience.
Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus 4 years of AI/ML experience.
At least 1 year of people leadership experience.
3 years of experience managing and leading an engineering team (preferred).
6 years of experience deploying scalable and responsible AI solutions on cloud platforms (preferred).
Experience developing AI/ML algorithms using Python, C++, C#, Java, or Golang (preferred).
Ability to stay abreast of AI research and apply novel techniques in production (preferred).
Excellent communication and presentation skills to articulate complex AI concepts (preferred).

Save