Senior Manager, Product Management - Conversational AI Servicing Quality Assurance

Capital One Financial

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
McLean, VANew York, NYRichmond, VA
Salary
$182,500–$208,300 / yr
Posted
31 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $211k
This role $195k
$159k most similar roles pay here $255k

This role pays less than 54% of similar roles. Most pay $176,450–$245,250 — the shaded band above. At the midpoint, this role pays about $195k versus about $211k for comparable roles.

Based on 240 similar postings.

Employer

About Capital One Financial

Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking

Capital One Financial currently has 998 open roles on FindRole.

Listed pay typically runs $197,300–$225,100 across 992 roles with salary data.

Most-posted roles

View all roles at Capital One Financial

At a glance

TL;DR · Senior Manager, Product Management - Conversational AI Servicing Quality Assurance

Sr. Manager, Product Management - Conversational AI Servicing Quality Assurance leads the Analytics Pillar team to direct strategy for evaluating conversational AI solutions. This role focuses on scaling automated validation and unstructured analytics across customer interactions while pioneering "AI QA on AI" capabilities. Key responsibilities include managing platform integration, establishing human-in-the-loop workflows, creating closed-loop feedback systems, and overseeing core product workstreams such as transcript-level LLM intelligence, natural language querying, and UI enhancements. The candidate will manage technical dependencies and lead a team of product and analytics associates to ensure quality checks remain consistent across complex customer intents. Required expertise includes experience with large-scale data platforms, cloud-scale conversational applications, and LLM evaluation pipelines. The role addresses the challenge of maintaining accurate, scalable automated monitoring for high-priority regulatory, business, and behavioral use cases within a generative AI environment.

What you'll do

  • Execute the product roadmap to integrate conversational AI solutions onto the quality platform.
  • Establish "AI QA on AI" capabilities including automated assessment parameters and human-in-the-loop workflows.
  • Develop closed-loop feedback systems for continuous self-correction of AI models.
  • Design scalable infrastructure to maintain accurate quality checks across complex customer intents.
  • Drive transcript-level LLM intelligence, natural language querying, and UI enhancements.
  • Expand automated monitoring for regulatory, business, and behavioral use cases.
  • Manage the Analytics Pillar team by mentoring staff and aligning backlogs with executive priorities.
  • Optimize delivery velocity across engineering and data science teams to ensure product excellence.

What we're looking for

  • Must have a Bachelor's or Master's degree in a quantitative field, Business, Marketing, or a related field.
  • Alternatively, must have a Bachelor's degree in any field and at least 4 years of Product Management experience.
  • Experience shipping complex data platforms or cloud-scale conversational applications is required.
  • Must possess deep knowledge of LLM evaluation pipelines.
  • Proven experience in team management and mentoring product and analytics associates is required.
  • Ability to translate business strategy and analysis into consumer-facing digital products is preferred.
  • Proficiency in human-centered, business-focused, technology-driven, and integrated problem-solving approaches is required.
  • Demonstrated ability to lead cross-functional teams and drive organizational alignment is required.

More like this

Similar roles

Senior Manager, Product Manager, AI Acceleration

Capital One Financial

New York, NY +1 29 days ago $200,700$229,100
Generative AI LLM-as-Judge AI Agents Data Science Product Management Streaming Data Platforms Observability Software Engineering Analytics Statistics Operations Research Information Systems
4+ yrs exp

Senior Manager, Product Management, AI/ML

Capital One Financial

McLean, VA +3 56 days ago $182,500$208,300
AI ML Gemini Claude Google Apps Script Product Management Software Engineering Analytics Statistics Operations Research Information Systems Prototyping Automation Tools
4+ yrs exp

Manager, Product Management, AI/ML

Capital One Financial

McLean, VA +3 35 days ago $149,800$171,000
AI ML Gemini Claude Google Apps Script Software Engineering Product Management Analytics Statistics Operations Research Information Systems
3+ yrs exp