Senior Product Manager – Conversational AI Servicing Quality Assurance
At a glance
AI generatedTL;DR
We are seeking a Senior Product Manager to lead the onboarding and assessment strategy for evaluating conversational AI solutions on our enterprise quality assurance platform. This role involves driving the integration of advanced AI technologies, developing automated QA capabilities with closed-loop feedback systems, and scaling these systems to maintain consistency and accuracy as we expand evaluation across diverse customer interactions. The ideal candidate is an experienced product leader with a track record in shipping complex data platforms or cloud-scale conversational applications, along with a deep understanding of LLM evaluation pipelines. They should be adept at strategic thinking, managing technical dependencies, and navigating high-velocity cross-functional teams.
Skills
What you'll do
- Drive end-to-end integration of conversational AI solutions onto enterprise QA platforms.
- Develop advanced automated assessment parameters for continuous improvement of AI systems.
- Establish closed-loop feedback mechanisms to enable AI self-correction and learning.
- Design scalable quality assurance systems to handle rapid expansion of customer intents.
- Ensure consistent, accurate, and scalable automated assessments across diverse tasks.
What we're looking for
- Experienced in shipping complex data platforms or cloud-scale conversational applications.
- Strong knowledge of LLM evaluation pipelines or a deep passion for them.
- Proven ability to drive end-to-end platform integration and roadmap execution.
- Expertise in designing scalable automated QA systems for rapid coverage expansion.
- Skilled in developing advanced AI QA capabilities with closed-loop feedback mechanisms.
- Capable of managing complex technical dependencies across high-velocity teams.
Employer
About Capital One Financial
Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking
Capital One Financial currently has 535 open roles on FindRole.
Listed pay typically runs $197,300–$225,100 across 531 roles with salary data.
Most-posted roles
- Lead Software Engineer, Full Stack 9
- Lead Software Engineer, Back End 7
- Lead Machine Learning Engineer 6
- Lead Software Engineer 6
- Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) 6