Staff AI Engineer, Enterprise Analysis Platform

What you'll do

• Design, develop, test, deploy, and support AI software components including foundation model training and LLM inference.
• Implement similarity search, guardrails, model evaluation, experimentation, governance, and observability for production systems.
• Apply state-of-the-art LLM optimization techniques to improve performance, scalability, cost, latency, and throughput of large-scale systems.
• Utilize a broad stack of open-source and SaaS technologies including Huggingface, VectorDBs, PyTorch, and AWS Ultraclusters.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.
• Translate complex scientific research into practical, production-ready features for internal and external users.
• Architect and manage high-scale AI platforms that integrate deterministic code with non-deterministic reasoning systems.

What we're looking for

• Bachelor's degree in Computer Science, Engineering, or AI with at least 8 years of experience developing AI and ML algorithms.
• Master's degree in Computer Science, Engineering, or a relevant technical field with at least 6 years of experience developing AI and ML algorithms.
• At least 8 years of experience programming with Python, Go, Scala, or Java.
• 8 years of experience deploying scalable and responsible AI solutions on cloud platforms like AWS, Google Cloud, or Azure.
• Experience architecting, designing, and supporting complex AI systems including LLM inference, similarity search, and vector databases.
• Experience applying state-of-the-art techniques to optimize training and inference software for hardware utilization, latency, and cost.
• Ability to lead multiple engineering teams and influence cross-functional stakeholders up to the VP level.
• Excellent communication skills to articulate complex AI concepts to peers and stakeholders.