Senior Lead AI Engineer (FM Hosting, LLM Inference)

Capital One Financial

Actively hiring
Mclean, Va, US Posted 122 days ago $229,900–$262,400 / year
View original post Log in to save

At a glance

AI generated

TL;DR

As a Senior Lead AI Engineer at COPSSC, you will join the FM Hosting team responsible for LLM inference services. Your primary focus will be to design and implement scalable solutions that enhance our large language model performance, ensuring efficient hosting and seamless user experiences. Day-to-day responsibilities include optimizing models for real-time inference, collaborating with cross-functional teams on infrastructure improvements, and conducting research to integrate cutting-edge AI technologies. Proficiency in Python, TensorFlow, or PyTorch is essential, along with expertise in cloud platforms like AWS or Azure. You should also have a strong background in machine learning, distributed systems, and experience working with large-scale data processing frameworks. This role presents an opportunity to tackle complex challenges in the rapidly evolving field of AI-driven hosting services.

Skills

Python TensorFlow PyTorch Kubernetes Docker AWS CI/CD PostgreSQL Redis Prometheus Grafana GitLab Jupyter Notebook Scikit-learn Pandas NumPy Hugging Face Transformers

What you'll do

  • Design and optimize large language model inference systems.
  • Implement efficient hosting solutions for AI models in cloud environments.
  • Develop scalable infrastructure to support real-time AI applications.
  • Ensure high performance and low latency in AI service delivery.
  • Monitor and maintain the security of AI systems and data.

What we're looking for

  • Minimum 10 years of experience in AI and machine learning.
  • Proven track record leading large-scale AI projects and teams.
  • Expertise in developing and deploying LLM inference systems.
  • Strong background in COPSSC (Cloud, Operations, Platforms, Security, Strategy, Cloud).
  • Experience with FM Hosting and related infrastructure technologies.

Market check

Salary context

This $229,900–$262,400 range sits above 79% of similar postings on FindRole.

Peer median band

$179,137–$261,850

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$192,006–$246,150

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Capital One Financial

Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking

Capital One Financial currently has 489 open roles on FindRole.

Listed pay typically runs $197,300–$225,100 across 483 roles with salary data.

Most-posted roles

View all roles at Capital One Financial

More like this

Similar roles

Senior Lead AI Engineer (LLM Gateway, FM Hosting)

Capital One Financial

Mclean, Va, US 15 days ago $229,900–$262,400
Python TensorFlow PyTorch Docker Kubernetes AWS CI/CD Git PostgreSQL Redis Scikit-learn Flask RESTful APIs Nginx Prometheus Grafana

Senior Lead AI Engineer (FM Hosting)

Capital One Financial

New York, Ny, US 108 days ago $229,900–$262,400
Python TensorFlow PyTorch Kubernetes Docker AWS CI/CD Git Jupyter Notebook PostgreSQL MongoDB Scikit-learn Pandas NumPy Flask RESTful APIs Swagger GraphQL

Senior Lead AI Engineer

Capital One Financial

New York, Ny, US 36 days ago $229,900–$262,400
Python TensorFlow PyTorch Kubernetes Docker AWS CI/CD Git PostgreSQL MongoDB Scikit-learn Pandas NumPy Jupyter Notebook Prometheus Grafana