Lead Data Engineer

Capital One Financial

Confirmed live today Low trust

Quick summary

Work type: On-site
Location: New York, NYMcLean, VARichmond, VA
Employment: Full-time
Posted: 89 days ago
Freshness: Confirmed live today
Nearby: 99+ roles within 25 mi

Market check

Salary context

How this pay compares to similar roles

Similar $172k

$123k $221k

below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $132,426–$211,200.

Based on 240 similar postings.

Employer

About Capital One Financial

Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking

Capital One Financial currently has 2107 open roles on FindRole.

Listed pay typically runs $197,300–$225,100 across 1107 roles with salary data.

Most-posted roles

View all roles at Capital One Financial

At a glance

TL;DR · Lead Data Engineer

Role Posting Log in to save

JOB TITLE: Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI) The Lead Data Engineer joins the Marketing and Messaging team to build scalable platforms delivering omnichannel messages across owned and paid Adtech channels. As a lead developer, you will collaborate with Agile teams to design, develop, test, and support technical solutions for data movement and distributed computing. You will build robust cloud-based solutions, optimize information systems using sound data design practices, and perform unit tests to ensure code is effectively tuned for performance. The role requires proficiency in Python, SQL, Spark, Kafka, Snowflake, Databricks, and AWS. You will also utilize NoSQL databases, Open Source RDBMS, and interactive AI tooling like GitHub Copilot. This position solves complex business problems by creating hyper-personalized customer experiences through advanced data modeling and real-time streaming applications.

Skills

Python SQL AWS Spark Kafka Snowflake Databricks GenAI ETL NoSQL Hadoop Hive EMR Redshift MySQL Mongo Cassandra UNIX Linux Agile GitHub Copilot

What you'll do

Design, develop, test, and implement technical solutions using data movement tools and technologies.
Lead a team of developers in building distributed computing and full-stack systems.
Utilize Python, SQL, and Snowflake or Databricks to manage cloud-based data warehousing.
Optimize information systems for end-users and downstream consumers using sound data design practices.
Deliver robust cloud-based solutions to drive hyper-personalized customer experiences.
Perform unit tests and conduct code reviews to ensure performance and design quality.
Mentor other members of the engineering community on new technologies and tech trends.

What we're looking for

At least 4 years of experience in application development.
At least 2 years of experience in big data technologies.
At least 1 year of experience with cloud computing (AWS, Microsoft Azure, Google Cloud).
Master's Degree (preferred).
7+ years of experience in application development including Python, SQL, Spark, ETL tools, or AWS Glue (preferred).
4+ years of experience with a public cloud, distributed data tools, real-time streaming, NoSQL, data warehousing, UNIX/Linux, and data modeling (preferred).
2+ years of experience with Agile engineering practices (preferred).

Save