Senior Lead Data Engineer (Python, AWS, Spark, Kakfa, SQL, Snowflake, DynamoDB, Databricks, GenAI)

Capital One Financial

Actively hiring

Mclean, Va, US Posted 63 days ago $229,900–$262,400 / year

View original post Log in to save

At a glance

AI generated

TL;DR

As a Senior Lead Data Engineer on the Marketing and Messaging team, you will play a pivotal role in building scalable platforms that deliver hyper-personalized messages across various channels. Your responsibilities include collaborating with Agile teams to design and implement technical solutions using data movement tools such as Python, SQL, Snowflake, Databricks, and AWS services. You will lead a team of developers with expertise in distributed computing and full-stack systems, optimizing information systems for end-users and downstream applications through sound data practices. The role requires extensive experience with AI-assisted coding tools, Python, SQL, Spark, ETL tools, and distributed computing frameworks like Kafka and Hadoop to solve complex business problems at scale.

Skills

Python AWS Spark Kafka SQL Snowflake DynamoDB Databricks CI/CD GenAI GitHub Copilot MapReduce Hadoop EMR MySQL

What you'll do

Design and develop complex data pipelines using Python, SQL, and AWS services.
Lead a team of developers in building scalable platforms for omnichannel messaging.
Implement and optimize data movement tools and technologies for efficient data processing.
Ensure high-quality data governance and permissible use within the organization.
Utilize Snowflake, Databricks, and other cloud-based services to enhance data warehousing.

What we're looking for

9+ years of experience in application development using Python and SQL
Extensive experience with AWS Glue, ETL tools, and distributed computing (Hadoop, Spark)
5+ years working with Kafka for data streaming and processing
Experience with Snowflake, Databricks, and other cloud-based data warehousing services
4+ years of data modeling for data warehousing projects

Market check

Salary context

This $229,900–$262,400 range sits above 92% of similar postings on FindRole.

Peer median band

$128,050–$221,950

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$142,300–$211,650

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Capital One Financial

Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking

Capital One Financial currently has 489 open roles on FindRole.

Listed pay typically runs $197,300–$225,100 across 483 roles with salary data.

Most-posted roles