Senior Lead Data Engineer (Python, AWS, Spark, Kakfa, SQL, Snowflake, DynamoDB, Databricks, GenAI)

Capital One Financial

Actively hiring
Mclean, Va, US Posted 63 days ago $229,900$262,400 / year

At a glance

AI generated

TL;DR

As a Senior Lead Data Engineer on the Marketing and Messaging team, you will collaborate with agile teams to design, develop, test, implement, and support technical solutions using data movement tools such as Python, SQL, Snowflake, Databricks, and AWS services. You will lead a team of developers experienced in distributed computing and full-stack systems, optimizing information systems for end-users and downstream applications through sound data design practices. The role involves working with emerging technologies to build scalable platforms that deliver hyper-personalized messages across multiple channels, leveraging tools like Spark, Kafka, and Snowflake while ensuring data quality and governance.

Skills

Python AWS Spark Kafka SQL Snowflake DynamoDB Databricks CI/CD GenAI Hadoop EMR MapReduce GitHub_Copilot

What you'll do

  • Lead development of technical solutions using data movement tools and technologies.
  • Design and implement scalable platforms for omnichannel message delivery.
  • Optimize information systems for end-users and downstream applications.
  • Utilize Python, SQL, Snowflake, Databricks, and other cloud-based services.
  • Work with a team to build and maintain distributed computing systems.
  • Ensure data quality and governance in data modeling and warehousing.

What we're looking for

  • 9+ years of experience in application development using Python and SQL.
  • 5+ years of experience with distributed data/computing tools like Spark, Kafka, and Hadoop.
  • 4+ years of experience in data modeling for data warehousing.
  • Extensive experience with AWS services including Glue, Snowflake, Databricks, and DynamoDB.
  • Experience leveraging AI-assisted coding tools to accelerate software delivery.

Market check

Salary context

This $229,900–$262,400 range sits above 92% of similar postings on FindRole.

Peer median band

$128,050$221,950

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$142,300$211,650

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Capital One Financial

Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking

Capital One Financial currently has 489 open roles on FindRole.

Listed pay typically runs $197,300–$225,100 across 483 roles with salary data.

Most-posted roles

View all roles at Capital One Financial

More like this

Similar roles

Senior Data Engineer (SQL, Python, Databricks)

CIBC

Il-70 W Madison St, 10Th Fl, US 14 days ago $120,000$135,000
Databricks PySpark Scala Azure SQL Server SSIS CI/CD Tableau Cognos Power BI Jira Azure DevOps Python REST APIs DevOps