As a Lead Data Engineer, you will join a dynamic and inclusive team to design and build an enterprise-level scalable, low-latency, fault-tolerant streaming data platform that delivers meaningful insights. Your responsibilities include leading the development of distributed streaming data pipelines and analytics data stores using frameworks like Flink and Spark Streaming with Java, Scala, and Python. You will also manage a group of engineers working on big data technologies such as Spark, Kafka, Snowflake, and AWS Big Data Services to handle medium to large scale datasets. Additionally, you will influence best practices for data pipeline design and processing structured and unstructured data while collaborating in an agile environment focused on CI/CD and application resiliency standards.
Design and build a scalable, low-latency streaming data platform.
Develop next-generation distributed streaming data pipelines using Flink and Spark Streaming.
Lead engineers in creating big data technologies-based data pipelines on large datasets.
Influence best practices for data pipeline design and structured/unstructured data processing.
Collaborate with security teams to ensure application resiliency standards are met.
What we're looking for
7+ years of application development experience in Java, Python, SQL, or Scala.
4+ years of experience with distributed data computing tools like Flink, Kafka, and Spark.
4+ years of NoSQL implementation experience with DynamoDB and OpenSearch.
Lead the design and build of enterprise-level scalable streaming data platforms.
Influence best practices for data pipeline design and structured/unstructured data processing.
Market check
Salary context
This
$179,400–$204,700
range sits above
69%
of similar postings on FindRole.
Peer median band
$125,050–$206,700
Median floor and ceiling across peers.
Typical midpoint (25–75%)
$126,800–$210,112
Middle half of comparable postings.
Based on 240 comparable postings.*
* 240 is the maximum number of comparable postings sampled.
Employer
About Capital One Financial
Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking
Capital One Financial currently has
489 open roles
on FindRole.
Listed pay typically runs
$197,300–$225,100
across 483 roles with salary data.