Lead Data Engineer

Elastic

Confirmed live today High trust

Quick summary

Work type
On-site
Location
—
Salary
$113,100–$178,900 / yr
Posted
2 days ago
Freshness
Confirmed live today

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $170k
This role $146k
$102k most similar roles pay here $220k

This role pays less than 69% of similar roles. Most pay $134,725–$204,287 — the shaded band above. At the midpoint, this role pays about $146k versus about $170k for comparable roles.

Based on 240 similar postings.

Employer

About Elastic

Elastic is the company behind Elasticsearch and the Elastic Stack (Elasticsearch, Kibana, Beats, and Logstash). It sells search, observability, and security products built on that search engine, primarily through its Elastic Cloud managed service.

Elastic currently has 50 open roles on FindRole.

Listed pay typically runs $147,750–$212,650 across 48 roles with salary data.

Most-posted roles

View all roles at Elastic

At a glance

TL;DR · Lead Data Engineer

The Lead Data Engineer will join the Data Engineering & Architecture team to grow a Data Platform that enables internal teams to work with data confidently. You will design, maintain, and improve pipelines and infrastructure across the full data lifecycle, including ingestion, streaming, transformation, and delivery. Key responsibilities include collaborating with stakeholders to define data flows, co-creating data contracts, and managing resources on Google Cloud Platform. You will utilize a technical stack featuring Apache Airflow, Spark, Iceberg, Kafka, Flink, dbt Labs, and Terraform. Proficiency in Bash, Python, and SQL is required, along with knowledge of OLAP, OLTP, Document, and Vector databases. This role solves the technical challenge of turning complex data into trusted, usable assets while ensuring platform performance and compliance.

What you'll do

  • Design, maintain, and improve data pipelines and infrastructure across the full data lifecycle.
  • Use Apache Airflow, Spark, Iceberg, Kafka, Flink, and dbt Labs to process and transform data.
  • Provision and manage cloud resources on Google Cloud Platform using Terraform.
  • Define data flows and co-create data contracts with internal stakeholders.
  • Monitor and refine pipeline performance to ensure smooth data operations.
  • Review code and enforce standard processes to steward the data platform.
  • Process access requests and ensure compliance with platform security policies.
  • Write clear documentation and guide teammates on utilizing platform tools.

What we're looking for

  • 8+ years of experience in data engineering or related roles.
  • Experience with Apache Airflow for orchestrating data workflows.
  • Experience with Spark, Flink, Kafka, and dbt Labs for data processing and transformation.
  • Understanding of Apache Iceberg for data table formats and data warehouse and lakehouse strategies.
  • Skilled in using Terraform for infrastructure-as-code deployments.
  • Proficient in programming languages, particularly Bash, Python, and SQL.
  • Knowledge of database systems, including OLAP, OLTP, Document, and Vector databases.
  • Experience with Google Cloud Platform (GCP) for cloud resource management.
  • Proven experience with data security and access controls for SOX Compliant data (preferred).
  • Experience and knowledge of the Elastic stack (preferred).

More like this

Similar roles

Lead Data Engineer

3M

MN 52 days ago
Python SQL Spark Databricks Azure Data Factory Synapse Kafka Cosmos DB MLOps CI/CD Feature Stores Vector Databases LLM Infrastructure as Code Data Modeling Airflow Event Hub
7+ yrs exp

Lead Data Engineer

Capital One Financial

New York, NY 27 days ago
Python SQL Scala Java AWS Azure Redshift Snowflake Spark Kafka Hadoop Hive EMR NoSQL Cassandra MySQL Linux Shell Scripting Agile
4+ yrs exp

Lead Data Engineer

Capital One Financial

Plano, TX 115 days ago
Python Java TypeScript React Databricks Snowflake Spark Kafka AWS Redshift SQL Scala Flink DynamoDB OpenSearch UNIX Linux CI/CD Agile Microservices
4+ yrs exp

Lead Data Engineer

Capital One Financial

McLean, VA +3 112 days ago
Python SQL Scala Java AWS Azure Redshift Snowflake Spark Kafka Hadoop Hive EMR NoSQL Cassandra MySQL UNIX Linux Shell Scripting Agile Machine Learning
4+ yrs exp

Lead Data Engineer

Capital One Financial

McLean, VA +3 108 days ago
Python SQL Scala Java AWS Azure Redshift Snowflake Spark Kafka Hadoop Hive EMR NoSQL Cassandra MySQL UNIX Linux Shell Scripting Agile Machine Learning
4+ yrs exp

Lead Data Engineer

Capital One Financial

Plano, TX +2 86 days ago
Python SQL Scala Java AWS Snowflake Redshift Spark Kafka Hadoop Hive EMR NoSQL Cassandra MySQL Linux Shell Scripting Agile
4+ yrs exp