Senior Databricks Platform Engineer

General Dynamics

Confirmed live 2 days ago High trust
Remote

Quick summary

Work type
Remote
Location
Remote
Salary
$169,604–$229,464 / yr
Posted
6 days ago
Freshness
Confirmed live 2 days ago

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $187k
This role $200k
$130k most similar roles pay here $240k

This role pays more than 53% of similar roles. Most pay $151,000–$223,187 — the shaded band above. At the midpoint, this role pays about $200k versus about $187k for comparable roles.

Based on 240 similar postings.

Employer

About General Dynamics

General Dynamics is a global aerospace and defense company offering a broad portfolio of products and services in business aviation, ship construction, land combat vehicles, and information technology. It serves customers in the U.S. government, allied governments, and a diverse array of commercial markets.

General Dynamics currently has 1123 open roles on FindRole.

Listed pay typically runs $124,093–$150,385 across 984 roles with salary data.

Most-posted roles

View all roles at General Dynamics

At a glance

TL;DR · Senior Databricks Platform Engineer

Senior Databricks Platform Engineer will join the CMM Data Modernization and Governance team to support a cloud-based solution for federal courts. The role involves designing, building, administering, and optimizing the Databricks Lakehouse Platform, including Unity Catalog, workspaces, and scalable data architectures. Day-to-day responsibilities include developing data pipelines using Apache Spark, Delta Lake, and Delta Live Tables; managing compute clusters and SQL warehouses; and automating platform provisioning via Terraform, Python, SQL, and Databricks Asset Bundles. The position requires expertise in Spark performance tuning, CI/CD pipelines using Jenkins or GitHub Actions, and monitoring tools like Grafana and Datadog. Technical skills include experience with AWS environments, Docker, Kubernetes, and Bash scripting. This role solves critical data governance, engineering, and analytics challenges to support operational decision-making within the Case Management Modernization program.

What you'll do

  • Design, configure, and maintain the enterprise Databricks Lakehouse Platform including workspaces and Unity Catalog.
  • Administer and optimize Databricks compute resources, SQL warehouses, and serverless capabilities for performance and cost efficiency.
  • Develop and optimize data pipelines and ETL/ELT processes using Apache Spark, Delta Lake, and Databricks Workflows.
  • Manage data governance by implementing Unity Catalog, RBAC, and access control policies aligned with security requirements.
  • Automate platform provisioning and deployments using Terraform, Python, SQL, and Databricks Asset Bundles.
  • Implement monitoring, logging, alerting, and capacity planning to ensure system observability and performance.
  • Perform Spark and SQL performance tuning and troubleshoot complex data processing issues.
  • Establish platform standards, reusable engineering patterns, and technical documentation for the organization.

What we're looking for

  • An MA/MS degree with 12 years of general experience and 10 years of specialized experience is required.
  • A BA/BS degree with 14 years of experience or a Doctorate with 11 years of experience may be substituted for the degree requirement.
  • Candidates must have 10+ years of related experience in data engineering, Databricks platform, and data ingestion.
  • Experience must include implementing and administering the Databricks Lakehouse Platform, including Unity Catalog and cluster management.
  • Proficiency in Python, Bash, and SQL is required for automation, testing, and platform scripting.
  • Candidates must have hands-on experience with CI/CD pipelines and Infrastructure as Code (IaC) tools like Terraform.
  • Experience operating Databricks in AWS-based or hybrid cloud environments is required.
  • Familiarity with containerized environments such as Docker and Kubernetes is required.

More like this

Similar roles

Senior Data Lakehouse Architect, Vice President

State Street

Quincy, MA 13 days ago $120,000$202,500
Databricks AWS Delta Lake Unity Catalog Apache Spark Python SQL S3 Glue EMR Lambda Redshift Terraform CI/CD RAG LLM GenAI MLflow Entra ID KMS
10+ yrs exp

Databricks Platform & Database Engineer

CoStar Group

Arlington, VA 42 days ago $136,000$177,000
Databricks AWS SQL Server PostgreSQL MySQL Aurora DynamoDB Terraform Python PySpark SQL CI/CD Unity Catalog Delta Lake S3 Looker PowerBI MLflow Kafka Snowflake
5+ yrs exp

Senior Staff Data Platform Engineer

Qualcomm

San Diego, CA +1 122 days ago $158,400$237,600
Databricks Unity Catalog Delta Lake MLflow AWS Amazon EKS Terraform Terramate Python SQL NoSQL CI/CD GitHub Actions Jenkins Bash Helm OpenTelemetry HashiCorp Vault OPA Sonar
7+ yrs exp

Lead Software Engineer

JPMorgan Chase

Wilmington, DE 65 days ago
Databricks Apache Spark Delta Lake Python Java SQL AWS Terraform Airflow Unity Catalog CI/CD Git ETL ELT Data Modeling Streamlit React Structured Streaming
5+ yrs exp

Lead Software Engineer

JPMorgan Chase

Plano, TX 8 days ago
Databricks Apache Spark Delta Lake Python Java SQL AWS Terraform Airflow Unity Catalog CI/CD Git ETL ELT Data Modeling Streamlit React
5+ yrs exp