Databricks Engineer, Mid
At a glance
AI generatedTL;DR
As a mid-level Data Engineer on the Databricks platform at Booz Allen, you will support mission-critical data initiatives for defense and intelligence clients by designing and maintaining scalable data pipelines in cloud environments. You will build ELT or ETL pipelines using tools like Delta Live Tables (DLT) and PySpark, ensuring data quality through best practices such as incremental mergers and ACID transactions. Collaborating with cross-functional teams, you will implement medallion architecture for bronze, silver, and gold layers in cloud storage environments while documenting processes to ensure maintainability. The role requires experience with Databricks, SQL, Python, Spark fundamentals, and knowledge of data governance concepts like Unity Catalog. Ideal candidates also have familiarity with cloud platforms, orchestration tools, streaming data processing, and Git for version control.
Skills
What you'll do
- Build and optimize ELT or ETL pipelines using Databricks Notebooks, Delta Live Tables (DLT), and Workflows.
- Implement data ingestion, transformation, and quality processes with PySpark, Spark SQL, and Delta Lake best practices.
- Support data platform operations by monitoring pipeline performance and troubleshooting issues.
- Contribute to medallion architecture implementations in cloud storage environments like Azure ADLS or AWS S3.
- Document pipelines, data models, and processes for maintainability and knowledge transfer.
What we're looking for
- 2+ years experience in data engineering or software development.
- Proficiency in SQL, Python scripting, and data manipulation techniques.
- Understanding of distributed data processing concepts like Spark fundamentals.
- Experience with Databricks tools including notebooks, Delta Lake, and Workflows.
- Ability to collaborate effectively in a team environment.
- Bachelor’s degree in Computer Science, Engineering, or related field.
Employer
About Booz Allen Hamilton
Booz Allen Hamilton is a management and technology consulting firm that provides analytics, digital, engineering, and cybersecurity solutions primarily to U.S. government agencies and commercial clients. Industry: Management & Technology Consulting
Booz Allen Hamilton currently has 641 open roles on FindRole.
Listed pay typically runs $86,800–$198,000 across 628 roles with salary data.
Most-posted roles
- Data Scientist 33
- Data Engineer 24
- Data Scientist, Senior 18
- Software Engineer 16
- DevOps Engineer 13