Senior Databricks Data Engineer, Vice President

State Street

Confirmed live today High trust
Hybrid

Quick summary

Work type
Hybrid
Location
Quincy, MAPrinceton, NJ
Employment
Full-time
Posted
66 days ago
Freshness
Confirmed live today

Market check

Salary context

How this pay compares to similar roles

Similar $176k
$119k $231k
below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $131,962–$220,000.

Based on 240 similar postings.

Employer

About State Street

State Street Corporation is one of the world''s largest custodian banks and asset managers, providing investment servicing, investment management, and investment research to institutional investors. Industry: Financial Services & Asset Custody

State Street currently has 351 open roles on FindRole.

Listed pay typically runs $115,000–$195,944 across 199 roles with salary data.

Most-posted roles

View all roles at State Street

At a glance

TL;DR · Senior Databricks Data Engineer, Vice President

The Sr. Databricks Data Engineer, Vice President joins a strong development team to build challenging new products within the financial space. This hands-on role involves designing, building, and testing end-to-end data pipelines for streaming, events, and batch ingestion on cloud-based infrastructure. You will develop ETL processes for data lakes, create custom high-throughput frameworks, and manage the full software development lifecycle within an agile scrum team. Key technical requirements include proficiency in Databricks, Delta Lake, Apache Spark, Scala, and Databricks SQL. You will utilize Azure, Cosmos DB, Kubernetes, and Docker while troubleshooting DevOps pipelines using ADO and Harness. The role requires handling semi-structured data like Avro, JSON, and XML, while ensuring data quality and accuracy through rigorous monitoring and validation.

What you'll do

  • Design, build, and test end-to-end data pipelines for streaming, events, and batch data on Azure.
  • Develop and implement ETL processes to transform and load data into data lakes.
  • Build custom high-throughput and configurable frameworks and libraries.
  • Manage the full software development lifecycle including coding, integration testing, deployment, and documentation.
  • Monitor and troubleshoot data pipelines to identify and resolve technical issues.
  • Implement data quality checks and validations to ensure overall data accuracy.
  • Troubleshoot DevOps pipelines using tools like ADO and Harness.
  • Perform data analysis and exploration on semi-structured data formats like Avro, JSON, and XML.

What we're looking for

  • Bachelor’s Degree level qualification in a computer or IT related subject.
  • 10+ years of overall Bigdata data pipeline experience.
  • 5+ years of Databricks hands-on experience.
  • 5+ years of experience on cloud-based development including Azure Services, Azure Devops, Kubernetes, and Docker.
  • Proficient working knowledge of Data Warehousing platforms as Databricks, Delta lake, and Apache Spark.
  • Hands-on development experience in Databricks SQL and Scala.
  • Experience in micro-services architecture and understanding of Cloud Computing (Azure preferred).
  • Experience on Snowflake (preferred).

More like this

Similar roles

Senior Data Engineer, Vice President

State Street

Boston, MA 37 days ago $110,000–$207,500
Databricks AWS Azure Python Java J2EE Scala PL/SQL Data Modeling ELT CICD DevOps big-data Cloud Security Data Engineering Scripting
10+ yrs exp

Databricks Data Engineer, Lead

Booz Allen Hamilton

Bethesda, MD +1 12 days ago $77,600–$176,000
Databricks Python PySpark AWS Delta Lake Unity Catalog ETL Data Modeling Amazon S3 AWS Glue Amazon RDS AWS Lambda CloudWatch Collibra Medallion Architecture Data Governance
8+ yrs exp

VP, Software Engineering & Development

State Street

Quincy, MA +1 44 days ago
Azure Snowflake Databricks SQL Scala Java ETL ELT Data Warehousing Azure Synapse Analytics Azure Data Factory Azure SQL Database Data Lake Delta Lake Kubernetes Docker Git SVN Agile Teradata SQLServer Oracle
10+ yrs exp Hybrid

Senior Data Engineering Lead

State Street

Quincy, MA +3 40 days ago
Azure Databricks SQL Scala Java Snowflake Azure Synapse Analytics Azure Data Factory Azure SQL Database Delta Lake ETL ELT Data Modeling Git Kubernetes Docker Azure DevOps Oracle SQLServer Bigdata Agile
10+ yrs exp Hybrid

VP, Software Engineering & Development

State Street

Quincy, MA +1 33 days ago
Snowflake Databricks Azure SQL Scala Java Azure Data Factory Azure SQL Database Synapse Delta Lake ETL ELT Data Modeling Git SVN Kubernetes Docker Teradata Oracle SQL Server Agile
10+ yrs exp Hybrid

Senior Databricks Platform Engineer

General Dynamics

Remote (Washington, DC) 51 days ago $169,604–$229,464
Databricks Unity Catalog Apache Spark Delta Lake Python SQL Terraform Delta Live Tables Databricks Lakeflow CI/CD Docker Kubernetes AWS Prometheus Grafana Datadog CloudWatch Elastic Bash IAM
10+ yrs exp Remote