Senior Databricks Data Engineer, Vice President

State Street

Confirmed live 2 days ago High trust
Hybrid

Quick summary

Work type
Hybrid
Location
Quincy, MAPrinceton, NJ
Salary
$120,000–$202,500 / yr
Posted
21 days ago
Freshness
Confirmed live 2 days ago
Nearby
99+ roles within 25 mi

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $189k
This role $161k
$107k most similar roles pay here $238k

This role pays less than 68% of similar roles. Most pay $154,200–$223,750 — the shaded band above. At the midpoint, this role pays about $161k versus about $189k for comparable roles.

Based on 240 similar postings.

Employer

About State Street

State Street Corporation is one of the world''s largest custodian banks and asset managers, providing investment servicing, investment management, and investment research to institutional investors. Industry: Financial Services & Asset Custody

State Street currently has 176 open roles on FindRole.

Listed pay typically runs $120,000–$202,500 across 172 roles with salary data.

Most-posted roles

View all roles at State Street

At a glance

TL;DR · Senior Databricks Data Engineer, Vice President

Role Posting Log in to save

As a Sr. Databricks Data Engineer, Vice President, you will join an agile scrum team to develop challenging new products within the financial space using cutting-edge technology. You will be responsible for the full software development lifecycle, including designing, building, and testing end-to-end data pipelines for streaming, events, and batch ingestion on cloud-based infrastructure. Your daily work involves developing ETL processes, creating high-throughput frameworks, and managing data warehousing tasks. The role requires proficiency in Databricks, Delta Lake, Apache Spark, Scala, and Databricks SQL. You will also utilize Azure, Cosmos DB, Git, and DevOps tools like ADO and Harness to manage semi-structured data formats such as Avro, JSON, and XML. Additionally, you will monitor pipelines, perform data exploration, and troubleshoot infrastructure involving Kubernetes and Docker to ensure high data quality and accuracy.

Skills

Databricks Azure Spark Delta Lake SQL Scala Cosmos DB Snowflake Docker Kubernetes Git Azure DevOps Harness Avro JSON XML Shell Scripting Unix

What you'll do

  • Design, build, and test end-to-end data pipelines for streaming, events, and batch processing on Azure infrastructure.
  • Develop and implement ETL processes to ingest, transform, and load data into data lakes.
  • Build custom high-throughput and configurable frameworks and libraries using Databricks and Spark.
  • Manage all aspects of the software development lifecycle including coding, integration testing, deployment, and documentation.
  • Monitor and troubleshoot data pipelines to identify and resolve technical issues.
  • Implement data quality checks and validations to ensure accuracy across all datasets.
  • Troubleshoot DevOps pipelines using tools such as Azure DevOps and Harness.
  • Handle semi-structured data formats including Avro, JSON, and XML.

What we're looking for

  • Bachelor's degree in a computer or IT related subject.
  • 10+ years of overall Big Data data pipeline experience.
  • 5+ years of hands-on Databricks experience.
  • 5+ years of experience in cloud-based development including Azure Services, Azure DevOps, Kubernetes, and Docker.
  • Proficiency in Databricks SQL, Scala, Delta Lake, and Apache Spark.
  • Experience with micro-services architecture and Cloud Computing (Azure preferred).
  • Experience with Snowflake (preferred).
  • Experience working in the financial industry.

Related searches

More Sr. Databricks Data Engineer jobs Sr. Databricks Data Engineer jobs in Quincy All jobs at State Street

More like this

Similar roles

Senior Databricks / Snowflake Data Architect

State Street

Clifton, NJ 3 days ago $125,000–$226,250
Databricks Snowflake Apache Spark Python SQL AWS Delta Lake Unity Catalog Kafka CI/CD Infrastructure-as-Code Data Vault ETL ELT MLOps S3 EMR Glue Lambda DuckDB ClickHouse Redshift BigQuery KDB+ Apache Iceberg
Save

Senior Databricks Platform Engineer

General Dynamics

Remote 6 days ago $169,604–$229,464
Databricks Unity Catalog Apache Spark Delta Lake Python SQL Terraform CI/CD Docker Kubernetes AWS Bash Grafana Prometheus Datadog CloudWatch Elastic ETL ELT
10+ yrs exp Remote
Save

Senior Data Lakehouse Architect, Vice President

State Street

Quincy, MA 13 days ago $120,000–$202,500
Databricks AWS Delta Lake Unity Catalog Apache Spark Python SQL S3 Glue EMR Lambda Redshift Terraform CI/CD RAG LLM GenAI MLflow Entra ID KMS
10+ yrs exp
Save

Principal Software Engineer

JPMorgan Chase

Jersey City, NJ 14 days ago
Python AWS Terraform Databricks Agentic AI Machine Learning SDLC Data Lake Data Warehouse Lakehouse Distributed Computing Data Governance Schema Governance
10+ yrs exp
Save

Databricks Platform & Database Engineer

CoStar Group

Arlington, VA 42 days ago $136,000–$177,000
Databricks AWS SQL Server PostgreSQL MySQL Aurora DynamoDB Terraform Python PySpark SQL CI/CD Unity Catalog Delta Lake S3 Looker PowerBI MLflow Kafka Snowflake
5+ yrs exp
Save