Join our regulatory reporting data engineering team as a Scala - Spark Developer to assist in developing and enhancing Spark-based data pipelines on Databricks. You will implement business logic for regulatory reports under senior guidance, develop automation utilities with Python, and work extensively with Snowflake datasets. Responsibilities include supporting batch workflows using Autosys, writing BDD test cases, participating in code reviews, and providing basic production support. Ideal candidates have 3+ years of experience in software development or data engineering, strong Scala and Apache Spark knowledge, familiarity with cloud platforms like Snowflake, and understanding of database concepts. Additional skills such as Unix/Linux commands, shell scripting, and exposure to Generative AI are desired. This role offers hands-on learning with a modern tech stack and the chance to work on large-scale regulatory systems in a supportive environment.
Develop and enhance Spark-based data pipelines using Scala on Databricks.
Implement business logic for regulatory reporting under senior guidance.
Create automation utilities and operational controls with Python scripts.
Manage datasets in Snowflake, performing transformations and validations.
Set up and maintain batch workflows using Autosys scheduler.
Write and maintain BDD test cases and unit tests in Python.
Participate in code reviews and Agile ceremonies for project management.
What we're looking for
3+ years of experience in software development or data engineering
Strong knowledge of Scala and Apache Spark with ability to debug applications
Experience developing and maintaining Spark-based data pipelines on Databricks
Understanding of cloud data platforms, preferably Snowflake
Proficiency in Python for scripting, automation, and testing
Exposure to BDD frameworks and unit test writing
Familiarity with Unix/Linux commands and shell scripting
Market check
Salary context
This
$90,000–$150,000
range sits above
14%
of similar postings on FindRole.
Peer median band
$117,000–$198,000
Median floor and ceiling across peers.
Typical midpoint (25–75%)
$134,000–$196,187
Middle half of comparable postings.
Based on 240 comparable postings.*
* 240 is the maximum number of comparable postings sampled.
Employer
About Morgan Stanley
Morgan Stanley is a global financial services firm providing investment banking, securities, wealth management, and investment management services to corporations, governments, institutions, and individuals. Industry: Investment Banking & Financial Services
Morgan Stanley currently has
35 open roles
on FindRole.
Listed pay typically runs
$139,500–$165,000
across 34 roles with salary data.