Join BlackRock’s dynamic data engineering team as a Senior Data Engineer, where you will lead the creation and optimization of data pipeline architectures for large datasets. Your daily tasks include assembling complex data sets, identifying process improvements, and collaborating with cross-functional teams such as data scientists and platform engineers to ensure high-quality data delivery. You will work extensively with Python, Scala, Spark, Hadoop Suite, PySpark, Hive, Snowflake, and SQL, automating ingest processes and optimizing data pipelines for scalability. With a strong background in big data engineering and experience in cloud platforms like AWS and Azure, you will contribute to the development of next-generation products by staying updated on tech trends and recommending innovative solutions. This role demands expertise in data governance, metadata management, and lineage tools, as well as hands-on experience with Databricks and machine learning integrations.
Lead creation and maintenance of optimized data pipeline architectures on large datasets.
Assemble complex data sets that meet specific business requirements.
Identify, design, and implement internal process improvements for technology teams.
Work with stakeholders to resolve data-related technical issues and support infrastructure needs.
Automate manual ingest processes and optimize data delivery according to service level agreements.
Keep data segregated according to relevant policies and ensure compliance.
Develop tools and support major components of the data platform ecosystem cross-functionally.
What we're looking for
4+ years of hands-on experience in big data engineering and pipeline optimization.
Strong Python or Scala programming skills with expertise in PySpark and UDFs.
Experience developing on Spark in a production environment, including parallel execution and resource management.
Proficiency in Hive (on Spark), Yarn, Sqoop, and handling various file formats like ORC, PARQUET, AVRO.
Strong experience implementing solutions on Snowflake and using Transact SQL, No-SQL, and GraphQL.
Knowledge of data quality frameworks, CI/CD pipelines, and cloud deployment tools (AWS, Azure, Docker).
Market check
Salary context
This
$132,500–$162,000
range sits above
35%
of similar postings on FindRole.
Peer median band
$118,500–$220,000
Median floor and ceiling across peers.
Typical midpoint (25–75%)
$126,800–$211,200
Middle half of comparable postings.
Based on 240 comparable postings.*
* 240 is the maximum number of comparable postings sampled.
Employer
About Blackrock
BlackRock is the world''s largest asset management firm, providing investment management, risk management, and advisory services to institutional and retail clients through its Aladdin technology platform. Industry: Asset Management & Financial Services
Blackrock currently has
83 open roles
on FindRole.
Listed pay typically runs
$137,500–$180,000
across 83 roles with salary data.