This listing doesn't post a salary. Most similar roles pay
$192,050–$212,050.
Based on 240 similar postings.
Employer
About JPMorgan Chase
JPMorgan Chase & Co. is a global financial services firm and one of the largest banks in the world, offering investment banking, commercial banking, asset management, and consumer financial services.
JPMorgan Chase currently has
1117 open roles
on FindRole.
Listed pay typically runs
$186,160–$215,000
across 7 roles with salary data.
Lead Software Engineer - Big Data joins the Corporate Sector - Infrastructure Platforms - Data and Specialty Services team to build and deliver secure, scalable technology products. This role involves designing, automating, and operating production-grade ETL and data transformation pipelines while managing large-scale data lake tables in Iceberg and Delta formats. The engineer will develop Spark-based batch and real-time workflows, contribute to platform infrastructure and SDKs, and mentor junior staff. Key technical requirements include proficiency in Python, Java, or Scala, along with experience in Apache Spark, Databricks, Spring Boot, and Docker. The role requires expertise in distributed data stores like HBase and Cassandra, cloud tools across AWS and Azure, and monitoring via Grafana and Prometheus. The position focuses on solving complex data transformation challenges, improving operational stability, and integrating AI-assisted engineering practices into the software development lifecycle.
Design, build, and optimize Spark-based batch and real-time ETL data transformation pipelines.
Manage large-scale data lake tables using Iceberg and Delta formats to ensure ACID compliance.
Implement and maintain monitoring systems using Grafana, Prometheus, and Elasticsearch to track system health.
Develop and deploy RESTful APIs using Spring Boot and Docker for data access and insights.
Automate recurring operational tasks and remediations to improve the stability of production systems.
Drive the adoption of AI-assisted engineering practices to improve code quality and delivery speed.
Mentor junior engineers and lead communities of practice regarding emerging technologies and best practices.
Evaluate external vendors and internal architectural designs to ensure alignment with firm objectives.
What we're looking for
Formal training or certification in software engineering concepts and 5+ years of applied experience.
Advanced proficiency in programming languages and frameworks including Python, Java, Scala, Apache Spark, Databricks, Grafana, Prometheus, Elasticsearch, Cloudwatch, Spring Boot API, and containers.
Experience implementing low-latency, scalable data operations using Apache HBase and Apache Cassandra.
Ability to build and design scalable ETL pipelines for structured/semi-structured data within Hadoop-based architectures.
Proficiency in managing large-scale data lake tables in Iceberg format and Delta table structures with Spark for batch and real-time ingestion.
Demonstrated experience leading the use of approved AI-assisted software development tools while ensuring security, performance, and validation standards.
Advanced understanding of agile methodologies, CI/CD, application resiliency, and security within the Software Development Life Cycle.
Experience in financial services, cloud-native environments, and managing infrastructure using Azure or AWS tools (preferred).
Java
Python
Scala
AWS
Apache Spark
Databricks
AI-assisted engineering
CI/CD
Agile
Big Data
Cloud Native
Data Visualization
Business Intelligence
System Design
Automated Testing