Lead Software Engineer, Java

What you'll do

• Design, build, and optimize robust ETL data pipelines using Databricks and Spark.
• Architect and implement data lake and warehouse solutions using AWS services like S3, Glue, and Lambda.
• Lead and mentor a team of engineers by providing technical guidance and performing code reviews.
• Automate the remediation of recurring issues to improve the operational stability of software systems.
• Monitor, troubleshoot, and tune data pipelines and cloud resources for performance and cost efficiency.
• Implement observability standards to promote reusability and operational simplicity across data pipelines.
• Develop solutions to improve platform orchestration, developer experience, and system resiliency.

What we're looking for

• Formal training or certification on software engineering concepts and 5+ years of applied experience.
• 5+ years of professional experience in one or more programming languages, including Java or Python for data engineering tasks.
• Hands-on experience with Databricks (Spark, Delta Lake) and AWS data services such as EMR, Athena, Glue, and S3.
• Experience utilizing Apache Spark for large-scale data processing, real-time/batch analytics, and machine learning.
• Proficiency in the Software Development Life Cycle, including CI/CD, DevOps, and infrastructure-as-code tools.
• Proven leadership experience in leading and mentoring software engineers.
• Experience with modern monitoring and logging tools like Dynatrace, Splunk, Grafana, or Prometheus.
• Experience leveraging AI tools for developer productivity (preferred); familiarity with SpringBoot, Kubernetes, Docker, Kafka, and financial products (preferred).