GCP Lead Software Engineer
At a glance
AI generatedTL;DR
Wells Fargo is seeking a Lead Software Engineer to join its CTR team as a senior-level contributor, focusing on the design and optimization of scalable data platforms using Apache Spark and other cutting-edge technologies. This role involves leading the development and maintenance of ETL/ELT pipelines, automating workflows for data ingestion, transformation, and loading, while ensuring robust observability and performance monitoring. The engineer will integrate data from multiple sources into data lakes or warehouses, optimize storage strategies, and implement data quality checks and governance frameworks. Key requirements include extensive experience with Google Cloud Platform (GCP) tools such as Cloud Dataflow, BigQuery, and Cloud Composer, along with strong development skills in SQL and Python. Additional desired qualifications encompass proficiency with PySpark, Pandas, and Polars for data processing, and familiarity with interactive notebook environments like Jupyter or Databricks.
Skills
What you'll do
- Design and maintain ETL/ELT pipelines to automate data ingestion, transformation, and loading.
- Integrate diverse data sources into data lakes or warehouses with optimal storage strategies.
- Cleanse and normalize raw data for analytics, implementing robust data quality checks.
- Monitor and optimize data workflows for scalability and efficiency using GCP tools.
- Ensure robust observability and performance monitoring of data platforms.
What we're looking for
- 5+ years of experience building data pipelines on Google Cloud Platform (GCP)
- Strong proficiency in SQL and Python for data engineering tasks
- Experience with workflow orchestration using GCP-native tools like Cloud Composer
- Solid understanding of ETL/ELT processes and data governance best practices
- Expertise in monitoring and observability using GCP or equivalent tools
Employer
About Wells Fargo
Wells Fargo & Company is one of the largest banks in the United States, providing banking, investment, mortgage, and consumer and commercial finance products and services nationwide. Industry: Banking & Financial Services
Wells Fargo currently has 63 open roles on FindRole.
Listed pay typically runs $119,000–$224,000 across 31 roles with salary data.
Most-posted roles
- Lead Software Engineer 4
- Lead Systems Operations Engineer 3
- Lead Information Security Engineer 2
- Senior Systems Operations Engineer 2
- Application Penetration Testing Senior Manager 1