At a glance
AI generatedTL;DR
As a Senior Data Engineer in the Intelligent Manufacturing organization at General Motors, you will design and build industrialized data assets and pipelines to support Business Intelligence and Advanced Analytics objectives. Your role involves delivering scalable solutions that meet both functional and non-functional business requirements by working with databases, streaming technology, CI/CD processes, and cloud platforms like Azure. You will lead projects involving Python or Scala, SQL, and NoSQL databases, leveraging technologies such as Apache Spark on Databricks, Kubernetes, Kafka, and Azure services including Data Lake Storage and Event Hubs. Your responsibilities include optimizing data pipelines for scalability, designing new source system integrations, and collaborating with business and IT teams to develop real-time solutions that enhance plant asset maintenance, safety, and operational performance.
Skills
What you'll do
- Design and implement highly scalable data pipelines using Apache Spark and Delta Lake.
- Build and optimize complex data integrations from varied formats like files, databases, and APIs.
- Lead architectural discussions and contribute to the strategic adoption of new technologies.
- Develop and maintain cloud-native data platforms on Azure with services like Data Lake Storage and SQL.
- Monitor, troubleshoot, and optimize data pipelines and platform workloads for performance.
What we're looking for
- 7+ years of data engineering experience with Python or Scala and SQL.
- Proficiency in distributed data processing (Spark) and container orchestration (Kubernetes).
- Experience with cloud platforms, preferably Azure, including Data Lake Storage and Event Hubs.
- Solid understanding of CI/CD principles and tools for continuous deployment.
- Advanced knowledge of performance optimization techniques like partitioning and caching.
- Design and build scalable batch and streaming data pipelines using Databricks and Delta Lake.
- Monitor and troubleshoot data pipelines to optimize Spark jobs and SQL warehouses.
Employer
About General Motors (GM)
General Motors (GM) is a leading American multinational automotive corporation founded in 1908 and headquartered in Detroit, Michigan.
General Motors (GM) currently has 106 open roles on FindRole.
Listed pay typically runs $170,000–$261,300 across 59 roles with salary data.
Most-posted roles
- Senior AI/ML Engineer, AV Pipelines & Lineage 2
- AI/ML Staff Researcher 1
- Applied ML Validation Manager 1
- Controller Integration Engineer (VMEC) 1
- Controller Integration Manager 1