Senior Data Engineer

Marathon Petroleum

Actively hiring Posted this week
San Antonio, TX · Findlay, OH Posted 5 days ago

At a glance

AI generated

TL;DR

As a Senior Data Engineer at MPC, you will join a dynamic team dedicated to building scalable data pipelines and cloud-based solutions using Azure services such as Data Lake, Synapse Analytics, Databricks, and Functions. Your responsibilities include designing complex data architectures for high-volume datasets, ensuring robust data security and privacy measures, and collaborating with various teams to translate requirements into efficient data solutions. You will leverage Python, SQL, Spark, and orchestration tools like Azure Data Factory and Databricks Workflows to innovate and optimize data processes daily. This role requires expertise in big data technologies, cloud platforms, data governance, integration, modeling, pipelines, privacy, quality management, security, warehousing, DevOps, metadata management, NoSQL databases, and real-time processing. With a focus on the energy industry, you will contribute to engineering standards and mentor junior engineers while driving continuous improvements in data infrastructure.

Skills

Azure Python SQL Spark Azure Data Factory Databricks Workflows Hadoop Data Lake Synapse Analytics Azure Functions Databricks CI/CD ETL DevOps Metadata Management NoSQL Databases Real Time Processing Data Governance Data Security Data Privacy

What you'll do

  • Designs and optimizes scalable data pipelines using Azure Data Lake and Synapse Analytics.
  • Develops complex data architecture to process high-volume datasets efficiently.
  • Implements data security measures and ensures compliance with privacy regulations.
  • Conducts data quality tasks and resolves complex data processing issues.
  • Mentors less experienced engineers and contributes to engineering standards.

What we're looking for

  • 5+ years of data engineering experience with cloud platforms like Azure.
  • Strong proficiency in Python, SQL, Spark, and orchestration tools such as Azure Data Factory.
  • Expertise in designing and optimizing scalable data pipelines and cloud-based solutions.
  • Experience in mentoring junior engineers and contributing to engineering standards.
  • Knowledge of big data technologies, including Hadoop, Spark, and distributed computing.

Employer

About Marathon Petroleum

Marathon Petroleum Corporation is one of the largest petroleum refining, marketing, retail, and transportation companies in the United States, operating an extensive refining network and Speedway convenience stores. Industry: Oil Refining & Energy

Marathon Petroleum currently has 10 open roles on FindRole.

Most-posted roles

View all roles at Marathon Petroleum