Senior Data Platform Engineer

IBM

Confirmed live yesterday Trusted

Quick summary

Work type: On-site
Location: —
Posted: 22 days ago
Freshness: Confirmed live yesterday

Market check

Salary context

How this pay compares to similar roles

Similar $182k

$109k $224k

below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $150,325–$213,200.

Based on 240 similar postings.

Employer

About IBM

IBM is a US-based global technology company providing hybrid cloud, AI, consulting, enterprise software, and IT infrastructure products and services.

IBM currently has 265 open roles on FindRole.

Listed pay typically runs $180,812–$217,000 across 11 roles with salary data.

Most-posted roles

View all roles at IBM

At a glance

TL;DR · Senior Data Platform Engineer

Role Posting Log in to save

As a Senior Data Platform Engineer within IBM Consulting, you will join a team dedicated to helping clients shape their hybrid cloud and AI journeys. You will design, build, and maintain scalable data engineering solutions on Google's Cloud ecosystem, specifically focusing on batch and real-time data pipelines for Data Warehouses and Datalakes. Your daily work involves developing solutions using Google Cloud services like DataProc, DataFlow, PubSub, BigQuery, Big Table, Cloud Spanner, CloudSQL, and AlloyDB. You will utilize open-source technologies including Apache Beam, Airflow, dbt, Spark, Python, and Scala to optimize data layers and manage platform operations via Cloud Scheduler and Cloud Composer. This role solves complex data migration and processing problems to ensure efficient, scalable data flow for diverse business needs.

Skills

BigQuery DataFlow DataProc PubSub BigTable Apache Beam Apache Airflow Spark Python Scala dbt Cloud Spanner CloudSQL AlloyDB Hadoop Cloud Composer Google Cloud Storage Data Warehouse Datalake

What you'll do

Design and develop batch and real-time data pipelines for Data Warehouses and Datalakes.
Build and maintain data engineering solutions using Google Cloud Storage, BigQuery, and BigTable.
Implement data processing using DataProc with Spark/Hadoop and DataFlow with Apache Beam or Python.
Schedule and manage data platform operations using Google Cloud Scheduler and Cloud Composer.
Optimize the data layer for efficient data migration and high-performance processing.
Ensure the scalability and efficiency of all data pipelines to meet business requirements.
Integrate open-source technologies like dbt, Airflow, and Spark into the Google Cloud ecosystem.

What we're looking for

Proven experience designing, building, and maintaining data engineering solutions on Google's Cloud ecosystem.
Expertise in Google Cloud services including DataProc, DataFlow, PubSub, BigQuery, Big Table, Cloud Spanner, CloudSQL, and AlloyDB.
Experience developing batch and real-time data pipelines for Data Warehouse and Datalake.
Proficiency in open-source technologies including Apache Beam, Apache Airflow, dbt, Spark/Python, or Spark/Scala.
Experience scheduling and managing data platforms using Google Cloud Scheduler and Cloud Composer.
Experience designing and optimizing data layers for efficient data migration and processing.
Advanced Apache Beam knowledge, dbt and data modeling familiarity, and Spark and Scala expertise (preferred).
Bachelor's Degree.

10+ yrs exp Hybrid

Save

Software Engineer

The Coca‑Cola Company

Atlanta, GA 12 days ago $107,000–$125,700

Python SQL Azure Databricks Synapse dbt Airflow Java Scala Snowflake BigQuery Redshift ADLS Azure Data Factory Microsoft Fabric CI/CD Git Spark Apache Maven Dimensional Modeling Data Warehousing Lakehouse Architecture Infrastructure as Code GitHub Actions

3+ yrs exp

Save