Data Engineer

IBM

Confirmed live today High trust

Quick summary

Work type
On-site
Location
ParamusResearch Triangle ParkDenver, COCharlotte, NCBoston, MAAtlanta, GAMinneapolis, MNDallas, TXHouston, TXAustin, TXChicago, ILNew York, NY
Posted
2 days ago
Freshness
Confirmed live today

Market check

Salary context

How this pay compares to similar roles

Similar $164k
$116k $211k
below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $126,800–$202,200.

Based on 240 similar postings.

Employer

About IBM

IBM is a US-based global technology company providing hybrid cloud, AI, consulting, enterprise software, and IT infrastructure products and services.

IBM currently has 246 open roles on FindRole.

Listed pay typically runs $180,812–$215,000 across 9 roles with salary data.

Most-posted roles

View all roles at IBM

At a glance

TL;DR · Data Engineer

As a Data Engineer within IBM Consulting, you will be embedded with client teams to design and deliver hands-on data solutions on the AWS and Databricks platforms. You will be responsible for re-engineering legacy data workloads, migrating Tier-1 applications from MySQL to Databricks Lakebase, and building end-to-end data pipelines. Your daily work involves integrating SAP data through SAP BTP and BDC Connect, developing prototypes, and establishing engineering standards for CI/CD, testing, and observability. You will utilize a technical stack including Spark, Delta Lake, MLflow, Unity Catalog, SQL, Python, Fivetran, Kafka, Amazon EventBridge, and Terraform. This role solves complex data migration and architecture problems, creating scalable, cloud-native data products and supporting AI use cases across AWS and GCP environments.

What does a Data Engineer earn?

Median $165150 from 205 postings across 62 companies.

See salary data

What you'll do

  • Design and build data pipelines and integrations using Fivetran, Databricks, and AWS services.
  • Lead the migration of Tier-1 applications from MySQL to Databricks Lakebase, including schema re-design and validation.
  • Integrate SAP data through SAP BTP and BDC Connect with non-SAP data sources.
  • Build prototypes and reference implementations and harden them for production use.
  • Support data and AI use cases, including integration with GCP-based ML and GenAI components.
  • Establish engineering standards for CI/CD, testing, observability, security, and cost control.
  • Manage and maintain large data repositories to ensure scalability and performance.
  • Design end-to-end data solutions across multiple platforms to meet specific client business objectives.

What we're looking for

  • Must possess a Bachelor's Degree.
  • Must be able to travel 4 days per week.
  • Must hold a Databricks Certified Data Engineer or Machine Learning Professional certification.
  • Must have advanced hands-on expertise in data engineering and solution architecture to design and deliver complex data solutions.
  • Must have strong hands-on expertise with Databricks (Spark, Delta Lake, MLflow, Unity Catalog), AWS, SQL, and Python.
  • Must have experience with relational databases like MySQL, database migration, Fivetran, and modern data-sharing patterns.
  • Must have experience with Delta Lake, Apache Iceberg, and open table formats including schema evolution and optimization.
  • Must have hands-on experience designing scalable data platforms using Kafka, Amazon EventBridge, Amazon SQS, Terraform, and CI/CD.
  • Experience with Databricks Lakebase or similar managed PostgreSQL/OLTP-on-lakehouse technologies (preferred).
  • Knowledge of SAP BTP, BDC Connect, SAP extraction patterns, or SAP IS-U (preferred).
  • Exposure to GCP ML/GenAI services and cloud-native solution design across AWS and GCP (preferred).
  • Experience with Git-based version control and branching strategies for data workloads (preferred).
  • Experience in the utilities or energy industry with relevant Databricks and/or AWS certification (preferred).

More like this

Similar roles

Data Engineer

IBM

78 days ago
SQL PostgreSQL Presto Python pandas Apache Airflow Apache Kafka IBM Event Streams ETL ELT IBM watsonx.data Apache Spark Git Data Modeling

Data Engineer

IBM

Paramus +11 2 days ago
Databricks AWS Python SQL Spark Delta Lake MLflow Unity Catalog Fivetran MySQL PostgreSQL Apache Iceberg Kafka Amazon EventBridge Amazon SQS Terraform CI/CD SAP BTP GCP Git

Data Products Designer

IBM

Paramus +11 2 days ago
Databricks AWS SQL Data Modeling Delta Lake Unity Catalog Kafka Amazon EventBridge Amazon SQS Fivetran SAP Erwin ER Studio Collibra Agile NLP Big Data GenAI

Databricks Solution Architect

IBM

Paramus, NJ +11 2 days ago
Databricks AWS GCP Microsoft Azure PySpark Scala Spark SQL Delta Lake MLflow Unity Catalog Apache Iceberg Kafka Amazon EventBridge SQS Fivetran SAP BTP MySQL CI/CD RAG MLOps LLMOps APIs Microservices

Data Engineer

Citi

Jersey City, NJ +3 149 days ago $142,320–$213,480
AWS Glue AWS Athena Airflow Snowflake Python PySpark MongoDB Oracle PostgreSQL AbInitio Unix Shell Scripting ETL Data Warehouse BigData Systems Analysis Project Management
5+ yrs exp Hybrid

Data Engineer

Booz Allen Hamilton

Fort Meade, MD 59 days ago
Data Engineering ETL AWS Azure AI/ML Data Pipelines Data Governance Data Normalization Dashboards Metrics Exploratory Analysis Feature Development IoT Machine Learning
4+ yrs exp