Data Engineer II, Getting Customers Ready for AI

Microsoft

Quick summary

Work type: On-site
Location: Redmond, WA
Salary: $102,100–$202,200 / yr
Posted: 5 days ago
Closes: Dec 19, 2026
Nearby: 99+ roles within 25 mi

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $170k

This role $152k

$89k most similar roles pay here $222k

This role pays less than 62% of similar roles. Most pay $130,412–$209,313 — the shaded band above. At the midpoint, this role pays about $152k versus about $170k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 694 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 636 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Data Engineer II, Getting Customers Ready for AI

Role Posting Log in to save

As a Data Engineer II on Microsoft Security's Getting Customers Ready for AI team, you will design and develop scalable data platforms and pipelines that transform raw security signals into high-quality datasets for analytics and AI-driven insights. Your day-to-day responsibilities include building ETL/ELT workflows, optimizing pipeline performance, and ensuring data quality through validation frameworks. You will work with distributed storage systems like Azure Data Lake Storage and Synapse to maintain scalability and cost efficiency while adhering to compliance requirements. Ideal candidates have experience in Python, Scala, or SQL for large-scale data processing, as well as familiarity with big data frameworks such as Spark and streaming systems like Kafka/Event Hub. This role offers opportunities to collaborate closely with AI engineers and contribute to the development of telemetry pipelines that provide insights into AI system performance and usage.

Skills

Python Azure Spark Kafka Databricks ADLS Synapse SQL Scala CI/CD Git Prometheus Grafana PostgreSQL Snowflake Hadoop Airflow Terraform

What you'll do

Design and build scalable data pipelines for processing large volumes of security and operational data.
Develop ETL/ELT workflows to transform raw telemetry into structured, consumable datasets for analytics.
Implement data ingestion frameworks to integrate multi-source data from services, APIs, and event streams.
Enable high-quality datasets for AI/ML teams by supporting feature pipelines and training data preparation.
Build telemetry pipelines and metrics systems to provide insights into AI system performance and usage.

What we're looking for

2+ years of experience in software, data, or related engineering with coding in languages like C, C++, Java, Python.
Hands-on experience building or maintaining scalable data pipelines and distributed data systems.
Proficiency in Python, Scala, or SQL for developing data processing and pipeline solutions.
Understanding of data modeling, ETL processes, and large-scale data processing concepts.
Experience with big data frameworks (e.g., Spark) and streaming systems (e.g., Kafka).
Familiarity with cloud-based data platforms such as Azure Data Lake Storage, Synapse Analytics, Databricks.

Save