As a Data Engineering IC2 on our cutting-edge team, you will design and build distributed systems that process petabytes of data to power AI models used by millions. Your day-to-day involves modernizing the data stack from batch-heavy patterns to event-driven architectures using Spark/Databricks, engineering high-throughput telemetry systems for user interaction data, and defining storage, compute, and networking resources with IaC tools like Bicep/Terraform. You will also optimize query execution plans and cluster performance to ensure cost-efficiency while maintaining speed. Ideal candidates have a deep understanding of massive-scale compute engines, experience in building internal developer platforms, and proficiency in streaming technologies such as Kafka and Azure EventHubs. This role requires expertise in container orchestration with Kubernetes and enabling AI/ML workloads through feature stores and vector databases.
Designs and builds frameworks using Spark/Databricks to process massive datasets efficiently.
Modernizes data stack by shifting from batch-heavy patterns to event-driven architectures for AI inference.
Engineers high-throughput telemetry systems to capture user interactions with Copilot for Reinforcement Learning.
Defines and deploys all storage, compute, and networking resources using IaC tools like Bicep/Terraform.
Builds automated governance and observability systems to detect anomalies in the data mesh proactively.
Optimizes query execution plans and cluster performance to ensure cost-efficiency and speed of the platform.
What we're looking for
Bachelor's or Master's degree in Computer Science, Math, Software Engineering, or related field.
Proven experience with massive-scale compute engines like Apache Spark and Flink.
Experience in building internal developer platforms or Data-as-a-Service APIs.
Proficiency in streaming technologies such as Kafka and Azure EventHubs.
Reliable experience with Kubernetes for deploying data applications.
Demonstrated ability to enable AI/ML workloads including Feature Stores.
Market check
Salary context
This
$85,400–$168,100
range sits above
4%
of similar postings on FindRole.
Peer median band
$139,900–$260,000
Median floor and ceiling across peers.
Typical midpoint (25–75%)
$177,250–$214,500
Middle half of comparable postings.
Based on 240 comparable postings.*
* 240 is the maximum number of comparable postings sampled.
Employer
About Microsoft
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has
451 open roles
on FindRole.
Listed pay typically runs
$119,800–$234,700
across 417 roles with salary data.