Software Engineer, Data Systems

What you'll do

• Develop and construct the store, data model, and query path for engineering performance data.
• Ingest, join, store, and deliver large-scale profiling and telemetry data with low latency.
• Join profiling data with system context from hosts, schedulers, configurations, logs, and storage.
• Establish and version data contracts with producing teams to ensure seamless transitions for consumers.
• Manage trade-offs between data quality, query latency, storage costs, and data retention.
• Handle delayed, duplicated, or inconsistent data while making limitations visible to downstream users.
• Develop data APIs and evidence views for manual and automated analysis.
• Implement access controls and resource limits to maintain stability during high demand or failures.

What we're looking for

• Bachelor’s degree in Computer Science, Computer Engineering, or a related field, or equivalent experience.
• 12+ years of relevant software engineering experience, including delivery and operation of data pipelines, storage systems, or analytical services.
• Experience handling large-scale data in production, including billions of events per day or petabyte-class stores.
• Experience with low-latency streaming pipelines that manage backpressure, replay, and accurate duplicate delivery.
• Proficiency with C++, Python, and SQL.
• Experience establishing and versioning data contracts with producing teams and guiding consumers through format changes.
• Ability to debug across component boundaries and validate changes through code review, tests, and independent measurements.
• Hands-on work with telemetry, time-series data, analytical query engines like ClickHouse, or columnar formats like Arrow and Parquet (preferred).