Staff Software Engineer, Tech Foundations

What you'll do

• Lead the design and delivery of distributed systems handling tens of millions of events per second.
• Scale the metrics pipeline while controlling costs through aggregation, sampling, and blocking unused metrics.
• Replace legacy log aggregation with an OpenTelemetry-based pipeline and evolve storage on OpenSearch.
• Build a fast, reliable query layer with rate limiting and isolation for engineers and AI agents.
• Provide teams with self-service visibility and control over telemetry costs, granularity, and retention.
• Improve time to detect through anomaly detection and automated correlation across signals.
• Write well-tested, maintainable code and contribute back to relevant open-source projects.
• Mentor engineers on design reviews, operational readiness, and on-call procedures.

What we're looking for

• 9+ years of industry experience building and operating large-scale distributed systems in production.
• Proven track record of leading the technical direction of a system or multi-team project from design through operation.
• Deep experience in at least one telemetry domain at scale, such as metrics, logs, or distributed tracing.
• Strong coding skills in Go or Java/Kotlin, including the ability to work in unfamiliar codebases and upstream open source.
• Experience with cloud-native infrastructure, specifically Kubernetes, AWS, and service mesh technologies like Istio or Envoy.
• Clear written and verbal communication skills for creating design docs and tradeoff analyses for engineering leadership.
• Contributions to OpenTelemetry, Prometheus, Grafana Mimir, VictoriaMetrics, OpenSearch, or Jaeger (preferred).
• Experience with time series storage internals, high-cardinality data, anomaly detection, or building tools for AI agents (preferred).