This role pays more than
88%
of similar roles. Most pay
$184,613–$246,665
— the shaded band above.
At the midpoint, this role pays about
$267k
versus about
$216k
for comparable roles.
Based on 240 similar postings.
Employer
About Datadog
Datadog, Inc. is an American company that provides an observability service for cloud-scale applications, providing monitoring of servers, databases, tools, and services, through a SaaS-based data analytics platform.
Datadog currently has
131 open roles
on FindRole.
Listed pay typically runs
$187,000–$240,000
across 66 roles with salary data.
As a Staff Engineer on the ML Observability team at Datadog, you will lead the development of cutting-edge tools to monitor and improve AI systems in production, focusing on Large Language Models (LLMs) and generative AI. Your responsibilities include driving the design and implementation of observability features, prototyping new product capabilities, and working cross-functionally with engineering teams, product managers, UX designers, and applied scientists to rapidly iterate and find market fit. You will develop tools for tracing, evaluating, and debugging LLMs, influence architecture decisions, mentor engineers, and stay attuned to customer needs to guide priorities. The role requires a deep understanding of distributed systems, scalable backend architectures, and hands-on experience with LLM-powered applications. Additionally, you should be well-versed in model internals, inference pipelines, evaluation techniques, and prompt engineering, thrive in ambiguous environments, communicate effectively, and maintain a strong focus on clean code and innovation.