Senior Software Engineer, Bits AI SRE

Datadog

Hybrid

Quick summary

Work type: Hybrid
Location: —
Salary: $187,000–$240,000 / yr
Posted: 25 days ago

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $193k

This role $214k

$130k most similar roles pay here $252k

This role pays more than 68% of similar roles. Most pay $165,819–$221,000 — the shaded band above. At the midpoint, this role pays about $214k versus about $193k for comparable roles.

Based on 240 similar postings.

Employer

About Datadog

Datadog, Inc. is an American company that provides an observability service for cloud-scale applications, providing monitoring of servers, databases, tools, and services, through a SaaS-based data analytics platform.

Datadog currently has 130 open roles on FindRole.

Listed pay typically runs $187,000–$240,000 across 65 roles with salary data.

Most-posted roles

View all roles at Datadog

At a glance

TL;DR · Senior Software Engineer, Bits AI SRE

Role Posting Log in to save

Join our dynamic team as a senior product-minded engineer to develop AI-assisted product experiences that streamline investigation and resolution for Datadog customers. You will collaborate with cross-functional teams to build conversational workflows, guided remediations, and codefixes using Go or similar languages, alongside LLM-based systems. Your day-to-day involves rapid prototyping, testing, and iterating on backend infrastructure and AI prompts to ensure reliable, production-ready features. With a focus on applied AI product development, you will integrate model behavior into user-facing products and work closely with partner teams to expand remediation capabilities. Ideal candidates have at least five years of experience in building production systems, expertise in prompt engineering, and a passion for improving software engineering practices through AI.

Skills

Go LLM-based systems Prompt engineering Kubernetes Python PostgreSQL CI/CD Docker Git Swagger/OpenAPI Cloud services (AWS/GCP/Azure) Terraform Prometheus Grafana CI/CD pipelines DevOps methodologies

What you'll do

Develop customer-facing AI systems for chat, remediations, and codefixes to resolve production issues.
Build reliable backend infrastructure connecting AI outputs to operational actions and remediation capabilities.
Prototype and iterate rapidly on new product features based on applied AI workflows.
Enhance prompt engineering and evaluation loops to improve the reliability of AI-powered systems.
Collaborate with cross-functional teams to integrate AI features into user-facing products.

What we're looking for

At least 5 years of professional backend engineering experience with strong product mindset.
Expertise in building production systems using Go or similar languages and working with LLM-based systems.
Experience in prompt engineering, evaluation, iteration for LLM-powered systems to improve quality through experimentation.
Strong fundamentals in engineering to build reliable user-facing products integrating AI features.
Comfortable operating in a fast-moving environment with high ambiguity, prototyping new ideas quickly.
Ability to collaborate effectively across product, design, and engineering teams to shape both UX and technical implementation.

Similar roles

ML Engineer

Microsoft

82 days ago $100,600–$199,000

GenerativeAI MultimodalSystems MLOps Azure PromptEngineering RAG MemoryFrameworks CI/CD Python Java C++ SQL PostgreSQL Docker Kubernetes Terraform AWS Git Jenkins GitHub Swagger/OpenAPI RESTfulAPIs JSON YAML Prometheus Grafana Kafka Redis Elasticsearch GraphQL

Hybrid

Save

Senior Software Engineer

Broadcom

Burlington, MA 117 days ago $108,000–$172,800

Java Kubernetes GitHub Maven Jenkins Docker CI/CD Git Linux Python PostgreSQL VMware vSphere vSAN NSX Terraform AWS Azure

Save

Senior Software Engineer

Prudential Financial

Newark, NJ 121 days ago $104,000–$171,600

React Springboot Docker Terraform AWS Kubernetes DevOps CI/CD GitHub Jenkins Python Java Node.js HTML CSS JavaScript DynamoDB ECS Lambda RDS S3 Observability Metric Logs Tracing Agile Methodology

Hybrid

Save

Senior Software Engineer

Microsoft

Redmond, WA 16 days ago $119,800–$234,700

C# TypeScript Python Azure RESTful APIs OAuth Entra ID Docker Kubernetes CI/CD Prometheus Grafana PostgreSQL Redis GraphQL

Save

Senior Software Engineer

The Walt Disney Company

Remote 51 days ago $148,700–$199,400

Java AWS DynamoDB SQS RDS Kinesis SQL NoSQL CI/CD Python PostgreSQL Kubernetes Terraform Git Docker Prometheus Grafana

Remote

Save

Senior Software Engineer

Blackline

Pleasanton, CA 37 days ago

Python Java .NET .NET Core PostgreSQL SQL Docker Kubernetes Azure AWS GCP RESTful APIs Scrum Agile API gateway identity management authentication messaging platforms RabbitMQ workflow orchestration job scheduling search NoSQL

Hybrid

Save