Product Solutions Architect - LLM Observability | Datadog Careers

Datadog

Hybrid

Quick summary

Work type
Hybrid
Location
New York, NY
Salary
$151,500–$222,000 / yr
Posted
15 days ago
Nearby
99+ roles within 25 mi

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $196k
This role $187k
$142k most similar roles pay here $243k

This role pays less than 52% of similar roles. Most pay $165,800–$226,600 — the shaded band above. At the midpoint, this role pays about $187k versus about $196k for comparable roles.

Based on 240 similar postings.

Employer

About Datadog

Datadog, Inc. is an American company that provides an observability service for cloud-scale applications, providing monitoring of servers, databases, tools, and services, through a SaaS-based data analytics platform.

Datadog currently has 109 open roles on FindRole.

Listed pay typically runs $187,000–$240,000 across 58 roles with salary data.

Most-posted roles

View all roles at Datadog

At a glance

TL;DR · Product Solutions Architect - LLM Observability | Datadog Careers

Apply Now Log in to save

As a Product Solutions Architect (PSA) at Datadog’s LLM Observability team, you will serve as the technical expert for customers and internal teams, providing hands-on guidance on designing architectures and implementing best practices for large-scale LLM-powered applications. Your daily tasks include creating detailed technical collateral such as reference architectures and documentation to support Field teams, building proofs of concept, and delivering actionable feedback to Product Management based on real-world customer insights. This role requires a strong foundation in software engineering with hands-on experience in production environments, familiarity with distributed systems and core observability concepts, and proficiency in languages like Python or JavaScript/TypeScript. You will work in a rapidly evolving domain, translating technical patterns into the emerging field of LLM observability, ensuring scalable solutions for complex customer use cases.

Skills

LLM Observability Python JavaScript TypeScript Distributed Systems Tracing Metrics Logging Datadog SRE DevOps CI/CD

What you'll do

  • Serve as the in-house expert for Datadog’s LLM Observability product.
  • Provide technical and architectural guidance to enterprise customers adopting LLM Observability.
  • Create high-impact technical collateral like reference architectures and documentation.
  • Build proofs of concept and small-scale deployments to validate solutions.
  • Act as a trusted advisor to Product Management, providing actionable feedback.

What we're looking for

  • Extensive hands-on experience building and operating LLM-powered applications in production.
  • Strong foundation in software engineering with expertise in Python or JavaScript/TypeScript.
  • Deep understanding of distributed systems, tracing, metrics, logging, and emerging LLM observability concepts.
  • Proven ability to create high-impact technical collateral like reference architectures and documentation.
  • Experience as an Architect or Consultant, ideally with a focus on observability tools and SRE practices.

Related searches

More Product Solutions Architect jobs Product Solutions Architect jobs in New York All jobs at Datadog

More like this

Similar roles

Staff Software Engineer - ML Observability | Datadog Careers

Datadog

New York, NY 15 days ago $234,000–$300,000
Python Docker Kubernetes Terraform CI/CD Prometheus Grafana PostgreSQL AWS LLMs Generative AI Tracing tools Observability platforms Machine learning methodologies Model evaluation techniques Prompt engineering
Hybrid
Save

Engineering Product Manager - Observability AI (USA, Remote)

Cisco

Remote (San Francisco, CA) +3 6 days ago $168,800–$241,200
AI Observability Telemetry Anomaly Detection Root Cause Analysis Alert Correlation Remediation Groundedness Hallucination Detection Task Success Agent Collaboration AI Security Compliance CI/CD Python PostgreSQL Kubernetes Docker AWS GCP
Remote
Save

Senior Engineering Manager - Observability

Target

Brooklyn Park, MN 80 days ago $132,000–$238,000
Kubernetes Golang OpenTelemetry ClickHouse InfluxDB Grafana React CI/CD Agile Git Linux Docker AWS Azure Google Cloud Platform PostgreSQL MongoDB Redis Kafka Prometheus Terraform
Hybrid
Save