Principal Engineer, Observability

Target

Confirmed live yesterday High trust
Hybrid

Quick summary

Work type
Hybrid
Location
Brooklyn Park, MN
Salary
$168,000–$303,000 / yr
Posted
30 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $203k
This role $236k
$125k most similar roles pay here $322k

This role pays more than 77% of similar roles. Most pay $174,600–$231,000 — the shaded band above. At the midpoint, this role pays about $236k versus about $203k for comparable roles.

Based on 240 similar postings.

Employer

About Target

Target Corporation is a large-format general merchandise and grocery retailer offering a wide assortment of everyday essentials, apparel, home goods, and electronics through stores and online. Industry: General Merchandise Retail

Target currently has 58 open roles on FindRole.

Listed pay typically runs $98,000–$176,000 across 58 roles with salary data.

Most-posted roles

View all roles at Target

At a glance

TL;DR · Principal Engineer, Observability

Principal Engineer - Observability serves as the senior-most individual contributor on the Observability team, providing technical leadership for an enterprise-scale reliability platform. You will define the architecture and standards for metrics, logs, traces, alerting, and AI-driven root cause analysis while solving complex distributed systems challenges in high-volume telemetry pipelines. The role involves building a product-oriented internal platform to improve developer experience and ensure system resilience across thousands of services. Key technologies include Golang, Kubernetes, Kafka, ClickHouse, InfluxDB, Grafana, and React. You will also work with OpenTelemetry standards and various data stores like PostgreSQL and MongoDB. This position addresses the critical business problem of maintaining high availability for retail operations by evolving reactive monitoring into an intelligent, proactive observability system that detects degradation and recommends automated recovery actions across a massive service ecosystem.

What does a Engineer earn?

Median $185000 from 249 postings across 48 companies.

See salary data

What you'll do

  • Own the end-to-end architecture for metrics, logs, traces, alerting, and AI-driven root cause analysis across all teams.
  • Solve complex distributed systems and high-volume telemetry pipeline challenges where standard playbooks do not exist.
  • Drive observability as an internal product to ensure a first-class developer experience and "observable by default" instrumentation.
  • Set technical standards and lead design reviews to increase the effectiveness of engineers across multiple teams.
  • Contribute to infrastructure-wide technical priorities and projects that fall outside the specific scope of the Observability team.
  • Represent the Observability domain in cross-functional architecture forums to align platform direction with enterprise strategy.
  • Mentor senior engineers and provide technical leadership to raise the engineering bar across the organization.

What we're looking for

  • In-depth knowledge of system design, build, test, and operational debugging practices.
  • Demonstrated experience architecting and delivering production distributed systems at scale.
  • A track record of sustained technical influence and standard-setting across multiple engineering teams.
  • Commitment to continuous learning and staying current with evolving technologies.
  • 12+ years of experience in technology development or services (preferred).
  • 4+ years of experience in strategic planning and setting technical direction (preferred).
  • A 4-year degree or equivalent experience (preferred).
  • Experience with Golang, Kubernetes, Kafka, ClickHouse, InfluxDB, and other distributed systems technologies (preferred).

More like this

Similar roles

Engineer - Hardware Observability

Target

Brooklyn Park, MN 10 days ago $75,400$135,700
Python Java ETL ELT Data Modeling Data Pipelines Streaming Data SecOps DevOps Observability Infrastructure Telemetry Automation Tools Network Technology Schema Evolution
1+ yrs exp Hybrid

Lead Engineer, Observability Platform

CVS Health

Remote (RI) +4 25 days ago $106,605$284,280
OpenTelemetry Go Python Java Spring Boot Kubernetes Docker Argo CD AWS GCP Azure Terraform CloudFormation Helm Kustomize Grafana Loki Tempo Mimir PostgreSQL MySQL Kafka Pulsar ClickHouse Cassandra Istio Envoy CI/CD
7+ yrs exp Remote

Staff Software Engineer, Observability

Pinterest

Remote 7 days ago $177,185$364,795
Distributed Systems Data Engineering Observability OpenTelemetry Prometheus Grafana Kafka Flink Java Python Go Scala Kubernetes Service Mesh Time-series Databases Columnar Storage Stream Processing Machine Learning Anomaly Detection
7+ yrs exp Remote

Principal Software Engineer, Observability

The Walt Disney Company

Remote 29 days ago $184,300$247,100
AI LangChain LangGraph FastAPI Flask AWS Azure GCP Docker EKS CI/CD GitHub Datadog Grafana OpenTelemetry PySpark Pandas Databricks Snowflake Microservices
10+ yrs exp Remote

Principal Observability Automation Engineer

Q2

Austin, TX 14 days ago
C# Go Python Bash PowerShell AWS Azure GCP VMware Docker Terraform CI/CD SQL NoSQL MS SQL Server Grafana Splunk NGINX IIS Linux Windows Server RESTful APIs Microservices
10+ yrs exp