Senior Software Engineer, Agentic AI and Observability

What you'll do

• Build and implement observability solutions including metrics, tracing, logging, and alerting for agentic AI applications.
• Develop and sustain deployment pipelines and reliability tools for the Agentic AI Factory model.
• Define SLOs and SLIs with AI application teams to ensure production readiness for new agent deployments.
• Instrument LLM-based workflows to monitor performance, cost, quality, token usage, and tool orchestration.
• Drive incident response, root cause analysis, and reliability improvements for BizApps AI services.
• Identify and close observability gaps such as hallucination detection and orchestration failure tracing.
• Integrate reliability throughout the development lifecycle by working with platform, data, and application engineering groups.

What we're looking for

• BS or MS in Computer Science, Software Engineering, or a related field (or equivalent experience).
• 8+ years of experience and strong software engineering skills in Python and modern CI/CD practices.
• Hands-on experience with container orchestration (Kubernetes, Docker) and cloud infrastructure.
• Experience with observability and monitoring platforms such as Datadog, OpenTelemetry, Grafana, or Prometheus.
• SRE/DevOps approach to production systems, automating toil, and building for reliability.
• Excellent problem-solving skills and a proven track record of debugging complex distributed systems.
• Experience with LLM orchestration frameworks and agentic AI build patterns (preferred).
• Experience operating ML/AI systems in production environments (preferred).