The Observability group is seeking a Senior Software Engineer to join its Evaluation platform team, responsible for developing core services that monitor and optimize AI agent performance at scale. This role involves designing and implementing AI services to support product offerings, collaborating with product management and partner teams to align technical direction with business goals, and taking end-to-end responsibility for the development lifecycle of these services. The ideal candidate will engage with customers to gather feedback and resolve complex issues while innovating on technical solutions that enhance product availability, reliability, efficiency, observability, and performance. Proficiency in cloud technologies, DevOps practices, and experience with AI and machine learning frameworks is essential, along with a strong understanding of Microsoft businesses and the ability to collaborate effectively across stakeholders.
Skills
Python
Docker
Kubernetes
AWS
CI/CD
PostgreSQL
Prometheus
Grafana
Git
Linux
What you'll do
Design and implement AI services to support large-scale agent observability.
Ensure production readiness and drive DevOps culture for developed services.
Gather customer feedback and resolve complex issues related to services.
Innovate technical solutions to enhance product availability, reliability, and performance.
Collaborate with stakeholders to create cohesive end-to-end experiences.
What we're looking for
5+ years of software engineering experience in large-scale system development.
Strong background in designing and implementing AI services for product offerings.
Proven ability to collaborate with product management and partner teams effectively.
Experience taking end-to-end responsibility for the development lifecycle of services.
Skilled in engaging customers to gather feedback and resolve complex issues.
Understanding of Microsoft businesses and stakeholder collaboration for cohesive experiences.
Market check
Salary context
This
$100,600–$199,000
range sits above
35%
of similar postings on FindRole.
Peer median band
$119,800–$216,350
Median floor and ceiling across peers.
Typical midpoint (25–75%)
$149,800–$202,300
Middle half of comparable postings.
Based on 240 comparable postings.*
* 240 is the maximum number of comparable postings sampled.
Employer
About Microsoft
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has
451 open roles
on FindRole.
Listed pay typically runs
$119,800–$234,700
across 417 roles with salary data.