Member of Technical Staff - Copilot AI Evaluation Engineering Manager | Microsoft Careers

Microsoft

Hybrid Actively hiring
US Posted 82 days ago $139,900–$274,800 / year
View original post Log in to save

At a glance

AI generated

TL;DR

Microsoft AI is hiring a Member of Technical Staff - Copilot AI Evaluation Engineering Manager to lead the development of large language model (LLM) evaluation solutions for Microsoft’s AI assistant. This role involves managing a team of software, AI, and machine learning engineers to create secure, reliable, and scalable evaluation platforms. The ideal candidate will collaborate closely with product and research teams to prioritize features and enhance user experience globally. Key responsibilities include designing novel evaluation techniques and agentic solutions to measure and improve copilot quality. Preferred qualifications include extensive hands-on experience in ML/AI evaluation, a background in leading large-scale software system development, and expertise in languages such as C++, Java, or Python. This position demands strong leadership skills and a deep commitment to delivering high-quality engineering solutions that delight users on a massive scale.

Skills

Python Java JavaScript C++ ML AI CI/CD Kubernetes Docker AWS Azure Git JIRA PostgreSQL MongoDB Linux Agile Scrum

What you'll do

  • Hire and lead a team of engineers to develop world-class LLM evaluation solutions.
  • Manage software development for secure, reliable, and scalable evaluation platforms.
  • Design novel evaluation techniques to measure and enhance copilot quality.
  • Collaborate with product teams to prioritize features for AI companion technology.
  • Build agentic solutions to improve the performance and user experience of copilots.

What we're looking for

  • 8+ years of technical engineering experience with coding in C, C++, C#, Java, JavaScript, or Python.
  • Bachelor's Degree in Computer Science or related field, or equivalent experience.
  • Hands-on experience with ML and/or AI evaluation.
  • Experience leading engineering teams to deliver large-scale software systems in AI fields.
  • Strong opinions about best investments for establishing a delightful and performant AI companion system.
  • Collaborative leadership skills to manage and lead a team of engineers effectively.

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $206k
This role $207k
$124k most similar roles pay here $291k

This role pays more than 57% of similar roles. Most pay $177,250–$235,750 — the shaded band above. At the midpoint, this role pays about $207k versus about $206k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 534 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 488 roles with salary data.

Most-posted roles

View all roles at Microsoft

More like this

Similar roles

| Microsoft Careers

Microsoft

US 122 days ago $142,800–$274,800
Python Java JavaScript C# Kubernetes AWS Azure Docker CI/CD PostgreSQL Redis Apache Kafka Apache Spark TensorFlow PyTorch GraphQL REST SQL NoSQL
Hybrid
Save

| Microsoft Careers

Microsoft

California 33 days ago $142,800–$274,800
Python JavaScript Java C++ C# AWS Kubernetes Docker CI/CD PostgreSQL MongoDB
Hybrid
Save

| Microsoft Careers

Microsoft

US 14 days ago $85,400–$168,100
Spark Databricks Apache Spark Flink Ray Trino Snowflake Kafka Azure EventHubs Pulsar Kubernetes Terraform Bicep CI/CD IaC Python PostgreSQL Redis MongoDB Prometheus Grafana
Hybrid
Save