Senior Software Engineer, CoreAI | Microsoft Careers

Microsoft

Actively hiring
US Posted 76 days ago $119,800$234,700 / year

At a glance

AI generated

TL;DR

As a Senior Software Engineer on the FIT training team within Microsoft’s CoreAI organization, you will play a pivotal role in advancing the development of agentic AI systems by building scalable infrastructure for large language models (LLMs), semantic language models (SLMs), and multimodal models. Your day-to-day responsibilities include collaborating with engineers and researchers to optimize training tools, designing highly reliable services, and implementing security measures while ensuring efficient deployment and monitoring in production environments. The ideal candidate possesses expertise in languages such as Python, C++, Java, or JavaScript, along with a proven track record of delivering large-scale software systems in AI or related fields. This role demands an agile mindset, the ability to iterate quickly, and strong collaboration skills in a fast-paced environment focused on creating enterprise-grade agentic workflows at scale.

Skills

Python C++ C# Java JavaScript Azure LLMs SLMs CI/CD Docker Kubernetes Terraform Prometheus Grafana Git REST GraphQL

What you'll do

  • Design and optimize training infrastructure for LLMs, SLMs, and multimodal models.
  • Build scalable and reliable services to meet security and privacy requirements.
  • Implement production traffic-serving services with high reliability.
  • Participate in improving engineering systems and practices for complex cloud environments.
  • Contribute to the deployment and monitoring of AI services in production.

What we're looking for

  • 4+ years of technical engineering experience with coding in languages like C, C++, C#, Java, JavaScript, Python.
  • Experience building and optimizing training infrastructure for large-scale software systems, especially in AI or machine learning fields.
  • Ability to design and implement highly scalable and reliable services for production environments.
  • Strong background in deploying and monitoring services in complex cloud environments.
  • Proven track record of continuous improvement and agile development practices.

Market check

Salary context

This $119,800–$234,700 range sits above 76% of similar postings on FindRole.

Peer median band

$119,800$234,000

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$146,125$177,250

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 451 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 417 roles with salary data.

Most-posted roles

View all roles at Microsoft

More like this

Similar roles

Principal Software Engineer, CoreAI | Microsoft Careers

Microsoft

US 76 days ago $139,900$274,800
Python C++ Java JavaScript Azure CI/CD Kubernetes Docker Terraform Prometheus Grafana LLMs SLMs Multimodal_Models Code_Specific_Models Scalability Reliability Security Privacy Cloud_Infrastructure DevOps