As a Senior Software Engineer on the FIT training team within Microsoft’s CoreAI organization, you will play a pivotal role in advancing the development of agentic AI systems by building scalable infrastructure for large language models (LLMs), semantic language models (SLMs), and multimodal models. Your day-to-day responsibilities include collaborating with engineers and researchers to optimize training tools, designing highly reliable services, and ensuring compliance with security and privacy standards. You will also contribute to the deployment and monitoring of these systems in production environments, iterating quickly to address complex challenges and drive continuous improvement. Ideal candidates possess extensive experience in coding languages such as C++, Java, Python, and JavaScript, along with a proven track record of delivering large-scale software solutions in AI or related fields. This role demands an agile mindset, strong problem-solving skills, and the ability to thrive in fast-paced, dynamic environments where collaboration is key.
Design and optimize training infrastructure for LLMs, SLMs, and multimodal models.
Build scalable and reliable services to support production traffic requirements.
Implement security and privacy measures in service design and deployment.
Improve engineering systems and practices for complex cloud environments.
Monitor and maintain deployed AI services in production environments.
What we're looking for
At least 6 years of technical engineering experience with coding in C, C++, C#, Java, JavaScript, Python.
Bachelor's Degree in Computer Science or related field required.
Experience delivering large-scale software systems, preferably in AI or machine learning fields.
Ability to design and implement scalable and reliable services for production environments.
Strong skills in debugging complex training jobs and documenting findings effectively.
Proven track record of continuous improvement and agile mindset in fast-paced environments.
Market check
Salary context
This
$139,900–$274,800
range sits above
67%
of similar postings on FindRole.
Peer median band
$139,900–$238,500
Median floor and ceiling across peers.
Typical midpoint (25–75%)
$177,250–$214,500
Middle half of comparable postings.
Based on 240 comparable postings.*
* 240 is the maximum number of comparable postings sampled.
Employer
About Microsoft
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has
451 open roles
on FindRole.
Listed pay typically runs
$119,800–$234,700
across 417 roles with salary data.