As a Software Engineer II on the HPC/AI team, you will design and build advanced networking infrastructure for large-scale AI training in Azure Cloud. Your day-to-day responsibilities include developing high-performance communication frameworks, benchmarking systems to ensure scalability and reliability, and resolving complex issues in distributed environments. You will also drive the development of design documents and act as a Designated Responsible Individual (DRI) to monitor system health and initiate restorative actions. The role requires expertise in C, C++, Rust, or Python, along with experience in software design, distributed systems, and high-performance computing middleware. Familiarity with hardware-software co-design and profiling tools is preferred, as you will work on cutting-edge AI trends and patterns to enhance system performance at scale.
Skills
Python
C++
Rust
Docker
Kubernetes
Azure
CI/CD
Prometheus
Grafana
PostgreSQL
Redis
Git
Linux
High Performance Computing
Messaging Protocols
Networking Hardware
Performance Analysis Tools
Profiling Tools
REST APIs
JSON
YAML
What you'll do
Design and develop high-performance networking solutions for large-scale AI training infrastructure.
Analyze and enhance the scalability of networking systems handling petabyte-scale data transfer.
Debug complex issues in distributed, high-performance computing environments.
Implement and optimize code to improve system performance and maintainability.
Serve as a Designated Responsible Individual (DRI) for monitoring and restoring system stability.
What we're looking for
Bachelor's degree in Computer Science or equivalent technical field and 2+ years of software engineering experience.
Experience designing and developing distributed systems and large-scale AI training infrastructure.
Proficiency in programming languages such as C, C++, Rust, or Python.
At least 1 year of experience with high-performance computing and machine learning middleware.
Knowledge of hardware-software co-design principles and performance analysis tools.
Strong problem-solving skills and analytical capabilities for complex networking issues.
Familiarity with high-performance networking hardware and architecture.
Market check
Salary context
This
$100,600–$199,000
range sits above
41%
of similar postings on FindRole.
Peer median band
$119,800–$205,600
Median floor and ceiling across peers.
Typical midpoint (25–75%)
$140,714–$182,206
Middle half of comparable postings.
Based on 240 comparable postings.*
* 240 is the maximum number of comparable postings sampled.
Employer
About Microsoft
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has
451 open roles
on FindRole.
Listed pay typically runs
$119,800–$234,700
across 417 roles with salary data.
Azure
Power Platform
Copilot Studio
React
JavaScript
C#
Cosmos DB
Dataverse
D365
ASP .NET
Azure Container Apps
RESTful web services
Terraform
CI/CD
Kubernetes
Python
PostgreSQL