Senior and/or Principal Software Engineer, AI Frameworks Networking, Systems and Tools

Microsoft

Confirmed live today High trust
Remote

Quick summary

Work type
Remote
Location
Remote
Salary
$142,800–$274,800 / yr
Posted
53 days ago
Freshness
Confirmed live today
Closes
Mar 2, 2027

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $179k
This role $209k
$101k $293k
below market most similar roles pay here above market

This role pays more than 77% of similar roles. Most pay $149,500–$208,800 — the blue band above. At the midpoint, this role pays about $209k versus about $179k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 694 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 651 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Senior and/or Principal Software Engineer, AI Frameworks Networking, Systems and Tools

The Senior and/or Principal Software Engineer - AI Frameworks Networking, Systems and Tools joins the AI Frameworks team to develop software enabling AI models to run on supercomputers, servers, mobile phones, and IoT devices. This role involves designing, implementing, and ensuring the quality of the systems stack and related tools integrated with Azure as part of a software development kit. You will perform software development across all phases from concept to verification, applying engineering principles to define robust architectures. Key responsibilities include collaborating with hardware designers and ML developers to optimize model training and inference. Required skills include proficiency in C/C++ and Python, with preferred experience in C#, Java, microservice architecture, and orchestration platforms like K8s and Service Fabric. Knowledge of computer architecture and embedded programming is essential.

What does a Software Engineer earn in Remote?

Median $208800 from 354 postings across 50 companies.

See salary data

What you'll do

  • Design and implement robust, maintainable software architectures and systems.
  • Develop software using C/C++, C#, and Python.
  • Ensure the quality and integration of the systems stack with Azure.
  • Deliver software components as part of the official software development kit (SDK).
  • Identify project requirements and scope technical solutions.
  • Estimate work effort and schedule project deliverables.
  • Establish and drive the adoption of coding standards and patterns.
  • Perform full-cycle software development from concept and design to verification.

What we're looking for

  • Bachelor's Degree in Computer Science or related technical field.
  • 4+ years of technical engineering experience with coding in languages including C++, C, or Python.
  • Knowledge of computer architecture and/or embedded programming.
  • Ability to pass Microsoft Cloud background checks and other government security screenings.
  • 2+ years’ experience with C#/Java (preferred).
  • Strong technical background in software engineering principles and architecture design (preferred).
  • Experience building highly available, highly scalable microservice architecture (preferred).
  • Experience with orchestration platforms like K8s and Service Fabric (preferred).

More like this

Similar roles

Principal Software Engineer, AI Frameworks

Microsoft

Remote 29 days ago $165,600–$296,400
C++ Python LLM Inference AI Frameworks Software Architecture Computer Architecture Kernel Optimization Azure Observability Benchmarking Compilers Runtimes AMD GPUs Microsoft Silicon
8+ yrs exp Remote

Principal Software Engineer

Microsoft

Remote 14 days ago $142,800–$274,800
Azure C C++ C# Java JavaScript Python InfiniBand RoCE NVLink Ethernet TCP/IP RDMA gRPC SDN Distributed Systems Observability
6+ yrs exp Remote

Senior Software Engineer, AI Frameworks

Nvidia

Santa Clara, CA 37 days ago
PyTorch Ray Kubernetes Python C++ Go Triton Inference Server Docker CI/CD Helm Kustomize Distributed Systems CUDA RPC Nsight Model Serving Observability Logging Tracing
5+ yrs exp

Senior Software Engineer, AI Networking

Nvidia

Austin, TX +1 16 days ago
C/C++ RoCE InfiniBand RDMA DPDK DOCA NCCL CUDA Networking Protocols Distributed Systems Firmware OS Performance Tuning Congestion Control QoS Telemetry Automation
8+ yrs exp

Senior Software Engineer, AI Networking

Nvidia

Seattle, WA 111 days ago $184,000–$287,500
C/C++ RDMA DPDK DOCA NCCL CUDA RoCE InfiniBand Networking Protocols Distributed Systems Firmware OS Performance Tuning Congestion Control QoS Telemetry Automation
8+ yrs exp