below marketmost similar roles pay hereabove market
This role pays more than
71%
of similar roles. Most pay
$181,000–$243,250
— the blue band above.
At the midpoint, this role pays about
$236k
versus about
$212k
for comparable roles.
Based on 240 similar postings.
Employer
About Nvidia
Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing
Nvidia currently has
1623 open roles
on FindRole.
Listed pay typically runs
$184,000–$287,500
across 1110 roles with salary data.
The Manager, Software Architecture joins the Networking Systems & Software Architecture group's applied research team to lead systems and networking engineers. This role involves leading a team to build distributed AI communication systems, including libraries, frameworks, and system integrations. The manager is responsible for owning execution, setting technical direction, building roadmaps, and managing project planning and resource allocation. Key responsibilities include developing systems-level software for data movement between GPUs, nodes, and storage, focusing on low-level transport optimization, hardware-software co-design, and communication frameworks for production AI stacks and quantum computing interconnects. Candidates must possess expertise in C, C++, Rust, and Python, alongside knowledge of computer architecture, memory hierarchies, DMA engines, and networking. Required competencies include understanding ML systems concepts like transformer architectures and model parallelism.
Lead and develop a team of systems and networking engineers building distributed AI communication systems.
Build the technical roadmap in partnership with principal engineers and architects to balance near-term delivery with long-term research.
Manage project planning, resource allocation, and delivery timelines across concurrent workstreams.
Drive architecture and technical direction for systems-level software moving data between GPUs, nodes, and storage.
Create a culture of technical excellence and open collaboration within the engineering organization.
Oversee the development of libraries, frameworks, and system integrations for production AI stacks.
Participate in architecture reviews and make informed trade-off decisions regarding systems software and networking.
What we're looking for
Software engineering experience with advanced knowledge in systems software, networking, or distributed systems.
3+ years of direct people management experience.
BS, MS, PhD, or equivalent experience in Computer Science, Computer Engineering, or a related field.
Proficiency in programming languages such as C, C++, Rust, and Python.
Good understanding of computer architecture, memory hierarchies, DMA engines, and networking.
Understanding of ML systems concepts including transformer architectures, KV cache mechanics, model parallelism, or distributed training and inference patterns.
Strong communication skills for public speaking, writing technical documents, and providing candid feedback.
Knowledge of ML inference frameworks (vLLM, SGLang, TensorRT-LLM) and familiarity with hardware and software ecosystems (preferred).
Solution Architecture
Cloud Engineering
Data & Analytics
API Management
Microservices
CI/CD
Software Development
Digital Integration
Automation
Functional Design
Software Design