below marketmost similar roles pay hereabove market
This role pays more than
59%
of similar roles. Most pay
$126,750–$179,375
— the blue band above.
At the midpoint, this role pays about
$157k
versus about
$153k
for comparable roles.
Based on 240 similar postings.
Employer
About Cisco
Cisco Systems is the world''s leading networking technology company, designing and manufacturing networking hardware, telecommunications equipment, and cybersecurity solutions for businesses and governments. Industry: Networking Technology & Cybersecurity
Cisco currently has
271 open roles
on FindRole.
Listed pay typically runs
$167,700–$245,200
across 195 roles with salary data.
As a Software Engineer on the Foundational Model Service team, you will maintain and evolve a platform that provides internal engineering teams with access to small, large language, and embedding models. You will support model onboarding, releases, and automated validation while contributing to monitoring systems and applying agentic solutions to automate operations. Your daily work involves debugging production issues, creating technical documentation, and ensuring a 99.9% uptime SLA. You will utilize technologies including Kubernetes, Linux, vLLM, Nim, Triton, and NVIDIA NIM. The role requires expertise in GPU-based AI infrastructure, inference serving, and benchmarking models. You will solve complex problems related to distributed inference, capacity planning, and cost optimization while following secure coding practices and Cisco Design Thinking Principles to deliver scalable AI infrastructure.
What does a Software Engineer earn in North Carolina?
Median $196750 from 53 postings across 17 companies.
Support model onboarding and releases for the Foundational Model Service platform.
Maintain and operate production services on Kubernetes clusters using Nim and vLLM runtimes.
Automate validation processes that gate every deployment to ensure platform stability.
Contribute to monitoring systems to track and report service behavior to customers.
Apply agentic solutions to automate operations and remediate problems automatically.
Debug platform issues in both development and production environments.
Create technical design documentation and end-user documentation for the platform.
Participate in a shared on-call rotation to support critical services and maintain uptime.
What we're looking for
Bachelor’s degree in Computer Science, Information Systems, or related field with 3 years experience; master’s with 1 year; PhD; or equivalent practical experience.
Experience developing and operating production services on Kubernetes and Linux.
Experience with GPU-based AI infrastructure.
Hands-on experience serving models with vLLM, NVIDIA NIM, Triton, or a comparable inference runtime.
Experience leading technical work, mentoring engineers, documenting systems, and supporting critical services through an on-call rotation.
Experience evaluating and benchmarking models to support production release decisions (preferred).
Experience operating GPU workloads with NVIDIA CUDA or AMD ROCm (preferred).
Familiarity with distributed inference, disaggregated serving, KV cache aware routing, capacity planning, or cost optimization (preferred).
C#
C++
Python
Linux
EtherCAT
Motion Control
FPGA
Machine Learning
AI
Software Architecture
Robotics
Instrumentation
Semiconductor Equipment
Optical Imaging Systems
Modern C++
Python
C#
Java
Rust
Machine Learning
PyTorch
GPU Programming
Signal Processing
Computer Vision
Robotics
Web Service Architecture
FPGA
Numerical Methods
Mathematical Modelling