Software Engineer

Cisco

Confirmed live yesterday High trust

Hybrid

Quick summary

Work type: Hybrid
Location: San Jose, CA
Salary: $167,700–$245,200 / yr
Employment: Full-time
Posted: 11 days ago
Freshness: Confirmed live yesterday
Closes: Oct 30, 2026
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $153k

This role $206k

$99k $261k

below market most similar roles pay here above market

This role pays more than 86% of similar roles. Most pay $126,750–$179,000 — the blue band above. At the midpoint, this role pays about $206k versus about $153k for comparable roles.

Based on 240 similar postings.

Employer

About Cisco

Cisco Systems is the world''s leading networking technology company, designing and manufacturing networking hardware, telecommunications equipment, and cybersecurity solutions for businesses and governments. Industry: Networking Technology & Cybersecurity

Cisco currently has 254 open roles on FindRole.

Listed pay typically runs $167,700–$245,200 across 185 roles with salary data.

Most-posted roles

View all roles at Cisco

At a glance

TL;DR · Software Engineer

Role Posting Log in to save

As a Software Engineer on the Foundational Model Service team, you will maintain and evolve a platform that provides internal engineering teams with access to small, large language, and embedding models. You will support model onboarding, releases, and automated validation while contributing to monitoring systems and applying agentic solutions to automate operations. Your daily work involves debugging platform issues, creating technical documentation, and ensuring a 99.9% uptime SLA. You will utilize Python, Go, Kubernetes, Linux, vLLM, Nim, and Triton to manage GPU workloads and inference serving. The role requires expertise in model evaluation, quantization, and distributed inference. You will solve complex infrastructure problems by building scalable AI systems that handle frequent runtime updates and high-demand model deployments across the enterprise.

What does a Software Engineer earn in California?

Median $214500 from 1178 postings across 77 companies.

See salary data

Skills

Python Go Kubernetes Linux vLLM NVIDIA NIM Triton GitOps Helm Argo CD Infrastructure as Code RAG DeepEval lm-eval LLMs GPU Workloads

What you'll do

Support model onboarding and releases for the Foundational Model Service platform.
Maintain and operate the platform on Kubernetes clusters using Nim and Vllm runtimes.
Automate validation processes that gate every deployment to the production environment.
Contribute to monitoring systems to track and report service behavior to customers.
Apply agentic solutions to automate operations and remediate platform problems.
Debug platform issues in both development and production environments.
Create technical design documentation and end-user documentation for the platform.
Participate in a shared on-call rotation to support critical services.

What we're looking for

8 or more years of related AI systems, platform, or software engineering experience.
Proficiency in programming with Python or Go.
Production experience operating AI infrastructure and GPU workloads on Kubernetes and Linux.
Hands-on experience serving models with vLLM, NVIDIA NIM, Triton, or a comparable inference runtime.
Experience leading technical work, mentoring engineers, documenting systems, and supporting critical services through an on-call rotation.
Strong understanding of model inference and evaluation, including batching, throughput, quantization, and benchmarking (preferred).
Familiarity with distributed inference, disaggregated serving, KV cache aware routing, and GPU capacity planning (preferred).
Practical experience with GitOps, Helm, Argo CD, Infrastructure as Code, and model registries (preferred).

Save