Software Engineer, Test Automation

Cisco

Confirmed live yesterday High trust

Closes in 7 days Remote

Quick summary

Work type: Remote
Location: San Jose, CA
Salary: $167,700–$245,200 / yr
Posted: 11 days ago
Freshness: Confirmed live yesterday
Closes: Sep 18, 2026 (soon)
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $171k

This role $206k

$123k most similar roles pay here $258k

This role pays more than 76% of similar roles. Most pay $137,975–$204,050 — the shaded band above. At the midpoint, this role pays about $206k versus about $171k for comparable roles.

Based on 240 similar postings.

Employer

About Cisco

Cisco Systems is the world''s leading networking technology company, designing and manufacturing networking hardware, telecommunications equipment, and cybersecurity solutions for businesses and governments. Industry: Networking Technology & Cybersecurity

Cisco currently has 196 open roles on FindRole.

Listed pay typically runs $167,700–$245,200 across 196 roles with salary data.

Most-posted roles

View all roles at Cisco

At a glance

TL;DR · Software Engineer, Test Automation

Role Posting Log in to save

Software Engineer, Test Automation will join the team to build test infrastructure for an AI-agentic Security Operations Center. This role involves translating complex quality challenges into technical solutions by developing evaluation frameworks, implementing benchmarking protocols, and creating AI-based tools to mitigate risk and enhance system integrity. The engineer will manage the lifecycle of proof-of-concepts, conduct code reviews, and execute validation techniques such as LLM-as-judge methodologies, tenant isolation probes, and behavioral regression suites. Key technical requirements include proficiency in Python and Go, experience with Playwright, K6, and JMeter, and familiarity with LangChain and LangSmith. The role also requires expertise in contract testing, audit log validation, and security compliance frameworks like OCSF. This position focuses on ensuring the reliability of AI agents and workflows within a high-performance security environment.

What does a Software Engineer earn in California?

Median $214000 from 775 postings across 63 companies.

See salary data

Skills

Python Go LangChain LangSmith Playwright K6 JMeter LLM APIs Prompt Engineering Contract Testing Test Automation Performance Testing Security Compliance OCSF Caldera Audit Log Validation Tenant Isolation Probes

What you'll do

Build test infrastructure for an AI-agentic Security Operations Center (SOC).
Develop evaluation frameworks to assess the performance of AI agents and system processes.
Implement benchmarking protocols and AI-based solutions to mitigate risk and enhance system integrity.
Execute proof-of-concepts (POCs) to validate new testing paradigms and experimentation standards.
Implement validation techniques including LLM-as-judge methodologies, tenant isolation probes, and behavioral regression suites.
Perform contract testing, audit log validation, and security compliance checks in partnership with engineering teams.
Develop scalable, high-performance testing infrastructure using Python and Go.

What we're looking for

Bachelor's degree required.
8+ years of experience in software development and test automation.
Experience building large-scale testing ecosystems.
Proficiency in programming with Python and Go to build scalable, high-performance infrastructure.
Demonstrated experience with security compliance frameworks and modern performance testing methodologies.
Experience using AI to build automation and writing AI skills for test automation.
Expertise in LLM APIs, prompt engineering, LangChain, LangSmith, and LLM-as-judge frameworks.
Proficiency with tools such as Playwright, K6, JMeter, and OCSF validation libraries.

Similar roles

Software Technical Leader, Test Automation

Cisco

Remote (San Jose, CA) 14 days ago $186,900–$267,700

Python Go LLM APIs LangChain LangSmith Playwright K6 JMeter Contract Testing Prompt Engineering Security Compliance Audit Log Validation Tenant Isolation Probes LM-as-judge OCSF Caldera Terra VM

10+ yrs exp Remote

Save

Senior Staff Software Engineer

Cisco

Remote (San Jose, CA) 10 days ago $214,100–$309,800

Python Playwright AI-Agent Evaluation LLM APIs Prompt Engineering JMeter Contract Testing Performance Testing Test Automation Claude Codex

10+ yrs exp Remote

Save

Test Automation Software Engineer

Booz Allen Hamilton

McLean, VA 31 days ago $69,400–$158,000

Python JavaScript TypeScript C# .NET Selenium Playwright REST APIs SQL CI/CD Jenkins GitHub Actions Git Jira Containers Linux Windows Server IIS DevSecOps GitOps Static Code Analysis

Save

Test Automation Software Engineer

Booz Allen Hamilton

McLean, VA +1 7 days ago $77,600–$176,000

Selenium Playwright CI/CD Jenkins GitHub Actions Python JavaScript TypeScript C# .NET Git Jira REST APIs SQL Containers Linux DevSecOps GitOps GitHub CodeQL Static Code Analysis

Save

Software Test Automation Engineer

State Street

Quincy, MA 59 days ago

Python PySpark Databricks AWS Spark Scala SQL ETL Selenium Airflow JIRA X-Ray Confluence Hive Impala Hadoop TOAD Agile

5+ yrs exp Hybrid

Save

Software Test Automation Engineer

Maplewood, MN 29 days ago $145,676–$178,049

Test Automation C++ C APIs CIP OPC-UA MQTT Wi-Fi Encryption Security Best Practices Mock Services

7+ yrs exp

Save