Senior Software Development Engineer in Test, AI Tooling & Automation

Salesforce

Confirmed live yesterday High trust
Remote

Quick summary

Work type
Remote
Location
San Francisco, CA
Salary
$148,500–$223,900 / yr
Posted
17 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $189k
This role $186k
$135k most similar roles pay here $237k

This role pays more than 53% of similar roles. Most pay $164,250–$214,325 — the shaded band above. At the midpoint, this role pays about $186k versus about $189k for comparable roles.

Based on 240 similar postings.

Employer

About Salesforce

Salesforce is the world''s leading customer relationship management (CRM) platform, offering cloud-based software for sales, service, marketing, analytics, and application development. Industry: Enterprise Software & Cloud Computing

Salesforce currently has 106 open roles on FindRole.

Listed pay typically runs $148,500–$260,100 across 98 roles with salary data.

Most-posted roles

View all roles at Salesforce

At a glance

TL;DR · Senior Software Development Engineer in Test, AI Tooling & Automation

As a Senior Software Development Engineer in Test - AI Tooling & Automation, you will join the software quality team to build and maintain scalable, AI-first testing frameworks and automation suites. You will be responsible for validating complex workflows, agentic capabilities, LLM integrations, prompt accuracy, and deterministic system behaviors. The role involves performing white-box testing, identifying quality gaps in application code, and fixing test flakiness within a fast-paced CI/CD environment. You will also implement evaluation processes for subjective dimensions like response relevance and user safety. To succeed, you must possess strong technical fundamentals in Java, including data structures and algorithms. The role requires expertise in evaluating Large Language Models, experience with public cloud infrastructure, and the ability to collaborate across teams to ensure AI-driven solutions meet high enterprise standards for production readiness.

What does a Software Development Engineer in Test earn in California?

Median $208400 from 30 postings across 6 companies.

See salary data

What you'll do

  • Design and maintain scalable, AI-first testing frameworks and automation suites to validate complex workflows.
  • Translate high-level quality strategies into actionable plans for LLM integrations and prompt accuracy.
  • Perform white-box testing by analyzing application code to identify gaps and fix test flakiness.
  • Implement evaluation processes for subjective AI dimensions like response relevance, safety, and context.
  • Transition the team from traditional testing methods to AI-driven automation tools.
  • Ensure quality is integrated early and continuously throughout the agile delivery lifecycle.

What we're looking for

  • Strong technical fundamentals of Java, particularly in data structures and algorithms.
  • Proven track record of delivering automation solutions in a fast-paced CI/CD environment.
  • Strong analytical and problem-solving skills focused on identifying quality gaps and driving improvement.
  • Excellent communication skills to collaborate cross-functionally with product managers, engineers, and data scientists.
  • Experience evaluating Large Language Models (LLMs) for quality response is a big plus.
  • A software engineer with a strong coding background and understanding of Agentic PDLC is preferred.
  • Strong experience with white-box testing and fixing code is a huge plus.
  • Experience with public cloud infrastructure, Salesforce platform knowledge, or testing generative AI workflows is preferred.

More like this

Similar roles

Software Engineer, Test Automation

Cisco

Remote (San Jose, CA) 11 days ago $167,700$245,200
Python Go LangChain LangSmith Playwright K6 JMeter LLM APIs Prompt Engineering Contract Testing Test Automation Performance Testing Security Compliance OCSF Caldera Audit Log Validation Tenant Isolation Probes
8+ yrs exp Remote

Senior Software Engineer, Test Automation

Danaher Corporation

Downingtown, PA 37 days ago $110,000$125,000
Cypress JavaScript TypeScript CI/CD Git npm REST Agile Angular Test Automation Root-Cause Analysis API Testing Windows Desktop Automation
5+ yrs exp

Senior Software Development Engineer in Test

Nvidia

Santa Clara, CA 11 days ago $140,000$224,250
Python AI-assisted development Codex Claude Code Cursor Automation Frameworks Windows CUDA DLSS Frame Generation Reflex G-Sync PC Architecture Debugging Logging Software Quality Engineering
5+ yrs exp