Senior Software Development Engineer in Test, AI Tooling & Automation

Salesforce

Confirmed live yesterday High trust
Remote

Quick summary

Work type
Remote
Location
San Francisco, CA
Salary
$148,500–$223,900 / yr
Posted
40 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $189k
This role $186k
$135k most similar roles pay here $237k

This role pays more than 53% of similar roles. Most pay $164,250–$214,325 — the shaded band above. At the midpoint, this role pays about $186k versus about $189k for comparable roles.

Based on 240 similar postings.

Employer

About Salesforce

Salesforce is the world''s leading customer relationship management (CRM) platform, offering cloud-based software for sales, service, marketing, analytics, and application development. Industry: Enterprise Software & Cloud Computing

Salesforce currently has 106 open roles on FindRole.

Listed pay typically runs $148,500–$260,100 across 98 roles with salary data.

Most-posted roles

View all roles at Salesforce

At a glance

TL;DR · Senior Software Development Engineer in Test, AI Tooling & Automation

Senior Software Development Engineer in Test - AI Tooling & Automation will join the Product Led Growth team within the Self-Service and Growth organization. This role focuses on building and maintaining scalable, AI-first testing frameworks and automation suites to validate complex workflows and agentic capabilities for enterprise customers. The engineer will perform white-box testing, identify quality gaps in application code, and implement evaluation processes for LLM integrations, prompt accuracy, and user safety. Key responsibilities include translating high-level quality strategies into actionable plans and collaborating with cross-functional teams to ensure production-ready software. Required skills include strong technical fundamentals in Java, including data structures and algorithms, along with experience in CI/CD environments. The role addresses the challenge of transitioning from traditional testing to AI-driven validation for autonomous agents, conversational UIs, and generative AI workflows within a multi-product ecosystem.

What does a Software Development Engineer in Test earn in California?

Median $208400 from 30 postings across 6 companies.

See salary data

What you'll do

  • Design, build, and maintain scalable, AI-first testing frameworks and automation suites for complex workflows.
  • Translate high-level quality strategies into actionable automation plans for LLM integrations and prompt accuracy.
  • Perform white-box testing by analyzing application code to identify gaps and fix test flakiness.
  • Implement evaluation processes for subjective AI dimensions like response relevance, safety, and contextual accuracy.
  • Collaborate with cross-functional teams to integrate quality standards throughout the agile delivery lifecycle.
  • Validate agentic capabilities and ensure production-ready quality for enterprise-level software.

What we're looking for

  • Strong technical fundamentals in Java, specifically regarding data structures and algorithms.
  • Experience evaluating Large Language Models (LLMs) for quality response and using AI evaluation frameworks.
  • Proven track record of delivering automation solutions within a fast-paced CI/CD environment.
  • Ability to perform white-box testing and actively contribute to fixing code and reducing test flakiness.
  • Strong analytical and problem-solving skills focused on identifying quality gaps and driving improvements.
  • Excellent communication skills for cross-functional collaboration with product managers, engineers, and data scientists.
  • Experience working with public cloud infrastructure (AWS/Azure/GCP) or the Salesforce platform is preferred.
  • Prior experience testing autonomous agents, conversational UIs, or generative AI workflows is a plus.

More like this

Similar roles

Senior Software Engineer, Test Automation

Danaher Corporation

Downingtown, PA 37 days ago $110,000$125,000
Cypress JavaScript TypeScript CI/CD Git npm REST Agile Angular Test Automation Root-Cause Analysis API Testing Windows Desktop Automation
5+ yrs exp

Senior Software Development Engineer in Test

Nvidia

Santa Clara, CA 11 days ago $140,000$224,250
Python AI-assisted development Codex Claude Code Cursor Automation Frameworks Windows CUDA DLSS Frame Generation Reflex G-Sync PC Architecture Debugging Logging Software Quality Engineering
5+ yrs exp

Senior Software Development Engineer in Test

Nvidia

Santa Clara, CA 11 days ago $168,000$270,250
Kubernetes AWS Azure Google Cloud Terraform Ansible Docker CI/CD GitLab Jenkins Prometheus Grafana Thanos Selenium Playwright Slurm Linux GitOps CloudWatch
8+ yrs exp