Senior Staff Software Engineer, AI Developer Experience

SoFi

Confirmed live today High trust

Quick summary

Work type
On-site
Location
San Francisco, CASeattle, WA
Salary
$172,800–$297,000 / yr
Posted
4 days ago
Freshness
Confirmed live today

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $181k
This role $235k
$100k $318k
below market most similar roles pay here above market

This role pays more than 84% of similar roles. Most pay $149,500–$213,000 — the blue band above. At the midpoint, this role pays about $235k versus about $181k for comparable roles.

Based on 240 similar postings.

Employer

About SoFi

SoFi Technologies is a fintech company offering student and personal loans, mortgages, credit cards, investing, banking, and insurance products, positioning itself as a one-stop financial services platform. Industry: Financial Technology & Personal Finance

SoFi currently has 18 open roles on FindRole.

Listed pay typically runs $172,800–$264,000 across 15 roles with salary data.

Most-posted roles

View all roles at SoFi

At a glance

TL;DR · Senior Staff Software Engineer, AI Developer Experience

The Senior Staff Software Engineer, AI Developer Experience joins the AI Platform team to lead the interactive coding strategy and underlying infrastructure. As a founding technical lead, you will define the architecture for the enterprise AI Gateway, model routing, and automated evaluation platforms. You will build cost models, metering systems, and telemetry to balance model accuracy with operational spend. Key responsibilities include resolving architectural bottlenecks in distributed systems, managing harness vending, and leading cross-group initiatives for autonomous coding and CI/CD pipelines. You must possess hands-on experience with LLM-based architectures, model APIs, and AI-assisted development tools. The role requires expertise in system design for high-availability distributed systems, infrastructure unit economics, and establishing production standards for resilience and security within a complex engineering environment.

What does a Software Engineer earn in California?

Median $214500 from 1167 postings across 73 companies.

See salary data

What you'll do

  • Define and drive the architecture for the enterprise AI Gateway, model routing, and automated evaluation platforms.
  • Translate developer productivity bottlenecks into a 12–24 month technical roadmap and execute high-impact build initiatives.
  • Architect cost models, metering systems, and adaptive routing policies to balance model accuracy with operational spend.
  • Lead technical initiatives across multiple engineering teams to establish shared interfaces for CI/CD and autonomous coding.
  • Identify and remediate root causes of complex architectural bottlenecks like latency, throughput, and state management.
  • Evaluate emerging AI tooling and foundational models to recommend vendor-neutral, future-proof integration patterns.
  • Set production standards for resilience and testing while acting as a lead resolver for high-severity incidents.
  • Coach and develop Senior and Staff engineers to cultivate a culture of craft and ownership.

What we're looking for

  • Bachelor’s Degree plus 4+ years of experience or a Master’s Degree plus 3+ years of experience in software engineering or a related technical field.
  • Proven track record of technical leadership on software initiatives spanning multiple teams and complex distributed architectures.
  • Adept system design capability with large-scale, high-availability distributed systems, platform infrastructure, and cross-domain APIs.
  • Hands-on engineering experience building with LLM-based architectures, model APIs, and AI-assisted development tools.
  • Hands-on experience designing or operating model evaluation pipelines, AI proxies/gateways, or dynamic routing systems.
  • Demonstrated ability to analyze infrastructure unit economics, capacity trade-offs, and operational telemetry.
  • Exceptional communication and cross-functional leadership skills to drive technical alignment across engineering squads and leadership.
  • Experience designing or scaling internal developer platforms, FinOps frameworks, or autonomous agentic workflows (preferred).

More like this

Similar roles

Staff Software Engineer, AI Developer Experience

SoFi

San Francisco, CA +1 4 days ago $153,600–$264,000
Python Java Kotlin Go Scala LLM AWS GCP CI/CD Distributed Systems Containerization Prompt Engineering FinOps IDP Model Routing Telemetry Data Governance
3+ yrs exp

Senior Staff Software Engineer, Agentic Workflows

Nvidia

Santa Clara, CA 20 days ago
Python Go LLM Agentic Workflows APIs CI/CD Distributed Systems Model Context Protocol Artifactory Hugging Face Jira ServiceNow Event-driven Systems Production Debugging Testing Observability Model Registries CDN
10+ yrs exp

Senior Software Engineer

Microsoft

10 days ago $119,800–$234,700
Distributed Systems Large Language Models Python C++ C# Java JavaScript C CI/CD Observability API Design Cloud Infrastructure Configuration Management Telemetry Profiling Data Management Concurrency Production Systems Platform Engineering
4+ yrs exp Hybrid

Senior Staff AI Engineer

Capital One Financial

San Francisco, CA +4 63 days ago
Python Go Scala Java C++ C# PyTorch AWS Huggingface VectorDBs Nemo Guardrails LLM Inference Similarity Search Machine Learning Google Cloud Azure
10+ yrs exp

Senior Staff Software Engineer, Enterprise AI Platform

Nvidia

Santa Clara, CA 27 days ago
Python Go Rust Distributed Systems CI/CD Container Orchestration Messaging Caching Durable Storage Vector Stores Secrets Management Authentication Authorization Observability Telemetry
10+ yrs exp

Senior Staff Software Engineer

Warner Bros. Discovery

Atlanta, GA 13 days ago
Web Software System Architecture JavaScript TypeScript Python Go HTML CSS AWS GCP Azure Cloud-native CI/CD DevOps Full-stack CMS AI Observability Security Reliability
10+ yrs exp Hybrid