Staff II Software Engineer, AI/ML Ops

Blackline

Confirmed live today High trust
Hybrid

Quick summary

Work type
Hybrid
Location
Pleasanton, CANew York, NYLos Angeles, CA
Salary
$245,000–$307,000 / yr
Employment
Full-time
Posted
106 days ago
Freshness
Confirmed live today

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $190k
This role $276k
$123k $327k
below market most similar roles pay here above market

This role pays more than 97% of similar roles. Most pay $165,000–$214,500 — the blue band above. At the midpoint, this role pays about $276k versus about $190k for comparable roles.

Based on 240 similar postings.

Employer

About Blackline

BlackLine is a cloud-based financial operations management platform that automates and controls the financial close process for enterprises, including account reconciliation, journal entries, and financial reporting. Industry: Financial Technology & Accounting Software

Blackline currently has 12 open roles on FindRole.

Listed pay typically runs $175,000–$219,500 across 8 roles with salary data.

Most-posted roles

View all roles at Blackline

At a glance

TL;DR · Staff II Software Engineer, AI/ML Ops

The Staff II Software Engineer AI/ML Ops will join the team to design, build, and optimize data pipelines powering next-generation AI-driven accounting agents. You will lead the development of scalable, high-performance data infrastructure, managing PySpark ETL pipelines and integrating client data sources via APIs like FiveTran and Plaid. Key responsibilities include architecting model registries, feature stores, and CI/CD pipelines for LLM agent deployment. You will manage training infrastructure, including GPU/TPU resource allocation, and implement observability stacks using Prometheus and Grafana. Required technical skills include Python, Java, or Scala, along with expertise in TensorFlow, PyTorch, and orchestration tools like Kubeflow and MLflow. You will solve complex problems regarding agentic runtime environments, prompt injection protection, and automated retraining triggers within a cloud-native ecosystem.

What does a Software Engineer earn in California?

Median $214500 from 1167 postings across 73 companies.

See salary data

What you'll do

  • Build and maintain high-performance PySpark ETL pipelines to power AI-driven accounting agents.
  • Establish robust data connections using APIs and tools like FiveTran, Plaid, and internal connectors.
  • Architect and manage model registries and feature stores to support version tracking and reproducibility.
  • Design and manage training infrastructure including distributed orchestration and GPU/TPU resource allocation.
  • Build CI/CD pipelines to automate LLM agent deployment, policy validation, and prompt evaluation.
  • Implement observability systems to track conversation outcomes, factual accuracy, latency, and safety events.
  • Architect end-to-end guardrails for AI agents including prompt injection protection and tool authorization.
  • Develop automation scripts and orchestration systems to streamline the end-to-end machine learning lifecycle.

What we're looking for

  • Bachelor's or Master's degree in Computer Science, Machine Learning, Data Science, or a related field.
  • Strong programming skills in languages such as Python, Java, or Scala.
  • Expertise in ML frameworks (TensorFlow, PyTorch, scikit-learn) and orchestration tools (Airflow, Kubeflow, Vertex AI, MLflow).
  • Proven experience operating production pipelines for ML and LLM-based systems across cloud ecosystems (GCP, AWS, Azure).
  • Deep familiarity with LangChain, LangGraph, ADK or similar agentic system runtime management.
  • Strong competencies in CI/CD, IaC, and DevSecOps pipelines integrating testing, compliance, and deployment automation.
  • Hands-on experience with observability stacks (Prometheus, Grafana, Newrelic) for model and agent performance tracking.
  • Proficiency in containerization technologies such as Docker and Kubernetes.

More like this

Similar roles

Senior Software Engineer AI

Blackline

Pleasanton, CA +2 106 days ago
Python PySpark TensorFlow PyTorch scikit-learn Kubernetes Docker MLflow Kubeflow Airflow Vertex AI LangChain LangGraph AWS GCP Azure CI/CD Prometheus Grafana Newrelic Java Scala Bash Fivetran Plaid CDC IaC
Hybrid

Senior Machine Learning Engineer

Cloudflare, Inc

Austin, TX 124 days ago
Python PyTorch TensorFlow Scikit-Learn LangChain LangGraph Autogen RAG LLMOps Docker Kubernetes Terraform AWS GCP Azure BigQuery FastAPI TypeScript React Airflow Argo Workflows ArgoCD CI/CD Pytest
3+ yrs exp Hybrid

Staff AI/ML Engineer

Chime

San Francisco, CA 19 days ago $246,000–$340,000
Python SQL PyTorch AWS SageMaker Spark PySpark Snowflake Kafka Redis Airflow MLOps Deep Learning Real-time Inference

Staff Software Engineer, Applied AI

Apple Inc

Cupertino, CA 47 days ago $194,600–$293,900
LLM Python Go Java RAG PostgreSQL Snowflake SQL ETL HTTP APIs Model Monitoring Prompt Optimization ML Workflows Data Warehouse
10+ yrs exp

Staff I Software Engineer

Blackline

Pleasanton +1 106 days ago $180,000–$226,000
C# Java C++ AWS Azure GCP SQL No-SQL Kafka RabbitMQ RESTful APIs Microservices Infrastructure as Code event driven architecture ETL Data Modeling Workflow Orchestration Identity Management API Gateway
6+ yrs exp Hybrid

Staff Software Engineer, Backed/ML

Walmart

Bellevue, WA +1 75 days ago $132,000–$264,000
AI ML Cloud-Native Architecture CI/CD Android SDK Observability Web Front End Back End System Design Reliability Engineering WCAG) 2.2 AA
4+ yrs exp