The Principal AI/ML Operations Engineer role at a leading tech firm involves defining and implementing enterprise-level standards for ML-Ops and AIOps across the organization, ensuring models are deployed efficiently and governed with reliability and compliance. This senior position requires extensive experience in machine learning infrastructure and DevOps, with responsibilities including architecting scalable observability systems, managing CI/CD pipelines, and collaborating with data science teams to integrate AI solutions into existing workflows. The ideal candidate will have expertise in Python, Java, Scala, ML frameworks like TensorFlow and PyTorch, and orchestration tools such as Airflow and Kubeflow, along with a deep understanding of cloud ecosystems (GCP, AWS, Azure) and containerization technologies. They must also be proficient in observability stacks and governance frameworks for Responsible AI, ensuring secure deployment patterns and compliance reporting mechanisms are enforced.
Implement logging, metering, and auditing for agent behavior to ensure compliance alignment.
Architect end-to-end guardrails for AI agents including prompt injection protection and identity-aware routing.
What we're looking for
10+ years of experience in ML infrastructure and DevOps with 4+ years leading MLOps or AI Ops platforms.
Expertise in ML frameworks (TensorFlow, PyTorch) and orchestration tools (Airflow, Kubeflow).
Proven track record operating production pipelines for ML systems across cloud ecosystems like GCP, AWS, Azure.
Strong skills in CI/CD, IaC, DevSecOps, and observability stacks (Prometheus, Grafana).
Proficiency in scripting languages and containerization technologies for automation and infrastructure management.
Deep understanding of governance frameworks for Responsible AI, auditability, and cost metering.
Market check
Salary context
This
$257,000–$257,000
range sits above
83%
of similar postings on FindRole.
Peer median band
$170,000–$257,850
Median floor and ceiling across peers.
Typical midpoint (25–75%)
$167,652–$246,150
Middle half of comparable postings.
Based on 240 comparable postings.*
* 240 is the maximum number of comparable postings sampled.
Employer
About Blackline
BlackLine is a cloud-based financial operations management platform that automates and controls the financial close process for enterprises, including account reconciliation, journal entries, and financial reporting. Industry: Financial Technology & Accounting Software
Blackline currently has
12 open roles
on FindRole.
Listed pay typically runs
$193,000–$193,000
across 12 roles with salary data.
Python
PyTorch
TensorFlow
Keras
CUDA
Hugging Face
JAX
GPU
TPU
Data engineering
Feature engineering
A/B testing
Machine Learning
Deep Learning
Transfer learning
Scalable AI/ML systems
Data drift management
Model deployment
Production-grade services
Cross-functional collaboration