Senior Machine Learning Test Engineer

Autodesk

Remote Hybrid Actively hiring
Remote · Boston, MA Posted 15 days ago

At a glance

AI generated

TL;DR

As a Senior Machine Learning Test Engineer in the Research Enablement team at Autodesk, you will collaborate closely with researchers, ML developers, and software engineers to establish and enforce quality standards for machine learning systems. Your daily tasks include defining ML quality strategies, designing evaluation suites, automating QA workflows using Python and CI/CD tools like GitHub Actions, and creating test harnesses for ML services and APIs. You will also mentor teams on best practices and contribute to multi-team projects, ensuring code quality and consistency through participation in code reviews. The role requires strong programming skills in Python, experience with CAD software, and proficiency in automation and UAT frameworks. Ideal candidates are familiar with ML frameworks like PyTorch or TensorFlow, CI/CD tools, data pipelines, and MLOps practices, and have a passion for continuous learning and improvement.

Skills

Python CI/CD GitHub Actions Jenkins PyTorch TensorFlow Great Expectations Airflow Metaflow Comet MLflow Weights & Biases AWS Azure Google Cloud Platform

What you'll do

  • Define ML quality strategy and acceptance criteria across data, model, and system levels.
  • Design and maintain evaluation suites, metrics, and test datasets for ML models.
  • Evaluate CAD RL model outputs for geometric validity and policy stability.
  • Automate ML QA workflows using Python and CI/CD tools like GitHub Actions.
  • Create and maintain test harnesses for ML services and APIs to ensure quality.
  • Build quality gates for training and deployment pipelines with regression checks.
  • Mentor teams on ML QA best practices and consistent evaluation standards.

What we're looking for

  • 7+ years of professional experience in software engineering or QA for ML/AI systems
  • Strong programming skills in Python and experience in test automation
  • Proficient in designing and maintaining QA frameworks used by multiple teams
  • Familiarity with popular CAD environments tooling and MLOps practices
  • Excellent problem-solving skills, attention to detail, and strong communication abilities
  • Experience with CI/CD tools and processes for automating ML QA workflows
  • Understanding of software architecture and design patterns in an agile environment

Market check

Salary context

This listing doesn't show a salary. Similar roles on FindRole typically pay $160,500–$241,500.

Peer median band

$160,500$241,500

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$176,721$241,675

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Autodesk

Autodesk is a global leader in 3D design, engineering, and entertainment software, enabling users to imagine, design, and create a better world.

Autodesk currently has 34 open roles on FindRole.

Listed pay typically runs $139,000–$249,260 across 32 roles with salary data.

Most-posted roles

View all roles at Autodesk

More like this

Similar roles

Senior Staff Machine Learning Engineer

Intuit

Mountain View, California, US 43 days ago $214,000$289,500
AWS GCP TensorFlow PyTorch Spark Kubernetes MLflow RAG LLM CI/CD MLOps Python Docker Prometheus PostgreSQL

Senior Machine Learning Engineer

Adobe

San Francisco, US 43 days ago $211,800$306,625
Python PyTorch TensorFlow Machine_Learning Deep_Learning Data_Science CI/CD Mentorship Collaboration Research_and_Development Product_Integration Cross_Functional_Teams

Senior Machine Learning Engineer

Adobe

San Francisco, US 43 days ago $211,800$306,625
Python PyTorch TensorFlow Machine_Learning Deep_Learning CI/CD MLOps Data_Science Collaboration_Tools Version_Control_Systems Cloud_Platforms API_Development Database_Management Model_Evaluation Technical_Guidance

Senior Machine Learning Engineer

Clover Health

Remote (US) 28 days ago $150,000$200,000
Python numpy pandas sklearn tensorflow pytorch Natural-Language-Processing LLMs Docker Kubernetes CI/CD PostgreSQL MLOps
Remote

Senior Machine Learning Engineer

CVS Health

Remote (Wellesley-93 Worcester St, US) 28 days ago $111,240$222,480
Python PyTorch TensorFlow Kubeflow Vertex SQL Snowflake BigQuery CI/CD MLOps Reinforcement_Learning Causal_Inference LLM MCP Node.js React Spark Kafka Airflow
Remote

Senior Machine Learning Engineer

Capital One Financial

Mclean, Va, US 15 days ago $147,100$167,900
Python Scala Java scikit-learn PyTorch Dask Spark TensorFlow distributed computing data gathering data preparation distributed file systems multi-node database paradigms open source ML software CI/CD