This listing doesn't post a salary. Most similar roles pay
$172,987–$246,150.
Based on 240 similar postings.
Employer
About Coalition
Coalition is a cyber insurance and security company that combines comprehensive cyber insurance coverage with active risk management tools to help organizations prevent and respond to cyber incidents. Industry: Cyber Insurance & Risk Management
Coalition currently has
21 open roles
on FindRole.
Senior Manager, Machine Learning (Data Operations) joins the product team to ensure high-quality training data for machine learning models. This role serves as the primary point of accountability for labeling quality and methodology, where you will design annotation tasks, define quality frameworks, and manage the Label Studio platform. You will collaborate with ML engineers and product managers to translate model requirements into structured tasks while overseeing outsourced vendors to meet accuracy and throughput targets. Key responsibilities include establishing gold standard datasets, managing inter-annotator agreement, and tracking operational metrics like cost per label. The ideal candidate possesses expertise in annotation quality frameworks, experience with tools like Label Studio or Scale AI, and proficiency in Python and SQL. This role addresses the critical challenge of ensuring labeled data is accurate, consistent, and fit for purpose to power production models.
Python
Machine Learning
SQL
NLP
Data Science
Statistical Modeling
Deep Learning
A/B Testing
Data Mining
Cloud Platforms
Data Lakes
Relational Databases
Information Retrieval
Sentiment Analysis
Topic Modeling
Classification
Data Engineering