Reddit

What you'll do

• Own Automated Enforcement Quality: Diagnose underperformance and make go/no-go decisions for AI models.
• Translate Policy Into Models: Craft prompts, define evaluation criteria, and curate datasets to teach models policy intent.
• Guide Model Evolution: Monitor enforcement performance, identifying concept drift and recommending retraining or updates.
• Surface Blind Spots: Develop monitoring strategies for niche communities and emerging behaviors to ensure comprehensive coverage.
• Safeguard Model Integrity: Flag risks, escalate incidents, and recommend rollbacks when automated systems fall below quality thresholds.

What we're looking for

• 5-7+ years of experience in Trust & Safety operations.
• Strong AI literacy with deep understanding of LLM-based and classifier-driven systems.
• Experience translating policy into model behavior through prompts, evaluations, and datasets.
• Familiarity with AI safety concepts like evaluation design, data quality, and continuous improvement.
• Ability to bridge technical discussions with ML partners and strategic alignment with Policy leaders.
• Hands-on experience in content moderation, scaled enforcement programs, and real-time incident response.