Responsible Content Analyst

What you'll do

• Investigate emerging abuse patterns and safety risks across Microsoft AI products, specifically focusing on cyber-based misuse.
• Identify malicious activities such as phishing, malware, credential abuse, and attempts to circumvent safety controls.
• Adjudicate user prompts and model outputs using established Responsible AI policies and Cyber Safety guidelines.
• Analyze operational data to identify trends and support evidence-based enforcement or mitigation decisions.
• Document emerging abuse behaviors, tactics, and techniques involving generative AI for internal reporting.
• Develop and refine moderation guidelines, safety taxonomies, and evaluation datasets to improve system accuracy.
• Translate investigative findings into actionable recommendations for engineering teams to improve model safeguards and detection.
• Manage high-risk escalations, customer appeals, and complex incidents involving potential AI policy violations.

What we're looking for

• A Bachelor's degree in a relevant field is required with 3 years of experience handling sensitive content or situations.
• A High School Diploma is acceptable if accompanied by at least 5 years of experience in roles involving privacy and sensitive content.
• Candidates must be able to pass the Microsoft Cloud background check every two years.
• Experience investigating cyber threats, including phishing, malware, credential abuse, and MITRE ATT&CK techniques, is preferred.
• Proficiency in analyzing data using tools such as SQL, Kusto Query Language (KQL), Python, or Power BI is preferred.
• Experience in trust and safety, content moderation, threat intelligence, or incident response is preferred.
• Ability to evaluate multimodal content and develop operational guidelines for AI safety and abuse detection is preferred.
• Strong communication skills are required to document investigations and present findings to both technical and non-technical audiences.