Anthropic is developing AI assistants that are helpful, harmless, and honest. As usage of our AI services grows, we need to ensure they are not misused. We're looking for an experienced engineering leader to build out a team focused on detecting abuse, fraud, and harmful content.

Responsibilities:

Lead a team of engineers building systems to detect and prevent harm and abuse using Anthropic's AI services
Implement systems to detect fraudulent accounts, spam campaigns, harmful user generated content, and other malicious usage
Analyze usage patterns and develop protections against new methods of attack and evasion
Work closely with data scientists to develop algorithms and signals for detecting threats
Build self-service tools for customers to monitor and control access to AI services
Design our process for responding to detected signals, including communicating threats and remedies across the organization
Coach and mentor team members in their career growth

You may be a good fit if you:

Have 5+ years in an engineering management role, leading teams building integrity, trust and safety, or anti-fraud/abuse systems
Have deep experience with techniques for bot detection, account fraud, misinformation, and/or harmful user-generated content
Have the ability to balance speed and precision when responding to attacks and evaluating risk
Have excellent communication skills to explain threats and tradeoffs to stakeholders
Have people management skills in coaching, recruiting, and developing engineers
Have experience designing operational processes around on-call, post-mortems, etc.

Strong candidates may also:

Have a background in building systems at scale with a focus on reliability and performance
Have experience with AI/ML and understanding how models can be manipulated
Have knowledge of common internet communities, and adversaries like spammers, fraud rings, and their evolving techniques
Use technical depth to assess and improve system designs
Have project management skills to balance priority tradeoffs

Anthropic

Engineering Manager, Detection

SF or NY (Hybrid)$300K - $500Kfull-time