Trust And Safety Specialist Jobs

Discord has a highly engaged community of millions of daily active users who use the platform for many different reasons, but there’s one thing that nearly everyone does: play video games. Discord plays a uniquely important role in the future of gaming, and we are focused on…

About the role As a Safeguards Enforcement Analyst on the account abuse team, you'll build and execute enforcement workflows that keep our products safe, with a focus on detecting and mitigating potential harm. Your initial focus will be account compromise: Anth

Safeguards Enforcement Analyst, Access Controls & Identity at Anthropic in Ca New York City, NY | Washington. $285K – $330K/yr.

About the role As an Enforcement Analyst focused on Bio Harms, you will play a critical role in protecting against the misuse of AI systems for biological and related CBRNE harms. You will enforce our Usage Policy with a specific focus on detecting and mitigatin

About the role As an Enforcement Analyst focused on Chem & Explosives Harms, you will play a critical role in protecting against the misuse of AI systems for chemical and explosives harms. You will enforce our Usage Policy with a specific focus on detecting and

About the role As a Safeguards Enforcement Analyst on the user well-being team, you'll build and execute enforcement workflows that keep our products safe, with a focus on detecting and mitigating potential harm. Your initial focus will be on how Anthropic handl

About the role As an Enforcement Analyst, you will be responsible for reviewing content and executing enforcement actions across our products and services, with a focus on detecting and mitigating attempts to misuse Anthropic's AI systems for malicious cyber ope

About the role As a Safeguards Analyst focusing on Integrity & Authenticity, you will be responsible for building and executing enforcement workflows for our products and services, with a focus on detecting and mitigating attempts to misuse Anthropic's AI system

About the role We are looking for a threat intel manager to build and run our Model Exploitation & Fraud team within Threat Intelligence. This team detects, investigates, and disrupts the large-scale exploitation of Anthropic's AI systems. Model distillation, un

About the role We are looking for a threat intel manager to build and run our CBRN-E & Advanced Weapons team within Threat Intelligence. This team detects, investigates, and disrupts attempts to misuse Anthropic's AI systems for chemical, biological, radiologica

About the role The Safeguards team is responsible for ensuring our models and products are developed and deployed safely. We're looking for an Engineering Manager to lead our Review Tooling team, which builds the systems that humans — and increasingly Claude — u

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and…

About the role The Account Abuse team is tasked with ensuring Anthropic’s computing capacity is allocated fairly, minimizing resources available to bad actors and preventing them from coming back. As a software engineer on this team, you will build systems that

About the Role We are looking for a Threat Intelligence Engineer to join our Threat Intelligence team. In this role, you will build the infrastructure that powers our threat discovery capabilities—integrating external data sources, developing detection systems f

Join us in building the future of finance. Our mission is to democratize finance for all. An estimated $124 trillion of assets will be inherited by younger generations in the next two decades. The largest transfer of wealth in human history. If you’re ready to be at the…