Safeguards Enforcement Analyst Jobs

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role: The Safeguards ML Infra team designs, builds, and operates the production infrastructure that powers Claude's safety systems. We own the critical backend services that ensure safety on the token generation path, and we own the operational work of getting those systems safely into production: standing up safeguards for every new model launch, and deploying new safety classifiers as they ship. Every frontier model release runs through this team – we configure, verify, and roll out safeguards across every platform Claude runs on (1P, AWS Bedrock, GCP Vertex, etc.), and we lead incident response when issues arise. This role sits at the center of that operational work. You'll ensure safeguards are properly configured and deployed for model launches and own the off-cycle deployment of new safety classifiers — canarying changes, verifying that the right safeguards are provably live on the right models, and holding rollback authority when something looks wrong. Every launch should also shrink the checklist, and the manual verifications should evolve into a system that runs itself. You'll turn launch runbooks into tooling, hand-built checks into continuous validation, and one-off deploys into a repeatable pipeline. We're looking for engineers with deep experience in production change management at scale — people who have owned deploy pipelines, config management systems, rollout safety, or launch readiness for systems under real production pressure. Familiarity with ML research or transformer architectures is not required — you will learn that on the job. What we prioritize is production judgment: a track record of shipping cha

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role We are looking for software engineers to help build safety and oversight mechanisms for our AI systems. As a software engineer on the Safeguards team, you will work to monitor models, prevent misuse, and support user well-being. This role focuses on the data foundations that make that work possible: the pipelines, stores, and governance controls that our detection, evaluation, and review systems are built on, deployed across AWS, GCP, and Azure. You will apply your technical skills to uphold our principles of safety, transparency, and oversight while enforcing our terms of service and acceptable use policies. The systems you build sit underneath decisions with real consequences for customers and for people affected by model misuse, and much of the data moving through them is sensitive. Correctness, retention discipline, and access control are core engineering requirements here rather than things bolted on afterward. You will also design for portability from the outset, because these systems run in customer-managed and third-party environments you do not fully control. Key responsibilities Build and operate the data platform that powers Safeguards, including ingestion and processing pipelines, warehouses and other data stores, and the schemas and interfaces that detection and review systems depend on Keep Safeguards systems running day to day and hold a high operational bar that serves both safety and customers, while reducing the manual effort needed to sustain it Own data governance and integrity, including retention and access controls, privacy-preserving handling of sensitive data, lineage, and correctness guarantees

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Anthropic's Safeguards team is seeking a Red Team Engineer to help ensure the safety of our deployed AI systems and products. In this role, you'll take an adversarial approach to uncover vulnerabilities across our product ecosystem before they can be exploited by malicious actors. Your work will span from technical infrastructure vulnerabilities on our products to emergent risks from advanced AI capabilities. While you'll bring best practices from traditional security approaches, the focus is on broader safety implications and novel abuse unique to advanced AI systems and associated products. You'll investigate the full spectrum of potential abuse — from coordinated account manipulation and payment fraud to novel exploitation of product features — and simulate sophisticated threat actors who chain multiple attack vectors to achieve their objectives. Key responsibilities Conduct comprehensive adversarial testing across Anthropic's product surfaces, developing creative attack scenarios that combine multiple exploitation techniques Research and implement novel testing approaches for emerging capabilities, including agent systems, tool use, and new interaction paradigms Design and execute "full kill chain" attacks that emulate real-world threat actors attempting to achieve specific malicious objectives Build and maintain systematic testing methodologies that evaluate every aspect of our systems Develop automated testing frameworks to enable continuous assessment at scale Collaborate with Product, Engineering, and Policy teams to translate findings into concrete improvements Help establish metrics for measuring detection eff

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role We are looking for software engineers to help build the foundational pieces for safety, oversight and intervention mechanisms of our AI systems. As a software engineer on the Safeguards team, you will work to monitor models, prevent misuse, and ensure user well-being. This role will focus on building systems to detect unwanted model behaviors and prevent disallowed use of models. You will apply your technical skills to uphold our principles of safety, transparency, and oversight. Responsibilities: Develop the foundational systems which power Safeguards, including infrastructure for data storage and management, metric and evaluation systems, and tooling for human and agentic review. Ensure the day-to-day running of Safeguards systems and hold a high operational bar which serves both safety and customers while reducing the amount of human intervention and oversight required. Build robust and reliable multi-layered defenses for real-time improvement of safety mechanisms that work at scale You may be a good fit if you have: Bachelor’s degree in Computer Science, Software Engineering or comparable professional experience Proficiency in Python Ability to work across the stack Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders Strong candidates may also: 7+ years of experience in a software engineering position Have experience building trust and safety, anti-spam, fraud or abuse detection and mitigation mechanisms and interventions for AI/ML systems Have experience building metrics and measurement systems or data and privacy management systems Have worked closely with op

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the Role We're seeking a strategic communications professional to join our team and drive messaging for Anthropic’s Safeguards (Trust & Safety) work, with a focus on making these critical topics accessible and meaningful for everyday users. In this role, you'll craft compelling narratives that resonate with media, policymakers, researchers, and the broader public that help differentiate Anthropic’s approach to building responsible AI. The ideal candidate is highly skilled and a creative storyteller with strong proactive and reactive muscle. This role will require working with technical teams to distill complex, technical information into engaging campaigns and editorial that resonate broadly. They should be able to move fast, think critically, and work collaboratively with a wide range of teams on complex issues. This is a unique opportunity to shape how one of the world's leading AI companies communicates about safety and responsible development of AI systems at a crucial moment in the industry. Responsibilities Develop and execute communication strategies that explain the work Anthropic’s Safeguards team is doing, with a particular emphasis on helping everyday users understand our safety measures Effectively plan for and manage crisis communications and provide counsel to a wide range of stakeholders on potential issues and risks Own the comms strategy for Anthropic’s product safety work including new model launches, product features alongside harm areas like child safety, well-being, and mental health Lead cross-functional communications projects that align that align safeguards, research, product, policy, and legal

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Design at Anthropic sits at the intersection of craft, research, and product intuition. We're a small team working on products that millions of people use daily—and on interactions that don't have established conventions yet. Our work shapes how people experience AI: whether Claude feels like a tool or a collaborator, whether it earns trust or erodes it. We partner closely with engineers and researchers, often designing around capabilities that are emerging in real-time. That means staying close to the models, prototyping rapidly, and being comfortable with ambiguity. We're looking for designers who ship fast and stay in motion—people who would rather get something in front of users this week than perfect it for a month. You're excited to question fundamental UI assumptions and invent patterns that feel native to AI, and you're already using tools like Claude Code to extend what you can build. You pay attention to where model capabilities are heading, not just what Claude can do today, and you find ways to keep caring about the pixels, the copy, and the edge cases while shipping quickly. Key responsibilities Collaborate with product managers, engineers, AI researchers and other stakeholders to define product vision, strategy and roadmaps, and play an active role in shipping. Understand the technical architecture of our products and define primitives for new capabilities. Define feature areas with exceptional attention to detail and polish, identifying opportunities to improve quality and consistency of broader flows Craft beautiful, polished, and delightful user interfaces that build trust and showcase the power of our

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Anthropic is dedicated to developing AI assistants that are helpful, harmless, and honest. As usage of our AI services grows, we need to ensure they are not misused. The Safeguards team is at the forefront of protecting our users from the risks of powerful AIs as well as ethical, technical, and social risks from the use of generative AI. The Safeguards team at Anthropic builds protections for new AI features enabled by the research teams and protects new products and surfaces developed by our product teams. As a Product Manager for the Safeguards team at Anthropic, you will own the ideation, design, development and deployment of Safeguards systems and relevant product UX to ensure we are advancing frontier models safely to users across various cloud platforms. You will work closely with our research and product teams to develop detections, evals, interventions, and tools to measure and mitigate deployment and user risks. We are looking for a product manager who is deeply committed to making AI safe and beneficial for humanity. You are aware of the risks and are committed to working with experts and coming up with ideas for Anthropic to implement. You have deep technical expertise in development, deployment and measurement of Safeguards systems. You thrive in rapidly moving and ambiguous environments. Responsibilities Determine how to build in safety by design upstream and leverage downstream defenses for Anthropic’s frontier models, AI products, customers on different surfaces - Claude.ai, 1P API, external Cloud providers. Ability to write safety evals and communicate externally about saf

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Anthropic is dedicated to developing AI assistants that are helpful, harmless, and honest. As usage of our AI services grows, we need to ensure they are not misused. The Safeguards team is at the forefront of protecting our users from the risks of powerful AIs as well as ethical, technical, and social risks from the use of generative AI. The Safeguards team at Anthropic builds protections for new AI features enabled by the research teams and protects new products and surfaces developed by our product teams. As a Product Manager for the Safeguards team at Anthropic, you will own the ideation, design, development and deployment of Safeguards systems and relevant product UX to ensure we are advancing frontier models safely to users across various cloud platforms. You will work closely with our research and product teams to develop detections, evals, interventions, and tools to measure and mitigate deployment and user risks. We are looking for a product manager who is deeply committed to making AI safe and beneficial for humanity. You are aware of the risks and are committed to working with experts and coming up with ideas for Anthropic to implement. You have deep technical expertise in development, deployment and measurement of Safeguards systems. You thrive in rapidly moving and ambiguous environments. Responsibilities Determine how to build in safety by design upstream and leverage downstream defenses for Anthropic’s frontier models, AI products, customers on different surfaces - Claude.ai, 1P API, external Cloud providers. Ability to write safety evals and communicate externally about saf

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Anthropic's Safeguards team builds the systems that detect and mitigate misuse of our AI models, from individual policy violations to sophisticated, coordinated attacks. A growing part of that work depends on lightweight detection methods trained on model internals, which let us identify harmful behavior cheaply and at scale. This work feeds directly into Anthropic's Responsible Scaling Policy commitments. We're looking for an engineer to own the infrastructure behind that research. This is the tooling our researchers rely on to run experiments, train detection methods, and select detections for launch. It sits between research and production: researchers depend on it for fast iteration, and our detection systems depend on it for reliable, correct results as our models continue to change. Running machine learning workloads at our scale often requires solving novel systems problems. You'll identify those problems and build the abstractions, pipelines, and tooling that keep the research loop fast as requirements shift underneath you. Strong candidates will have a track record of solving large-scale systems and data problems and will be excited to grow deep machine learning expertise alongside it. Key responsibilities Build and scale the infrastructure and data pipelines behind Safeguards machine learning research Own the training, evaluation, and scoring workflows researchers use, with a focus on cutting the time between an idea and a result Design tooling and interfaces, including libraries and command line tools, that researchers can use directly without needing to understand the systems underneath Build correctness and

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Anthropic is dedicated to developing AI assistants that are helpful, harmless, and honest. As usage of our AI services grows, we need to ensure they are not misused. The Safeguards team is at the forefront of protecting our users from the risks of powerful AIs as well as ethical, technical, and social risks from the use of generative AI. The Safeguards team at Anthropic builds protections for new AI features enabled by the research teams and protects new products and surfaces developed by our product teams. As a Product Manager for the Safeguards team at Anthropic, you will own the ideation, design, development and deployment of Safeguards systems and relevant product UX to ensure we are advancing frontier models safely to users across various cloud platforms. You will work closely with our research and product teams to develop detections, evals, interventions, and tools to measure and mitigate deployment and user risks. We are looking for a product manager who is deeply committed to making AI safe and beneficial for humanity. You are aware of the risks and are committed to working with experts and coming up with ideas for Anthropic to implement. You have deep technical expertise in development, deployment and measurement of Safeguards systems. You thrive in rapidly moving and ambiguous environments. Responsibilities: Determine how to build in safety by design upstream and leverage downstream defenses for Anthropic’s frontier models, AI products, customers on different surfaces - Claude.ai, 1P API, external Cloud providers. Ability to write safety evals and communicate externally about safety. Dr

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the Role Safeguards Engineering builds and operates the infrastructure that keeps Anthropic's AI systems safe in production — the classifiers, detection pipelines, evaluation platforms, and monitoring systems that sit between our models and the real world. That infrastructure needs to be not just correct, but reliable : when a safety-critical pipeline goes down or degrades, the consequences can be serious, and they can be invisible until someone looks closely. As a Technical Program Manager for Safeguards Infrastructure and Evals, you'll own the operational health and forward momentum of this stack. Your primary responsibility is driving reliability — owning the incident-response and post-mortem process, ensuring SLOs are defined and met in partnership with various teams, and making sure that when things go wrong, the right people know, the right actions get taken, and those actions actually get closed out. Alongside that ongoing operational rhythm, you'll coordinate the larger platform investments: migrations, eval-platform improvements, and the cross-team dependencies that connect them. This role sits at the intersection of operations and program management. It requires genuine technical depth — you need to understand how these systems work well enough to triage effectively, judge what's actually safety-critical versus what can wait, and have informed conversations with the engineers building and maintaining them. But the core of the job is keeping the machine running well and the work moving. What You'll Do: Own the Safeguards Engineering ops review - Drive the recurring cadence that keeps the team informed and coordinated: s

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Anthropic is dedicated to developing AI assistants that are helpful, harmless, and honest. As usage of our AI services grows, we need to ensure they are not misused. The Safeguards team is at the forefront of protecting our users from the risks of powerful AIs as well as ethical, technical, and social risks from the use of generative AI. The Safeguards team at Anthropic builds protections for new AI features enabled by the research teams and protects new products and surfaces developed by our product teams. As a Product Manager for the Safeguards team at Anthropic, you will own the ideation, design, development and deployment of Safeguards systems and relevant product UX to ensure we are advancing frontier models safely to users across various cloud platforms. You will work closely with our research and product teams to develop detections, evals, interventions, and tools to measure and mitigate deployment and user risks. We are looking for a product manager who is deeply committed to making AI safe and beneficial for humanity. You are aware of the risks and are committed to working with experts and coming up with ideas for Anthropic to implement. You have deep technical expertise in development, deployment and measurement of Safeguards systems. You thrive in rapidly moving and ambiguous environments. Responsibilities: Determine how to build in safety by design upstream and leverage downstream defenses for Anthropic’s frontier models, AI products, customers on different surfaces - Claude.ai, 1P API, external Cloud providers. Ability to write safety evals and communicate externally about safety. Dr

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role We are looking for ML Engineers and Research Engineers to help detect and mitigate misuse of our AI systems. As a member of the Safeguards ML team, you will build systems that identify harmful use—from individual policy violations to sophisticated, coordinated attacks—and develop defenses that keep our products safe as capabilities advance. You will also work on systems that protect user wellbeing and ensure our models behave appropriately across a wide range of contexts. This work feeds directly into Anthropic's Responsible Scaling Policy commitments. Responsibilities Develop classifiers to detect misuse and anomalous behavior at scale. This includes developing synthetic data pipelines for training classifiers and methods to automatically source representative evaluations to iterate on Build systems to monitor for harms that span multiple exchanges, such as coordinated cyber attacks and influence operations, and develop new methods for aggregating and analyzing signals across contexts Evaluate and improve the safety of agentic products—developing both threat models and environments to test for agentic risks, and developing and deploying mitigations for prompt injection attacks Conduct research on automated red-teaming, adversarial robustness, and other research that helps test for or find misuse You may be a good fit if you Have 4+ years of experience in ML engineering, research engineering, or applied research, in academia or industry Have proficiency in Python and experience building ML systems Are comfortable working across the research-to-deployment pipeline, from exploratory experiments to production systems Are w

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role The Account Abuse team is tasked with ensuring Anthropic's computing capacity is allocated fairly, minimizing resources available to bad actors and preventing them from coming back. As a software engineer on this team, you will build the machine learning systems that help us detect and stop abuse at scale. The ideal candidate can see things from opponents' perspectives, understand their means and motives, and anticipate their responses to countermeasures. We're looking for full stack machine learning engineers with experience across model training, productionization, and evaluation. You'll also look for ways to use Claude to speed up how these models get built and maintained. This is classical ML on structured and behavioral data. You do not need a deep learning background or knowledge of LLM internals. What matters is that you have trained and shipped models where the stakes are real, and that you care about building robust production systems as much as the model itself. A false positive here is a legitimate customer locked out, so measurement, precision, and safe rollout are part of the job. Key responsibilities Build and operate a feature computation platform that serves both model training and real-time scoring, with point-in-time correct training data and low-latency online retrieval Train, evaluate, and deploy models that detect account-level abuse and fraud, running them both offline and online Build tooling that automates more of the model development lifecycle, including using Claude to speed up feature development, training, and evaluation Make backtesting, shadow deployment, and staged rollout the default pat

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role: The Safeguards ML Inference Path team designs, builds, and operates the production infrastructure that powers Claude's ML based safety systems. We collaborate closely with safety researchers and inference engineers to bring new classifiers and novel classes of ML defenses to production. We own the research → production transfer of new safety technologies that is on the critical path for every Claude model launch. And we build for scale: serving thousands of ML classifiers, for all requests on the token generation path, and for every platform Claude runs on -- 1P, Bedrock, Vertex, and beyond. We’re growing the team and looking for engineers who have deep expertise in productionizing ML systems. You'll work at the intersection of machine learning, large-scale distributed systems, and AI safety, developing the platforms and tools that enable our safeguards to operate reliably at scale. And your tooling and infrastructure will be used for every model launch, which are becoming more complex, and more frequent. Responsibilities: Design and build scalable ML infrastructure to support real-time safety deployments across our classifier and model ecosystem Build monitoring and observability tools to track classifier performance, data quality, and system health for safety-critical applications Collaborate with research teams to productionize safety research, translating experimental safety techniques into robust, scalable systems Optimize inference latency and throughput for real-time safety evaluations while maintaining high reliability standards Implement automated testing, deployment, and rollback systems for ML models in prod