Staff+ Software Engineer, Safeguards

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role We are looking for software engineers to help build safety and oversight mechanisms for our AI systems. As a software engineer on the Safeguards team, you will work to monitor models, prevent misuse, and support user well-being. This role focuses on the data foundations that make that work possible: the pipelines, stores, and governance controls that our detection, evaluation, and review systems are built on, deployed across AWS, GCP, and Azure. You will apply your technical skills to uphold our principles of safety, transparency, and oversight while enforcing our terms of service and acceptable use policies. The systems you build sit underneath decisions with real consequences for customers and for people affected by model misuse, and much of the data moving through them is sensitive. Correctness, retention discipline, and access control are core engineering requirements here rather than things bolted on afterward. You will also design for portability from the outset, because these systems run in customer-managed and third-party environments you do not fully control. Key responsibilities Build and operate the data platform that powers Safeguards, including ingestion and processing pipelines, warehouses and other data stores, and the schemas and interfaces that detection and review systems depend on Keep Safeguards systems running day to day and hold a high operational bar that serves both safety and customers, while reducing the manual effort needed to sustain it Own data governance and integrity, including retention and access controls, privacy-preserving handling of sensitive data, lineage, and correctness guarantees

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role We are looking for software engineers to help build the foundational pieces for safety, oversight and intervention mechanisms of our AI systems. As a software engineer on the Safeguards team, you will work to monitor models, prevent misuse, and ensure user well-being. This role will focus on building systems to detect unwanted model behaviors and prevent disallowed use of models. You will apply your technical skills to uphold our principles of safety, transparency, and oversight. Responsibilities: Develop the foundational systems which power Safeguards, including infrastructure for data storage and management, metric and evaluation systems, and tooling for human and agentic review. Ensure the day-to-day running of Safeguards systems and hold a high operational bar which serves both safety and customers while reducing the amount of human intervention and oversight required. Build robust and reliable multi-layered defenses for real-time improvement of safety mechanisms that work at scale You may be a good fit if you have: Bachelor’s degree in Computer Science, Software Engineering or comparable professional experience Proficiency in Python Ability to work across the stack Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders Strong candidates may also: 7+ years of experience in a software engineering position Have experience building trust and safety, anti-spam, fraud or abuse detection and mitigation mechanisms and interventions for AI/ML systems Have experience building metrics and measurement systems or data and privacy management systems Have worked closely with op

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role: The Safeguards ML Sampling Path team builds and operates the production services that power Claude's safety systems. These services sit on the token generation path across every platform Claude runs on: every request must pass through them, and each millisecond of added latency is wait time for our users. You’ll keep p99 latency flat as traffic grows, build for robustness as dependencies time out or partially fail, and ship changes safely to a system that cannot go down. What you'll do: Design, build, and operate the backend systems that process every token on the generation path for Claude requests, including the streaming contract with the API and inference engines. Own latency and reliability end to end: define and maintain SLOs and error budgets for added latency, time-to-first-token, and availability, and lead incident response and postmortem follow-through. Ship changes to the hot path rapidly but safely — canaried and gradual rollouts, error budget and latency gating, fast rollbacks — and drive per-token performance: chase tail latency and keep cost flat as traffic, models, and checks per request grow. Set technical direction for the sampling path: lead design reviews, make latency, reliability, and cost trade-off calls with the inference and research teams, mentor engineers, and raise the operational bar for the wider Safeguards organization. You may be a good fit if you: Have designed, built, and operated high QPS systems at global scale, and were accountable for them in production: incident response, outages, and postmortem-driven remediation. Have a strong foundation in distributed systems: replication, cons

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role We are looking for software engineers to help build safety and oversight mechanisms for our AI systems. As a software engineer on the Safeguards team, you will work to monitor models, prevent misuse, and ensure user well-being. This role will focus on building distributed and scalable systems to detect unwanted model behaviors and prevent disallowed use of models. You will apply your technical skills to uphold our principles of safety, transparency, and oversight while enforcing our terms of service and acceptable use policies. Responsibilities: Independently scope and lead complex, multi-month infrastructure projects, from an ambiguous starting point through to a production system Develop monitoring systems to detect unwanted behaviors from our API partners and potentially take automated enforcement actions; surface these in internal dashboards to analysts for manual review Stand up and run deployments of those monitoring systems across multiple clouds, including inside cloud-provider partner environments where data residency laws apply. Keep the deployments consistent through shared deployment pipelines, smoke tests, observability, and alerting Design and harden the sandboxed runtime that AI agents execute in: isolation, network egress controls, least-privilege data access, audit logging, and insider-risk controls Manage cost and capacity for large volumes of long-running agent work, and set and meet service-level objectives for the platform Partner with the engineers and researchers who write and evaluate the monitoring agents, and with security, privacy, and legal teams, so new detection work can ship quickly on a p

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role: The Safeguards ML Inference Path team designs, builds, and operates the production infrastructure that powers Claude's ML based safety systems. We collaborate closely with safety researchers and inference engineers to bring new classifiers and novel classes of ML defenses to production. We own the research → production transfer of new safety technologies that is on the critical path for every Claude model launch. And we build for scale: serving thousands of ML classifiers, for all requests on the token generation path, and for every platform Claude runs on -- 1P, Bedrock, Vertex, and beyond. We’re growing the team and looking for engineers who have deep expertise in productionizing ML systems. You'll work at the intersection of machine learning, large-scale distributed systems, and AI safety, developing the platforms and tools that enable our safeguards to operate reliably at scale. And your tooling and infrastructure will be used for every model launch, which are becoming more complex, and more frequent. Responsibilities: Design and build scalable ML infrastructure to support real-time safety deployments across our classifier and model ecosystem Build monitoring and observability tools to track classifier performance, data quality, and system health for safety-critical applications Collaborate with research teams to productionize safety research, translating experimental safety techniques into robust, scalable systems Optimize inference latency and throughput for real-time safety evaluations while maintaining high reliability standards Implement automated testing, deployment, and rollback systems for ML models in prod

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Anthropic is bringing Claude to the U.S. government and allied democracies, and we’re looking for startup-minded engineers to grow our public sector engineering team. This is a small team with large surface area. You’ll work across the stack to take products from 0 to 1 and beyond. We are looking for product- and civic-minded engineers with a track record of building and scaling great products. The opportunities outpace our ability to build them all, so the right candidate thrives on sharp judgment, prioritization, and focus. You’ll own work like: Building Claude products that can be used by customers in highly regulated environments Deploying Claude into government networks Understanding and improving Claude’s usefulness in common government workflows – for example, policy research, benefits administration, intelligence analysis Scaling and innovating Claude for Government, our existing product serving U.S. government customers today Our team is filling a number of roles and is open to candidates with either full-stack or backend experience. Key responsibilities Architect and ship deployments that meet public sector compliance and security requirements, from FedRAMP to classified networks Build AI applications tailored to government workflows by developing deep understanding of how agencies actually operate Partner with research and safeguards teams to evaluate and improve Claude for government use cases Work directly with government customers and internal go-to-market teams to turn requirements into technical and product roadmaps Design scalable systems for deployment, user management, and administrative control