Safeguards Enforcement Analyst Jobs

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role: The Safeguards ML Sampling Path team builds and operates the production services that power Claude's safety systems. These services sit on the token generation path across every platform Claude runs on: every request must pass through them, and each millisecond of added latency is wait time for our users. You’ll keep p99 latency flat as traffic grows, build for robustness as dependencies time out or partially fail, and ship changes safely to a system that cannot go down. What you'll do: Design, build, and operate the backend systems that process every token on the generation path for Claude requests, including the streaming contract with the API and inference engines. Own latency and reliability end to end: define and maintain SLOs and error budgets for added latency, time-to-first-token, and availability, and lead incident response and postmortem follow-through. Ship changes to the hot path rapidly but safely — canaried and gradual rollouts, error budget and latency gating, fast rollbacks — and drive per-token performance: chase tail latency and keep cost flat as traffic, models, and checks per request grow. Set technical direction for the sampling path: lead design reviews, make latency, reliability, and cost trade-off calls with the inference and research teams, mentor engineers, and raise the operational bar for the wider Safeguards organization. You may be a good fit if you: Have designed, built, and operated high QPS systems at global scale, and were accountable for them in production: incident response, outages, and postmortem-driven remediation. Have a strong foundation in distributed systems: replication, cons

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role We're hiring Cyber Evaluations Engineers to build and run the evaluations that measure cyber-relevant capabilities and safeguard robustness in our models. You'll design new evals, run per-release robustness testing, and dig into data on jailbreaks and prompt bypasses to understand where our safeguards hold up and where they don't. You'll also design many of the probes that detect cyber abuse in production and help shape the overall detection architecture alongside the policy team. Key responsibilities Design and run capability, uplift, and safety evaluations to assess cyber-relevant risk in new models Execute per-release safeguard-robustness testing ahead of major model launches Analyze evaluation results and communicate findings clearly to the team and to stakeholders Design, prototype, and tune detection probes for cyber misuse Work with the cyber policy team to turn policy lines into a layered, robust abuse-detection architecture, and measure its precision and coverage over time Build and maintain internal tooling used to run and score evaluations Collaborate with policy and engineering partners to translate eval findings into safeguard improvements Minimum qualifications Experience building or running evaluations, benchmarks, or test suites for software or ML systems, including delivering results on short, fixed timelines Hands-on cybersecurity experience (e.g., CTF participation, vulnerability research, exploit development, or security research) Proficiency in Python Strong ability to communicate evaluation results with multiple cross-functional stakeholders or potential policy stakeholders Preferred qualific

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role The Fraud Prevention team protects Anthropic's payment and monetization surfaces from financial abuse — keeping fraud losses, dispute rates, and network monitoring exposure in check while preserving a smooth experience for legitimate customers. As a software engineer on this team, you will build the systems that make risk decisions in real time, manage the dispute and chargeback lifecycle, and detect monetization abuse across subscriptions, in-app purchases, and promotions. The ideal candidate can see things from attackers' perspectives, anticipate their responses to countermeasures, and never loses sight of the fact that a false positive here is a paying customer. Payments fraud is more externally coupled than most trust and safety work — you'll collaborate closely with finance, support, and legal teams internally, and with payment processors and platform partners externally. Responsibilities: Design and build real-time risk decisioning that scores transactions at authorization time, balancing fraud loss, approval rates, and latency constraints Build tooling and automation for the dispute and chargeback lifecycle, from review queues to evidence collection and loss reporting Engineer fraud signals at scale — device fingerprinting, BIN and issuer signals, velocity features, and cross-account linkage — and detect monetization abuse across subscriptions, trials, promotions, and in-app purchases Own a portfolio of metrics — loss rate, dispute rate, authorization approval impact, and false-positive rate — rather than optimizing any single number Lead investigations into emerging fraud patterns, building multi-layered defense

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role We are looking for a threat intel manager to build and run our Model Exploitation & Fraud team within Threat Intelligence. This team detects, investigates, and disrupts the large-scale exploitation of Anthropic's AI systems. Model distillation, unauthorized access, account farming and reseller abuse, and fraud and scam operations. You will set the strategy for the mission area, hire and lead a small team of technical investigators, and build the systems, processes, and partnerships that let the team scale. The team includes established senior investigators who own our deepest technical casework, tracing distillation networks, reseller and proxy ecosystems, and financially motivated actors across first-party surfaces and third-party platforms; your job is to direct, resource, and amplify that work, not duplicate it. This area carries regular U.S. government engagement and requires deeply understanding external black market ecosystems and how they interact with our systems. Important context: In this position you may be exposed to explicit content spanning a range of topics, including those of a sexual, violent, or psychologically disturbing nature. This role may require responding to escalations during weekends and holidays. Key responsibilities Own strategy, priorities, and outcomes for the Model Exploitation & Fraud mission area; define what we detect, investigate, action, and share Hire, manage, and develop a team of technical threat investigators; set the quality bar for casework and intelligence reporting Design clear lanes between this role and the team's senior individual contributors: strategy

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role We are looking for a threat intel manager to build and run our CBRN-E & Advanced Weapons team within Threat Intelligence. This team detects, investigates, and disrupts attempts to misuse Anthropic's AI systems for chemical, biological, radiological, nuclear, and explosives threats and for the development of advanced or novel weapons. You will mature this from a promising start into a rigorous program, hiring investigators with real CBRN-E, weaponization, and counterproliferation expertise, sharpening detection beyond broad harm screens into threat-specific capabilities, and personally leading the cases where scientific judgment determines whether we're seeing curiosity, legitimate research, or a genuine weapons-development attempt. The area carries significant engagement with government, biosecurity, and scientific stakeholders. Important context: In this position you may be exposed to explicit content spanning a range of topics, including those of a sexual, violent, or psychologically disturbing nature. This role may require responding to escalations during weekends and holidays. Key responsibilities Own strategy, priorities, and outcomes for the CBRN-E & Advanced Weapons mission area; mature it from an emerging function into a rigorous investigative program Hire, manage, and develop a team of investigators with deep domain expertise across biological, chemical, and weapons-development threat areas Personally lead investigations into attempts to use our systems to develop, enhance, or disseminate CBRN-E weapons, or advanced weapons capabilities Evolve detection from broad harm screens toward CBRN-specific signa

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the Role We are looking for a Threat Intelligence Engineer to join our Threat Intelligence team. In this role, you will build the infrastructure that powers our threat discovery capabilities—integrating external data sources, developing detection systems for automated lead generation, and creating internal tooling that scales our investigators' impact. This is a foundational engineering role on a small, high-impact team. You will take projects from proof-of-concept to production, work closely with investigators to understand their needs, and help scale what may become a multi-person collections function. Responsibilities: Build automated detection systems that use disparate signals to identify abusive behavior. Take systems from idea to proof-of-concept to production-grade with appropriate monitoring, documentation, and maintenance processes Develop and maintain YARA rule infrastructure, including tools for writing, validating, and testing rules against real data Create integrations with external threat intelligence platforms (e.g. VirusTotal, Censys, Urlscan) via MCP servers to enable multi-source correlation during investigations Build data pipelines that ingest intelligence from RSS feeds, CTI news sources, and partner sharing, using Claude to extract TTPs and generate targeted hunting queries Develop behavioral analytics capabilities using DBT-based frameworks and create searchable audit logging infrastructure Establish feedback loops with investigators to tune detection systems and reduce false positives Scrape and normalize data from external sources to feed threat detection and enrichment workflows You may be a good

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the Role We are looking for a Technical Cyber Threat Investigator to join our Threat Intelligence team. In this role, you will be responsible for detecting, investigating, and disrupting the misuse of Anthropic's AI systems for malicious cyber operations. You will work at the intersection of AI safety and cybersecurity, conducting thorough investigations into potential misuse cases, developing novel detection techniques, and building robust defenses against emerging cyber threats in the rapidly evolving landscape of AI-enabled risks. Your work will directly protect the broader ecosystem from sophisticated threat actors who seek to leverage AI technology for harm. Important context: In this position you may be exposed to explicit content spanning a range of topics, including those of a sexual, violent, or psychologically disturbing nature. This role may require responding to escalations during weekends and holidays. Responsibilities Detect and investigate attempts to misuse Anthropic's AI systems for cyber operations, including influence operations, malware development, social engineering, and other adversarial activities Develop abuse signals and tracking strategies to proactively detect sophisticated threat actors across our platform Create actionable intelligence reports on new attack vectors, vulnerabilities, and threat actor TTPs targeting LLM systems Conduct cross-platform threat analysis grounded in real threat actor behavior, using open-source research, dark web monitoring, and internal data Utilize investigation findings to implement systematic improvements to our safety approach and mitigate harm at scale Study tr

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role We are looking for research engineers to build the safety and oversight mechanisms that govern how our models handle biological knowledge. As a bio safety researcher, you will spend your time: designing and running capability evaluations against frontier models, generating and curating training data for our safety classifiers, training and iterating on those classifiers alongside our ML engineers, and measuring how they hold up against adversarial pressure in production traffic. This work sits at the intersection of applied ML and biosecurity. You will help define what responsible AI safety looks like in the biological domain, translating threat models into evals, datasets, and deployed systems. The core technical tension you will own is precision: safeguards need to be robust against sophisticated actors while staying out of the way of the far larger population of legitimate researchers using Claude to accelerate life sciences work. Getting that tradeoff right is an empirical problem, and you will be the person measuring it. You do not need to be an ML researcher today. We are looking for strong scientific programmers with real depth in modern biology who want to bring that depth to bear on model evaluation and classifier development. Key responsibilities Design, build, and run capability evaluations to assess what new models can do in the biological domain, and turn results into concrete deployment recommendations Develop training and evaluation datasets for our safety classifiers, working with internal and external threat modeling experts to ground them in realistic risk Train, tune, and iterate on safety classifiers

About the Team Meesho's Security & Compliance team safeguards a platform that 5% of Indian households shop with - millions of orders, billions of data points, zero downtime as a baseline. We own the Information Security Management System, drive every external certification, and shape how Meesho earns trust with sellers, buyers, partners and regulators. We move fast, default to automation, and obsess over evidence. About the Role This is a hands-on individual contributor role for someone who wants to drive - not just oversee - a multi-framework compliance program. You'll be the DRI for ISO 27001:2022 and SOC 2 Type II, run end-to-end ITGC and TPRM cycles, and help operationalise India's DPDP Rules 2025 across a product organisation that processes data at meaningful scale. You'll work directly with Engineering, IT, Legal, Product, and external auditors. What you will do Certifications & external audits Own the certification and surveillance cycle for ISO 27001:2022 and SOC 2 Type II ; act as the single point of contact for external auditors. Plan and execute readiness assessments, gap closure, evidence collection, control walkthroughs, and management responses. Maintain audit calendars, evidence repositories, and bridge letters between audit windows. Drive PCI DSS v4.0.1 scope-reduction and assessment activities for in-scope environments. ISMS, policies & frameworks Maintain Meesho's ISMS aligned to ISO 27001:2022 - all 93 Annex A controls mapped across Organizational, People, Physical and Technological themes, with named owners and live evidence. Author, review, version-control and socialise security policies, standards, and procedures. Map controls across frameworks: ISO 27001:2022, SOC 2 TSC, PCI DSS v4.0.1, NIST CSF 2.0,

About the Team At OpenAI, our User Operations team safeguards our products and users from legal risk, regulatory non-compliance, fraud, and abuse. The team operates at the intersection of operations, compliance, and user trust, embedded within the broader User Operations organization and collaborating cross-functionally with Legal, Governance Risk & Compliance, Policy and Engineering. We support a global and diverse user base across OpenAI’s suite of product offerings, and developer tools by managing sensitive inbound tickets, regulatory obligations, and escalations. Every user-facing action is grounded in our commitment to legal integrity, ethical practice, and regulatory excellence. About the Role We are seeking an independent, adaptive, and operations-minded Regulatory Operations Analyst to help scale and evolve OpenAI’s global regulatory and compliance operations from San Francisco. This role focuses on complex regulatory operations, including work under the EU Digital Services Act (DSA) and EU AI Act, as well as regulatory inquiries and complaints across the Americas, and Asia-Pacific. You’ll manage sensitive cases independently, exercise sound judgment on escalations, and work closely with Legal Counsel, Governance, Risk and Compliance (GRC), and other cross-functional partners. You’ll also bring a working understanding of privacy and intellectual property matters so you can recognize and escalate related issues when needed. Beyond frontline casework, you’ll help shape the documentation, workflows, tooling, and automation that support safe, scalable and regulatory and legal compliance operations. This role is essential to building scalable, high-integrity operations that protect user rights, meet our obligations under emerging and current regulations. You’ll also contribute to multi-phase transitions and automation efforts that support our long-term operational model. Please note: This role may involve exposure to sensitive or concerning content, including

About the Team Safety Systems manages the complete lifecycle of safety efforts for OpenAI’s frontier models, ensuring our models are deployed responsibly and have a positive impact on society. Our work spans diverse research and engineering initiatives—from system-level safeguards and model training to evaluation and red-teaming—all aimed at mitigating misuse, misalignment, and maintaining our high bar for safety. We lead OpenAI's commitment to developing and deploying safe Artificial General Intelligence (AGI), fostering a culture of trust, responsibility, and transparency. Our goal is to continuously learn from deployments, distribute AI’s benefits widely, and ensure that powerful tools remain aligned with human values and safety considerations. Within Safety Systems, the Model Policy team works to ensure that frontier models behave safely and reliably in real-world environments by designing policies that define safe model behavior. We've had several relevant publications, including: Safety at every step OpenAI GPT6 System Card OpenAI Model Spec About the Role We’re hiring a Model Policy Manager to shape model behavior for U.S. government use, with a focus on national security applications. You’ll define nuanced policies and translate them into training and evaluation criteria, helping models navigate high-stakes scenarios while preserving their usefulness and capabilities. In this role, you’ll: Develop model policies that guide safe and useful behavior. Build evaluations, identify policy gaps and model failures, and use findings to improve policies and training. Work with research, engineering, and domain experts to support safe, reliable deployment. You might thrive in this role if you: Bring relevant experience in AI safety, policy, or risk assessment. Have strong judgment and can turn complex safety questions into clear, practical policies. Have the technical fluency to work hands-on with model data and evaluations. Are motivated by OpenAI’s mission and the re

About the team The Frontier Assurance team strengthens OpenAI’s safety decisions through independent expertise, rigorous assessment, and public transparency. We coordinate external evaluations of frontier models and safeguards, develop approaches such as embedded auditing, and manage the misalignment disclosure process and safeguard testing. Our work helps independent experts scrutinize OpenAI’s safety approach and ensures their findings inform consequential decisions about advanced AI systems. About the role As a researcher on Frontier Assurance, you will build the technical foundations for rigorous assessments of frontier AI risks. You will help design technical assessments with external evaluators and internal teams: identify consequential safety claims to test, define the evidence and methods needed to assess them, and address gaps in coverage. You will work closely with external evaluators and embedded auditors, helping them understand the systems they are assessing and access the models, data, and technical information their work requires. Where direct access is not possible, you will conduct experiments and analyses on their behalf, with methods and results they can meaningfully scrutinize. This role combines research engineering, experimental design, and close technical collaboration. You will move between investigating specific safety questions, navigating complex internal systems, and building reusable tools that make assessments more thorough and efficient. Your work will help turn independent scrutiny into concrete evidence about model capabilities, safeguards, and remaining risks. In this role, you will: Help design assessments with external evaluators and internal teams: identify consequential safety claims to test, define the evidence and methods needed to assess them, and address gaps in coverage. Support the technical execution of third-party assessments and embedded audits focused on frontier risks, working with evaluators to translate research que

The Loyalty Analyst helps run and continuously improve our loyalty program, owning its day-to-day administration while digging into what drives members to visit more often and spend more per visit. This person also safeguards the program's integrity by identifying and stopping fraudulent or abusive activity before it erodes program value. Working closely with marketing, finance, and technology teams, the Loyalty Analyst ensures the program runs smoothly and delivers real return on investment and serves as the primary point of contact for our loyalty vendor. Administer the day-to-day operations of the loyalty program, including point accrual and redemption rules, tier logic, and member account maintenance. Analyze loyalty member behavior to identify opportunities that increase return visit frequency and average guest check Monitor program transactions for signs of fraud or abuse (e.g., point gaming, account sharing, redemption anomalies) and escalate or resolve issues as needed. Build reporting and dashboards to track core loyalty KPIs: enrollment, active member rate, redemption rate, breakage, and member lifetime value. Partner with marketing to design and evaluate targeted offers, promotions, and campaigns aimed at loyalty members Work with technology and vendor partners to troubleshoot loyalty platform issues and support enhancements. BENEFITS Free Play & 1/2 price food! Health, dental, vision, 401(k) team member match, free mental well-being platform – and that’s just for starters for those who qualify. View team member benefits here. <p style="text-align:left !importan

About the Team Safety Systems manages the complete lifecycle of safety efforts for OpenAI’s frontier models, ensuring our models are deployed responsibly and have a positive impact on society. Our work spans diverse research and engineering initiatives—from system-level safeguards and model training to evaluation and red-teaming—all aimed at mitigating misuse, misalignment, and maintaining our high bar for safety. We lead OpenAI's commitment to developing and deploying safe Artificial General Intelligence (AGI), fostering a culture of trust, responsibility, and transparency. Our goal is to continuously learn from deployments, distribute AI’s benefits widely, and ensure that powerful tools remain aligned with human values and safety considerations. Within Safety Systems, the Model Policy team works to ensure that frontier models behave safely and reliably in real-world environments by designing policies that define safe model behavior. Our relevant publications include: Safety at every step OpenAI GPT6 System Card OpenAI Model Spec GPT-Live ChatGPT Images 2.5 About the Role We are hiring a Model Policy Manager to focus on the safety of multimodal models. In this role, you will shape how OpenAI identifies, evaluates, and addresses risks in multimodal AI models - such as GPT-Live and ChatGPT Images - as well as multimodal capabilities in frontier AI models. This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees. In this role, you will: Design and maintain model policies for audio, image, video, and omni-modal behavior. Translate theories of harm and threat models into behavioral safety policies, evaluation criteria, grading guidance, and safeguards. Identify and analyze safety regressions and failure patterns to identify gaps in existing policies and inform policy iteration. Develop policy artifacts that support model training, evaluation, and deployment, including behavior i

About the Team Safety Systems manages the complete lifecycle of safety efforts for OpenAI’s frontier models, ensuring our models are deployed responsibly and have a positive impact on society. Our work spans diverse research and engineering initiatives—from system-level safeguards and model training to evaluation and red-teaming—all aimed at mitigating misuse, misalignment, and maintaining our high bar for safety. We lead OpenAI's commitment to developing and deploying safe Artificial General Intelligence (AGI), fostering a culture of trust, responsibility, and transparency. Our goal is to continuously learn from deployments, distribute AI’s benefits widely, and ensure that powerful tools remain aligned with human values and safety considerations. Within Safety Systems, the Model Policy team works to ensure that frontier models behave safely and reliably in real-world environments by designing policies that define safe model behavior. Some of our publications include: Safety at every step OpenAI GPT6 System Card OpenAI Model Spec About the Role We’re hiring a Model Policy Manager to shape model behavior for U.S. government use, with a focus on national security applications. You’ll define nuanced policies and translate them into training and evaluation criteria, helping models navigate high-stakes scenarios while preserving their usefulness and capabilities. In this role, you will: Develop model policies that guide safe and useful behavior. Build evaluations, identify policy gaps and model failures, and use findings to improve policies and training. Work with research, engineering, and domain experts to support safe, reliable deployment. You might thrive in this role if you: Bring relevant experience in AI safety, policy, or risk assessment. Have strong judgment and can turn complex safety questions into clear, practical policies. Have the technical fluency to work hands-on with model data and evaluations. Are motivated by OpenAI’s mission and the responsible use of