Abuse Investigator Jobs

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role As a Safeguards Enforcement Lead on the User Well-Being team, you will be responsible for managing our child safety, mental health, abuse and exploitation, and age assurance enforcement workflows. This will include managing the team responsible for scaling, maintaining, and continuously improving the systems and processes we use to detect and respond to these harms. This is a management role. You will serve as the central point of contact for those who conduct content review, managing day-to-day workflows, quality assurance, and escalation processes. You will also work closely with internal Engineering, Policy, and Legal teams to scale detection systems and close enforcement gaps as the threat landscape evolves. Important context for this role: In this position you will regularly be exposed to and engage with explicit content of a sexual nature involving minors, as well as content that may be violent or psychologically disturbing. Anthropic takes the wellbeing of team members working in this area seriously and provides access to wellness resources and support. Candidates should carefully consider this aspect of the role before applying. Key responsibilities Manage a team of individual contributors across multiple policy areas under the User Well-Being banner Serve as the primary point of contact for review partners conducting content review, including onboarding, training, quality assurance, and ongoing relationship management Design and improve enforcement workflows to scale effectively as volume grows, while maintaining high accuracy and consistency across review decisions Partner with Engineering and Data Science tea

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career. About the team Payment Intelligence is comprised of multiple product teams building AI-first solutions to some of our customers’ biggest challenges, including fraud/abuse ( Radar ), payment optimizations ( AuthBoost ), Disputes, Authentication, and merchant analytics. We’re a mix of machine engineering engineers and full-stack software engineers impacting ~every Stripe transaction, creating revenue opportunities for Stripe and our customers, and helping protect the broader ecosystem. We have the benefit and privilege of working on cutting edge technologies with incredible scale and reach while also working directly with our merchants every day to build the right products for their needs. What you'll do As a Staff Engineer on Payment Intelligence, you’ll work across our product portfolio to ensure we’re building in a consistent, efficient, and effective manner. Experience with large, distributed systems on the critical path will help candidates succeed, as will comfort working across the stack and interacting with ML teams and models. Responsibilities Define technical strategy for multiple experiences across the Payment Intelligence portfolio, with a focus on quality and performance Champion a quality-first engineering culture - establish standards, tooling, and processes that make it easy to ship high-quality code at scale Partner with some of Stripe’s largest merchants to co-build the future of payment-centric intelligence Partner cross-functionally

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role We're hiring Cyber Evaluations Engineers to build and run the evaluations that measure cyber-relevant capabilities and safeguard robustness in our models. You'll design new evals, run per-release robustness testing, and dig into data on jailbreaks and prompt bypasses to understand where our safeguards hold up and where they don't. You'll also design many of the probes that detect cyber abuse in production and help shape the overall detection architecture alongside the policy team. Key responsibilities Design and run capability, uplift, and safety evaluations to assess cyber-relevant risk in new models Execute per-release safeguard-robustness testing ahead of major model launches Analyze evaluation results and communicate findings clearly to the team and to stakeholders Design, prototype, and tune detection probes for cyber misuse Work with the cyber policy team to turn policy lines into a layered, robust abuse-detection architecture, and measure its precision and coverage over time Build and maintain internal tooling used to run and score evaluations Collaborate with policy and engineering partners to translate eval findings into safeguard improvements Minimum qualifications Experience building or running evaluations, benchmarks, or test suites for software or ML systems, including delivering results on short, fixed timelines Hands-on cybersecurity experience (e.g., CTF participation, vulnerability research, exploit development, or security research) Proficiency in Python Strong ability to communicate evaluation results with multiple cross-functional stakeholders or potential policy stakeholders Preferred qualific

About the role Chime is looking for an engineering leader to help manage and guide one of the Trust & Safety engineering teams. Chime’s Trust & Safety org is on a mission to protect our members and fuel durable growth. In practice, that means earning member trust through secure, seamless experiences; preventing fraud and abuse; reducing unnecessary friction; and meeting regulatory obligations while enabling responsible growth. We're hiring Tech Lead Managers (TLM) for multiple squads in Trust & Safety. TLMs at Chime manage a team of 3-5 engineers: Setting the hiring bar, coaching and developing talent, and driving all formal people management activities. They own execution and delivery for the squad. They stay in the code, authoring and shipping features alongside their team. In this role, you can expect to: Manage and develop a squad of 4-5 engineers: Hiring, 1:1s, career coaching, managing for performance Own delivery for your squad end to end, from sprint planning and delivery commitments through service SLAs and operational health Write and ship code alongside your team, authoring pull requests that land in production Be accountable for the squad's technical direction, architecture, and quality bar, either via a tech lead on the squad, or by taking on the tech lead role yourself. Use AI coding agents and tooling to raise both your own leverage and your squad's, and establish the practices that make that durable for the team Partner with Product and Design on scope, prioritization, and quarterly planning, surfacing technical dependencies and capacity needs early Act as the squad's cross-functional point of contact for its technical capabilities and dependency coordination, and carry the "what should we build" conversation if/when a PM isn't dedicated to your squad Identify technical debt and advocate for sustainable engineering, staying an active contributor to the codebase Ensure quality, performance, and operational health, including a

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career. About the team Fraud Strategy is responsible for building scaled fraud mitigation systems that prevent fraud and protect the financial ecosystem, while minimizing disruption to good users. The fraud team’s mission is to protect Stripe, our users, and the broader financial ecosystem from actors who abuse Stripe accounts for financial gain. What you’ll do As a Fraud Strategist, you will be responsible for building strategies to mitigate fraud (buyer fraud, seller fraud and account fraud) on new and existing Stripe products. You will enable safer money movement for our users and help Stripe manage fraud risks intelligently. The stakes are high, and you will be up against ever-evolving challenges. You will face some of the most complex and dynamic problems at the company, and the nature of your work will evolve rapidly to combat new and more sophisticated challenges to Stripe's integrity in the financial ecosystem. You'll partner closely with Product, Engineering, Data Science, Operations and other Risk Strategy functions to ensure fraud controls are embedded in every Stripe product. Beyond protecting against fraud risk, you'll drive innovation in how Stripe approaches fraud management— staying ahead of emerging fraud trends and pushing the boundaries of what effective, scalable fraud risk management looks like at a global payments company. Responsibilities Monitor portfolio to identify, mitigate and predict risky behavior that could result i

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career. About the team Payment Intelligence is comprised of multiple product teams building AI-first solutions to some of our customers’ biggest challenges, including fraud/abuse ( Radar ), payment optimizations ( AuthBoost ), Disputes, Authentication, and merchant analytics. We’re a mix of machine engineering engineers and full-stack software engineers impacting ~every Stripe transaction, creating revenue opportunities for Stripe and our customers, and helping protect the broader ecosystem. We have the benefit and privilege of working on cutting edge technologies with incredible scale and reach while also working directly with our merchants every day to build the right products for their needs. What you'll do As a Staff Engineer on Payment Intelligence, you’ll work across our product portfolio to ensure we’re building in a consistent, efficient, and effective manner. Experience with large, distributed systems on the critical path will help candidates succeed, as will comfort working across the stack and interacting with ML teams and models. Responsibilities Define technical strategy for multiple experiences across the Payment Intelligence portfolio, with a focus on quality and performance Champion a quality-first engineering culture - establish standards, tooling, and processes that make it easy to ship high-quality code at scale Partner with some of Stripe’s largest merchants to co-build the future of payment-centric intelligence Partner cross-functionally

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role As a Safeguards Enforcement Analyst on the account abuse team, you'll build and execute enforcement workflows that keep our products safe, with a focus on detecting and mitigating potential harm. Your focus will be driving a number of enforcement areas including access controls and identity verification. You'll own the policy layer of these systems: what we ask users for, when, on what grounds, and what passes. The work sits at the intersection of policy, operations, and regulatory exposure. This position may expand into broader areas of enforcement over time. Safety is core to our mission, and you'll help shape policy enforcement so that our users can safely interact with and build on top of our products in a harmless, helpful, and honest way. Key responsibilities Set collection policy for identity signals: what we request, in which enforcement states, and what evidence reinstates access Improve verification program health — accuracy, appeal coverage, and consistency of outcomes Own access policy for hard cases, including geographic restrictions and reseller arrangements Run the operational queue for access-control cases alongside contractor support, authoring playbooks and QA'ing scaled review output Work with Legal, Public Policy, and Privacy stakeholders to keep our approach proportionate, privacy-preserving, and responsive to an evolving regulatory landscape Coordinate enforcement consistency with third-party platform partners Keep up to date with emerging AI policy enforcement best practices, and use these to inform our decision-making and workflows Stand up graduated enforcement in practice — verification request

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role As a Safeguards Enforcement Analyst on the Child Safety team, you will be responsible for our child safety enforcement workflows, responsible for scaling, maintaining, and continuously improving the systems and processes we use to detect and respond to child sexual abuse material (CSAM) and child sexual exploitation material (CSEM) generated or facilitated through Anthropic's products. This is a deeply operational role. You will serve as the central point of contact for those who conduct content review, managing day-to-day workflows, quality assurance, and escalation processes to ensure reviews are accurate, consistent, and conducted with appropriate support structures in place. You will also work closely with internal Engineering, Policy, and Legal teams to scale detection systems and close enforcement gaps as the threat landscape evolves. This work is essential to Anthropic's mission. Child safety is one of our highest-priority harm areas, and the person in this role will have a direct and meaningful impact on protecting children from AI-facilitated exploitation and abuse. Important context for this role: In this position you will regularly be exposed to and engage with explicit content of a sexual nature involving minors, as well as content that may be violent or psychologically disturbing. Anthropic takes the wellbeing of team members working in this area seriously and provides access to wellness resources and support. Candidates should carefully consider this aspect of the role before applying. Key responsibilities Own the day-to-day operational management of child safety content review workflows, including task ro

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role As a Safeguards Analyst focusing on Integrity & Authenticity, you will be responsible for building and executing enforcement workflows for our products and services, with a focus on detecting and mitigating attempts to misuse Anthropic's AI systems for coordinated inauthentic behavior, election manipulation, and targeting, tracking, and surveillance of individuals. Your work will span a broad and interconnected set of harm areas: AI-enabled influence operations and disinformation campaigns, the abuse of AI to interfere with electoral processes, and the use of AI systems to facilitate stalking, surveillance, profiling, and the targeting of individuals or groups. Safety is core to our mission, and you'll help shape policy enforcement so that our users can safely interact with and build on top of our products in a harmless, helpful, and honest way. Important context for this role: In this position you may be exposed to and engage with explicit content spanning a range of topics, including those of a political, violent, or psychologically disturbing nature. This role may require responding to escalations during weekends and holidays, particularly around major electoral events. Key responsibilities Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy Partner with Engineering and Data Science teams to optimize detection models for policy violations and automated enforcement systems Review flagged content to drive enforcement and policy improvements Enforce usage policies with a focus on detecting and mitigating AI-enabled influence operations, coord

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. Sr. Software Engineer, Security Foundations Build the future of data and AI. Join the Snowflake team. The Anti-abuse team at Snowflake is responsible for protecting Snowflake and our customers from abuse on the Snowflake platform. You will have the opportunity to help set the direction of the roadmap and build foundational security primitives while working closely with other teams at Snowflake. As an Anti-Abuse Software Engineer , you will design and build necessary software solutions within a multi-cloud env. across a wide range of problem areas that proactively protect our platform and users from adversarial threats. You will build and scale solution and mitigation frameworks to combat fraud, account takeovers (ATO), data exfiltrations and AI security threats, tackling the most complex engineering challenges of Snowflake’s hyper-growth. We’re at the forefront of the data revolution, committed to building the world’s greatest data and applications platform. Our ‘get it done’ culture allows everyone at Snowflake to have an equal opportunity to innovate on new ideas, create work with a lasting impact, and excel in a culture of collaboration. Responsibilities Design, build, and scale security-by-default capabilities that protect Snowflake products across a complex multi-cloud

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career. About the team Fraud Strategy is responsible for building scaled fraud mitigation systems that prevent fraud and protect the financial ecosystem, while minimizing disruption to good users. The fraud team’s mission is to protect Stripe, our users, and the broader financial ecosystem from actors who abuse Stripe accounts for financial gain. What you’ll do As a Fraud Strategist, you will be responsible for building strategies to mitigate fraud (buyer fraud, seller fraud and account fraud) on new and existing Stripe products. You will enable safer money movement for our users and help Stripe manage fraud risks intelligently. The stakes are high, and you will be up against ever-evolving challenges. You will face some of the most complex and dynamic problems at the company, and the nature of your work will evolve rapidly to combat new and more sophisticated challenges to Stripe's integrity in the financial ecosystem. You'll partner closely with Product, Engineering, Data Science, Operations and other Risk Strategy functions to ensure fraud controls are embedded in every Stripe product. Beyond protecting against fraud risk, you'll drive innovation in how Stripe approaches fraud management— staying ahead of emerging fraud trends and pushing the boundaries of what effective, scalable fraud risk management looks like at a global payments company. Responsibilities Monitor portfolio to identify, mitigate and predict risky behavior that could result in loss

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career. About the team Fraud Strategy is responsible for building scaled fraud mitigation systems that prevent fraud and protect the financial ecosystem, while minimizing disruption to good users. The fraud team’s mission is to protect Stripe, our users, and the broader financial ecosystem from actors who abuse Stripe accounts for financial gain. What you’ll do As a Manager on the Fraud Strategy team, you will lead a team of high performing and tenured fraud strategists responsible for safeguarding Stripe’s rapidly expanding portfolio of money movement and money management capabilities from fraud. You will lead the team to create short, medium and long term strategies that prevent fraud while enabling growth on rapidly expanding Stripe products like Treasury, Issuing, Capital, Crypto and Stablecoins. Responsibilities Lead a Specialized Team: Coach and mentor a world-class team of fraud strategists. You'll be responsible for their professional growth and for fostering a culture of rigorous, data-driven fraud system development. Own the E2E Fraud Prevention Lifecycle: Oversee the team's execution across all critical decision points—from new user onboarding, through offboarding and funds recovery Strategic Stakeholder Partnership: Act as a key partner to Product, Engineering, Data Science, and Operations. You will navigate complex cross functional fraud prevention system development and tuning, ensuring our risk appetite aligns with both internal go

About the Team The Integrity team at OpenAI is dedicated to ensuring that our cutting-edge technology is not only revolutionary, but also secure from a myriad of adversarial threats. We strive to maintain the integrity of our platforms as they scale. The Integrity team is at the front lines of defending against misuse in all its forms: content abuse, scaled attacks, and other actions that could undermine the user experience or harm our operational stability. About the Role As a Machine Learning Engineer in OpenAI's Integrity team, you will have the opportunity to work with some of the brightest minds in AI. You’ll work on state-of-the-art models and classifiers, experiment with new architecture and approaches, and push forward our abilities in content and user understanding. You’ll help turn research breakthroughs into tangible solutions that improve the trust and safety of our platform. If you're excited about training LLMs and building ML models, this role is your chance to make a significant mark. In this role, you will: Innovate and Deploy: Design and deploy advanced machine learning models that solve real-world problems. Bring OpenAI's research from concept to implementation, creating AI-driven applications with a direct impact. Collaborate with the Best: Work closely with researchers, software engineers, and product managers to understand complex business challenges and deliver AI-powered solutions. Be part of a dynamic team where ideas flow freely and creativity thrives. Optimize and Scale: Implement scalable data pipelines, optimize models for performance and accuracy, and ensure they are production-ready. Contribute to projects that require cutting-edge technology and innovative approaches. Learn and Lead: Stay ahead of the curve by engaging with the latest developments in machine learning and AI. Take part in code reviews, share knowledge, and lead by example to maintain high-quality engineering practices. Make a Difference: Monitor and maintain deployed m

About the Team OpenAI’s Financial Engineering and Identity data science team owns how revenue flows through our products and builds the systems that enable people and organizations to access OpenAI products safely, seamlessly, and at global scale. Identity sits at the critical intersection of growth, trust, and user experience. The team owns the experiences and infrastructure behind sign up, sign in, account recovery, authentication, and identity integrations across both consumer and enterprise products. As OpenAI expands across products and markets, Identity plays an increasingly important role in helping more users get started quickly while protecting them from abuse, fraud, and account compromise. About the Role We're looking for the first dedicated Data Scientist to partner with the Identity organization. In this role, you will define how we measure success across the entire identity journey—from first-time sign up and onboarding through authentication, account recovery, and enterprise identity experiences. You'll develop the experimentation frameworks, metrics, and analytical approaches that guide product decisions while helping the team navigate one of Identity's core challenges: optimizing growth while maintaining trust and security. You'll work closely with Product, Engineering, Design, Abuse, Risk, and Go-to-Market teams to identify opportunities, quantify trade-offs, and influence strategy. Some questions can be answered through A/B tests. Others require observational analyses, causal inference, and judgment under uncertainty. This is an opportunity to shape the analytical foundations of a high-impact product area from the ground up. This role is based in San Francisco, CA. We use a hybrid model (3 days/week in office) and offer relocation support. In this role, you will Define the north-star metrics and measurement frameworks used to evaluate the identity experience across consumer and enterprise products. Design and analyze experiments to optimize top-of

We are seeking an experienced Trading Operations Specialist to assist the company in executing trading strategies and ensuring the effective risk management of trading activities. This role involves overseeing pre-trade, live, and post-trade monitoring, stress testing algorithms, implementing kill functionality, monitoring market abuse, and raising red flags to senior management and compliance as necessary What You’ll Be Doing: Have access to and oversee the implementation of the kill switch to manage and mitigate trading risks promptly Lead a first-line team responsible for owning and managing trading risks, including stress testing algorithms and monitoring trade executions Review and approve new algorithms, parameters, and risk limits before they go live Monitor trades in real-time and review open positions to make informed decisions and adjustments as needed Raise red flags to the CEO, compliance team, and relevant stakeholders for immediate action and resolution Liaise with regulators on compliance matters where necessary Collaborate with the trading desk to ensure smooth and efficient trading operations while adhering to risk management protocols What We Look For In You: Bachelor's degree in Finance, Economics, Mathematics, or a related field 5+ years of proven experience in trading operations, risk management, and market surveillance within the financial industry Strong understanding of trading strategies, algorithms, risk metrics, and market dynamics Excellent analytical skills and the ability to assess and manage trading risks in real-time Proficiency in using trading platforms, automated monitoring tools, and risk management software Effective communication and decision-making skills to lead and collaborate Why Should You Join Our Team? Join an international team of highly qualified professionals Cutting-edge hardware and technology Onsite work at our Malta office (relocation to Malta is required) 40 paid days off Competitive salary