Abuse Research Engineer Jobs

About the Team At OpenAI, our Trust, Safety & Risk Operations teams safeguard our products, users, and the company from abuse, fraud, scams, regulatory non-compliance, and other emerging risks. We operate at the intersection of operations, compliance, user trust, and safety working closely with Legal, Policy, Engineering, Product, Go-To-Market, and external partners to ensure our platforms are safe, compliant, and trusted by a diverse, global user base. The Global Safety Response Operations team within the org provides 24/7 coverage for user safety, risk, and regulatory escalations across OpenAI’s products, handling the highest-priority cases that require human judgment and rapid response. The team operates as the core escalations management and delivery arm of OpenAI’s safety operations, ensuring that our products remain safe and aligned with our policies while enabling timely, empathetic, and consistent user support. About the Role We’re looking for experienced Trust, Safety, and Risk Operations analysts who have subject matter expertise in one or more of the following areas: policy enforcement and content moderation, fraud and scam prevention, developer risk, or privacy and regulatory escalations. You’ll be on the front lines of safety escalation management, helping to triage and resolve urgent and sensitive cases. You’ll work across subject matter areas, systems, and processes to ensure operational excellence, develop process improvements and automations, and surface insights and trends. This role is part of a 24/7 global operation team and will be expected to work a standard 5x8 work week, which includes covering the weekend shift each week (e.g., work weeks covering Saturday - Wednesday) We use a hybrid work model of 3 days in the Singapore office per week and offer relocation assistance to new employees. Please note: This role may involve exposure to sensitive content, including material that is sexual, violent, or otherwise disturbing. In This Role, You

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. We are hiring a Senior Security Engineer, dedicated to Product Security Incident Response. In this role, you will lead and architect Snowflake's product-integrated Incident Response strategy, with a primary focus on AI and LLM security. You'll design, plan, and drive the implementation of incident response capabilities across Snowflake's AI product surface - including Cortex AI, Cortex Agents, Snowflake Intelligence, and the data pipelines that power them. AS A SENIOR SECURITY ENGINEER, INCIDENT RESPONSE AT SNOWFLAKE, YOU WILL: Lead incident response for product-level security events, with deep focus on AI-specific threat vectors including prompt injection, model abuse, agent hijacking, and data exfiltration through AI workloads. Integrate IR into AI product pipelines - work directly with teams shipping Cortex features, Snowflake Intelligence, and AI-powered developer experiences to embed security requirements from design through deployment. Develop and codify our AI abuse response strategy - defining detection, containment, and remediation playbooks for LLM misuse, adversarial inputs, and AI-assisted attacks targeting Snowflake customers. Address tech debt across the AI product stack, ensuring that new Cortex and agentic architectures meet IR readiness requirements from th

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. We are hiring a Senior Security Engineer, dedicated to Product Security Incident Response. In this role, you will lead and architect Snowflake's product-integrated Incident Response strategy, with a primary focus on AI and LLM security. You'll design, plan, and drive the implementation of incident response capabilities across Snowflake's AI product surface - including Cortex AI, Cortex Agents, Snowflake Intelligence, and the data pipelines that power them. AS A SENIOR SECURITY ENGINEER, INCIDENT RESPONSE AT SNOWFLAKE, YOU WILL: Lead incident response for product-level security events, with deep focus on AI-specific threat vectors including prompt injection, model abuse, agent hijacking, and data exfiltration through AI workloads. Integrate IR into AI product pipelines - work directly with teams shipping Cortex features, Snowflake Intelligence, and AI-powered developer experiences to embed security requirements from design through deployment. Develop and codify our AI abuse response strategy - defining detection, containment, and remediation playbooks for LLM misuse, adversarial inputs, and AI-assisted attacks targeting Snowflake customers. Address tech debt across the AI product stack, ensuring that new Cortex and agentic architectures meet IR readiness requirements from th

About the Team At OpenAI, the User Safety & Risk Operations (USRO) team helps protect our products and users from abuse, fraud, safety risks, and other forms of misuse. We operate at the front line of real-world safety and risk management, translating user and operational signals into timely decisions, effective interventions, and improvements to our systems. This role sits on a team focused on building operational capacity for new, ambiguous, and fast-moving company priorities. The team defines what needs to be built, creates the operating model to support it, and works with partner teams to make the work scalable and durable over time. About the Role We are looking for a senior program manager to build the safety, quality, and risk operations supporting a new category of consumer devices. You will translate ambiguous product risks and evolving requirements into practical operating models, workflows, escalation paths, launch-readiness plans, and cross-functional decision-making. This is a foundational role: the systems you build will shape how OpenAI launches, monitors, and improves a new category of consumer devices safely at scale. You will help establish how potential safety incidents, product-quality concerns, sensitive customer escalations, privacy-sensitive issues, and other emerging device risks are identified, investigated, resolved, and incorporated into product and operational improvements. You will turn incomplete requirements into practical workflows, decision rights, launch plans, quality controls, measurement, and durable ownership. The role centers on program building, operational judgment, and execution. We welcome candidates from product safety, quality assurance, regulatory operations, technical program management, healthcare, medical devices, aerospace, consumer technology, and other environments involving complex products or regulated risks. Direct consumer-hardware experience is helpful but not required. The strongest candidates learn unfam

About the Team At OpenAI, our User Safety & Risk Operations (USRO) team helps protect our products and users from abuse, fraud, safety risks, and other forms of misuse. We operate at the front line of real-world safety and risk management, translating user and operational signals into timely decisions, effective interventions, and improvements to our systems. This role sits on a team focused on building operational capacity for new, ambiguous, and fast-moving areas of work. The team defines what needs to be built, creates the operating model to support it, and works with partner teams to make the work scalable and durable over time. About the Role We are seeking a Device Safety & Risk Operations Specialist to build the safety operating model for a new category of consumer hardware. This is a senior individual-contributor role for someone who can turn emerging product risks and incomplete requirements into practical workflows, controls, launch plans, and durable systems. You will define how product-safety incidents, critical escalations, regulated cases, and privacy-sensitive issues should be identified, investigated, escalated, resolved, and learned from. You will also establish operational requirements for case management, data access, decision logging, quality assurance, monitoring, and cross-functional response. You will stand up priority workflows through launch and early operations, then help transition them into durable homes across USRO and partner teams. The right person combines deep operational judgment with strong technical and hardware product fluency. They can move from executive-level risk framing to detailed workflow design, tabletop exercises, launch readiness, frontline guidance, and post-launch improvement. Location / work model: San Francisco, CA; hybrid, 3 days/week in-office. Please note: This role may involve exposure to sensitive or concerning material. Strong discretion, judgment, and resilience are essential. In This Role, You Will:

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. WHY DATA SCIENCE & ANALYTICS? The Data Science & Analytics organization's mission is to increase our speed, frequency and acumen of making decisions at scale by instilling a data-influenced approach to building products. We cover a wide area of the data spectrum including analytical data engineering, product analytics, experimentation, causal inference, statistical modeling and machine learning. Aligned and partnering with product verticals, we use this extensive tool belt to discover new opportunities and unmet use cases, influence and shape the product roadmap and prioritization, build data products and measure impact on our community of players and developers. WHY AUTHENTICATION & SECURITY? Authentication & Security sits at the intersection of trust, product, and growth. The team builds the systems that allow users to sign in, recover, and protect their accounts with confidence, while defending the platform against account takeovers, credential abuse, and fraud at massive scale. This role is an opportunity to shape a high-stakes product area where small changes in friction or protection can meaningfully affect sign-ups and user frequency. You will act as a strategic leade

About the Team At OpenAI, our Trust, Safety & Risk Operations teams safeguard our products, users, and the company from abuse, fraud, scams, regulatory non-compliance, and other emerging risks. We operate at the intersection of operations, compliance, user trust, and safety working closely with Legal, Policy, Engineering, Product, Go-To-Market, and external partners to ensure our platforms are safe, compliant, and trusted by a diverse, global user base. The Global Safety Response Operations team within the org provides 24/7 coverage for user safety, risk, and regulatory escalations across OpenAI’s products, handling the highest-priority cases that require human judgment and rapid response. The team operates as the core escalations management and delivery arm of OpenAI’s safety operations, ensuring that our products remain safe and aligned with our policies while enabling timely, empathetic, and consistent user support. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees. Please note: This role may involve exposure to sensitive content, including material that is sexual, violent, or otherwise disturbing. About the Role We’re looking for experienced Trust, Safety, and Risk Operations analysts who have subject matter expertise in one or more of the following areas: policy enforcement and content moderation, fraud and scam prevention, developer risk, or privacy and regulatory escalations. You’ll be on the front lines of safety escalation management, helping to triage and resolve urgent and sensitive cases. You’ll work across subject matter areas, systems, and processes to ensure operational excellence, develop process improvements and automations, and surface insights and trends. This is a 24/7 global operation that requires flexibility to work rotating shifts, including nights, weekends, and holidays, as part of an on-call coverage model. We use a hybrid work model of 3 days in the office per week and offer r

WHO WE ARE: Zinnia is the leading technology platform for accelerating life and annuities growth. With innovative enterprise solutions and data insights, Zinnia simplifies the experience of buying, selling, and administering insurance products. All of which enables more people to protect their financial futures. Our success is driven by a commitment to three core values: be bold, team up, deliver value – and that we do. Zinnia has over $180 billion in assets under administration, serves 100+ carrier clients, 2500 distributors and partners, and over 2 million policyholders. WHO YOU ARE: As Product Manager for Customer Identity & Access Management (CIAM), you will help shape and deliver how carriers, distributors, partners, and policyholders securely access Zinnia’s platform. Working alongside senior product leadership, you will own the backlog and delivery for parts of the identity product area — authentication, authorization, and the user lifecycle — balancing security and compliance with a smooth user experience. You will partner day to day with Engineering and Security to turn requirements into shipped features. WHAT YOU’LL DO: Own the product backlog and contribute to the CIAM roadmap across consumer (policyholder), partner (distributor/agent), and workforce identity. Write clear requirements and user stories for identity capabilities - authentication (SSO, MFA, passwordless), authorization (RBAC/ABAC, delegated access), and the user lifecycle (registration, provisioning/SCIM, recovery, deprovisioning). Work with Engineering and Architecture on identity protocol decisions and implementation (OAuth 2.0, OpenID Connect, SAML, SCIM). Contribute to build-vs-buy and platform evaluations for identity providers, and help maintain the integration approach across Zinnia products. Balance security, privacy, and usability — helping reduce friction while protecting against account takeover, credential stuffing, and abuse. Partner with Security, Risk, and Compliance to en

WHO WE ARE: Zinnia is the leading technology platform for accelerating life and annuities growth. With innovative enterprise solutions and data insights, Zinnia simplifies the experience of buying, selling, and administering insurance products. All of which enables more people to protect their financial futures. Our success is driven by a commitment to three core values: be bold, team up, deliver value – and that we do. Zinnia has over $180 billion in assets under administration, serves 100+ carrier clients, 2500 distributors and partners, and over 2 million policyholders. WHO YOU ARE: As Product Manager for Customer Identity & Access Management (CIAM), you will help shape and deliver how carriers, distributors, partners, and policyholders securely access Zinnia’s platform. Working alongside senior product leadership, you will own the backlog and delivery for parts of the identity product area — authentication, authorization, and the user lifecycle — balancing security and compliance with a smooth user experience. You will partner day to day with Engineering and Security to turn requirements into shipped features. WHAT YOU’LL DO: Own the product backlog and contribute to the CIAM roadmap across consumer (policyholder), partner (distributor/agent), and workforce identity. Write clear requirements and user stories for identity capabilities - authentication (SSO, MFA, passwordless), authorization (RBAC/ABAC, delegated access), and the user lifecycle (registration, provisioning/SCIM, recovery, deprovisioning). Work with Engineering and Architecture on identity protocol decisions and implementation (OAuth 2.0, OpenID Connect, SAML, SCIM). Contribute to build-vs-buy and platform evaluations for identity providers, and help maintain the integration approach across Zinnia products. Balance security, privacy, and usability — helping reduce friction while protecting against account takeover, credential stuffing, and abuse. Partner with Security, Risk, and Compliance to en

GitLab is the intelligent orchestration platform for DevSecOps. GitLab enables organizations to increase developer productivity, improve operational efficiency, reduce security and compliance risk, and accelerate digital transformation. More than 50 million registered users and more than 50% of the Fortune 100* trust GitLab to ship better, more secure software faster. The same principles built into our products are reflected in how our team works: we embrace AI as a core productivity multiplier, with all team members expected to incorporate AI into their daily workflows to drive efficiency, innovation, and impact. GitLab is where careers accelerate, innovation flourishes, and every voice is valued. Our high-performance culture is driven by our values and continuous knowledge exchange, enabling our team members to reach their full potential while collaborating with industry leaders to solve complex problems. Co-create the future with us as we build technology that transforms how the world develops software. * Fortune 500® is a registered trademark of Fortune Media IP Limited, used under license. Claim based on GitLab data. Fortune 100 refers to the top 20% ranked companies in the 2025 Fortune 500 list, published in June 2025. Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of GitLab. An overview of this role You will engineer security improvements to the GitLab product as well as building and maintaining the tools we use to detect and prevent abuse on our SaaS platforms. A strong software engineering background with experience in large Ruby/Rails codebases is required. As a senior engineer on the Trust and Safety team, you will predictively identify abuse patterns and trends and build anomaly detection and prevention systems to mitigate abusive users and their activities. This role is an ideal fit for candidates with software engineering backgrounds interested in moving into security engineering. Formal

Replit is the agentic software creation platform that enables anyone to build applications using natural language. With millions of users worldwide, Replit is democratizing software development by removing traditional barriers to application creation. About the Role We're redefining how software is built and who gets to build it. Our mission is to achieve Autonomy for All: making programming accessible, collaborative, and powered by AI. Realizing that vision requires a platform that legitimate users can trust and adversarial actors cannot exploit. We're hiring a Data Scientist to help build Replit's Trust & Safety and Anti-Abuse program from the ground up. You'll turn noisy behavioral, identity, payment, infrastructure, and content signals into the measurement systems, detections, and decisions that protect Replit's users, platform, and economics. You'll work closely with Engineering, Support, Legal, Security, Infrastructure, Money, and Growth to make abuse economically unviable while keeping friction low for legitimate users. Replit sits at the frontier of AI-native abuse. Our platform is a target for phishing and scam hosting, cryptomining, LLM token farming, card and coupon fraud, referral abuse, and increasingly, abuse driven by AI agents themselves. You'll help define how we identify, measure, and respond to these threats without compromising the experience of good users. Who You Are You're a data scientist who moves fast, goes deep, and thinks adversarially. You can spin up an analysis in hours that would take others days, not by cutting corners, but because you've built the intuition and technical toolkit to get to the right answer quickly. You dig past the top-line abuse rate to understand selection effects, missing labels, policy changes, attacker adaptation, and the false positives hidden inside an aggregate metric. You understand that Trust & Safety data is imperfect and outcomes are high stakes. Ground truth is delayed, biased, and often incomple

About the Role OpenAI’s brands are trusted by hundreds of millions of users around the world. As awareness and adoption of OpenAI’s products continue to grow, so does the volume and sophistication of brand abuse, including impersonation, scams, copycat applications, fraudulent websites, social media misuse, and other forms of online infringement. We are seeking an experienced Brand Protection Manager to build and operate OpenAI’s global brand protection program. This role will lead efforts to identify, prioritize, and address misuse of OpenAI’s brands across websites, social media platforms, app stores, marketplaces, advertising networks, and other online ecosystems. The ideal candidate combines strong operational execution, investigative instincts, and program management skills. They are comfortable working across Legal, Marketing, Comms, Security, Trust & Safety, and external partners to address emerging threats and develop scalable enforcement programs. This role will lead OpenAI’s Brand Protection & Operations function and help ensure that OpenAI’s brands remain trusted, protected, and resilient as the company continues to grow globally. This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees. In this role, you will: Build and operate OpenAI’s global brand protection program. Monitor and respond to misuse of OpenAI brands across websites, social media, marketplaces, app stores, advertising platforms, and emerging online ecosystems. Develop and manage programs to protect OpenAI products, services, and associated brands. Coordinate investigations and enforcement efforts across online and offline channels. Partner with product, marketing, security, trust & safety, and legal teams to address brand abuse and emerging threats. Develop enforcement playbooks, prioritization frameworks, and escalation processes. Manage relationships with brand protection vendors, mon

About Us At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world’s largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of code. Internet properties powered by Cloudflare all have web traffic routed through its intelligent global network, which gets smarter with every request. As a result, they see significant improvement in performance and a decrease in spam and other attacks. Cloudflare was named to Entrepreneur Magazine’s Top Company Cultures list and ranked among the World’s Most Innovative Companies by Fast Company. At Cloudflare, we’re not looking for people who wait for a polished roadmap; we’re looking for the builders who see the cracks in the Internet that everyone else has simply learned to live with. We value candidates who have the instinct to spot a "normalized" problem and the AI-native curiosity to create a solution using the latest tools. Our culture is built on iteration, leveraging AI to ship faster today to make it better tomorrow, while ensuring that every improvement, no matter how small, is shared across the team to lift everyone up. If you’re the type of person who values curiosity over bureaucracy, and that AI is a partner in solving tough problems to keep the Internet moving forward, you’ll fit right in. Available Locations: Lisbon, Portugal About the Role Cloudflare is a system spanning the globe, on a mission to make the Internet safer and more powerful every day. To help fulfill this mission, we are seeking an incident response Analyst / Consultant to join our Cloudforce One REACT organization. In this role, you will respond to active customer attacks across two primary tracks: 1) L7 mitigations — bot abuse, web scraping, credential stuff

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role The Fraud Prevention team protects Anthropic's payment and monetization surfaces from financial abuse — keeping fraud losses, dispute rates, and network monitoring exposure in check while preserving a smooth experience for legitimate customers. As a software engineer on this team, you will build the systems that make risk decisions in real time, manage the dispute and chargeback lifecycle, and detect monetization abuse across subscriptions, in-app purchases, and promotions. The ideal candidate can see things from attackers' perspectives, anticipate their responses to countermeasures, and never loses sight of the fact that a false positive here is a paying customer. Payments fraud is more externally coupled than most trust and safety work — you'll collaborate closely with finance, support, and legal teams internally, and with payment processors and platform partners externally. Responsibilities: Design and build real-time risk decisioning that scores transactions at authorization time, balancing fraud loss, approval rates, and latency constraints Build tooling and automation for the dispute and chargeback lifecycle, from review queues to evidence collection and loss reporting Engineer fraud signals at scale — device fingerprinting, BIN and issuer signals, velocity features, and cross-account linkage — and detect monetization abuse across subscriptions, trials, promotions, and in-app purchases Own a portfolio of metrics — loss rate, dispute rate, authorization approval impact, and false-positive rate — rather than optimizing any single number Lead investigations into emerging fraud patterns, building multi-layered defense

About the Team At OpenAI, our User Safety & Risk Operations (USRO) team helps protect our products and users from abuse, fraud, safety risks, and other forms of misuse. We operate at the front line of real-world safety and risk management, translating user and operational signals into timely decisions, effective interventions, and improvements to our systems. This role sits on a team focused on building operational capacity for new, ambiguous, and fast-moving areas of work. The team defines what needs to be built, creates the operating model to support it, and works with partner teams to make the work scalable and durable over time. About the Role We are seeking a Device Safety & Risk Operations Specialist to build the safety operating model for a new category of consumer hardware. This is a senior individual-contributor role for someone who can turn emerging product risks and incomplete requirements into practical workflows, controls, launch plans, and durable systems. You will define how product-safety incidents, critical escalations, regulated cases, and privacy-sensitive issues should be identified, investigated, escalated, resolved, and learned from. You will also establish operational requirements for case management, data access, decision logging, quality assurance, monitoring, and cross-functional response. You will stand up priority workflows through launch and early operations, then help transition them into durable homes across USRO and partner teams. The right person combines deep operational judgment with strong technical and hardware product fluency. They can move from executive-level risk framing to detailed workflow design, tabletop exercises, launch readiness, frontline guidance, and post-launch improvement. Location / work model: San Francisco, CA; hybrid, 3 days/week in-office. Please note: This role may involve exposure to sensitive or concerning material. Strong discretion, judgment, and resilience are essential. In This Role, You Will: