Abuse Research Engineer Jobs

SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today, SpaceX is actively developing the technologies to make this possible, with the ultimate goal of making life multiplanetary and expanding consciousness to the stars. SpaceXSI is building Super Intelligence to help humanity understand the universe. Our teams are building the full Super Intelligence stack: from our Colossus supercomputers, to Grok models, to our suite of applications, including Grok Bot, Grok Build, Grok Imagine, Grok Voice, and X. We're creating a powerful flywheel where more compute trains better models, better models power more useful products, and what we learn from people using those products shapes what we build next. ABOUT THE ROLE: We serve our community of users and customers by working tirelessly to preserve free expression and choice, create limitless interactivity, and maintain a safe digital marketplace. The Safety Integrity Program Manager, Harmful Activity will drive priorities, measures, and system health for harmful activity, owning program standards and execution across upstream systems and downstream operations. You are an experienced program manager with a strong background in content integrity, abuse, or risk programs at scale. You are skilled at setting requirements for detection and automation, translating policy and legal constraints into practical workflows and controls, and driving cross-functional partners to improve coverage, precision, and enforcement quality. You thrive in fast-paced environments and excel at turning operational signals into lasting improvements. RESPONSIBILITIES: Drive priorities, measures, and system health for harmful activity, and continuously improve execution Set requirements and success criteria for detection and automation, and drive Product, Engineering, and Operations to improve coverage, precision, and enforcement quality at scale. Translate

About the Team At OpenAI, our User Operations team safeguards our products and users from legal risk, regulatory non-compliance, fraud, and abuse. The team operates at the intersection of operations, compliance, and user trust, embedded within the broader User Operations organization and collaborating cross-functionally with Legal, Governance Risk & Compliance, Policy and Engineering. We support a global and diverse user base across OpenAI’s suite of product offerings, and developer tools by managing sensitive inbound tickets, regulatory obligations, and escalations. Every user-facing action is grounded in our commitment to legal integrity, ethical practice, and regulatory excellence. About the Role We are seeking an independent, adaptive, and operations-minded Regulatory Operations Analyst to help scale and evolve OpenAI’s global regulatory and compliance operations from San Francisco. This role focuses on complex regulatory operations, including work under the EU Digital Services Act (DSA) and EU AI Act, as well as regulatory inquiries and complaints across the Americas, and Asia-Pacific. You’ll manage sensitive cases independently, exercise sound judgment on escalations, and work closely with Legal Counsel, Governance, Risk and Compliance (GRC), and other cross-functional partners. You’ll also bring a working understanding of privacy and intellectual property matters so you can recognize and escalate related issues when needed. Beyond frontline casework, you’ll help shape the documentation, workflows, tooling, and automation that support safe, scalable and regulatory and legal compliance operations. This role is essential to building scalable, high-integrity operations that protect user rights, meet our obligations under emerging and current regulations. You’ll also contribute to multi-phase transitions and automation efforts that support our long-term operational model. Please note: This role may involve exposure to sensitive or concerning content, including

Adobe Risk Platform (ARP) is Adobe's centralized, adaptive system for detecting, preventing, and mitigating fraud and abuse across products and services, delivering robust security without degrading customer experience. It protects surfaces like Commerce, Stock, and Firefly with real-time risk decisions. As a Sr Staff Engineer on ARP, you'll set the architectural direction for risk mitigation across Adobe. You'll define the standards, patterns, and long-term technical strategy that let ARP and Adobe stay ahead of fraud and abuse as it evolves. What you'll do Architect systems built for the next three to five years of risk mitigation, while delivering impact iteratively and solving today's most important priorities along the way. Push the platform to the forefront of AI and ML to strengthen fraud and abuse detection. Lay the foundational building blocks of the Risk Platform that future risk-mitigation capability builds on, including the platform's shift toward event-driven, continuously-reasoning risk intelligence. Set architectural standards for risk-decisioning services that other teams across Adobe adopt. Share architectural thinking broadly, through design docs that become org-wide standards, white papers, tech talks, or cross-org design reviews. Simplify complex, interlinked systems into designs other teams can build on with confidence. Mentor senior and staff engineers across teams, growing the next generation of technical leaders. What you need to succeed Bachelor's or advanced degree in Computer Science or related field, or equivalent experience; Master's preferred. 12+ years architecting high-scale, highly performant platforms, and leading the technical teams that build them. Deep understanding of AI and ML, both to strengthen fraud detection and to counter AI-powered attacks. D

About the Role Adobe is seeking a Machine Learning Engineer to join the Adobe Genuine Engineering team. This group protects Adobe's ecosystem from fraud, abuse, and misuse using intelligent systems worldwide. In this position, you will build and develop machine learning models from scratch, including custom transformer-based frameworks, to identify fraudulent actions, stop account sharing, and protect the experience of hundreds of millions of users. You will manage the entire model lifecycle: raw behavioral data and feature engineering, architecture development, large-scale GPU training, deployment, and monitoring. The team is actively building in-house behavioral foundation models that learn identity-preserving representations from long sequences of user activity. This is a role for an engineer who wants to own deep learning systems end-to-end — not consume pre-built ones. Key Responsibilities Build and train deep learning models from scratch, including custom transformer and attention-based architectures for long behavioral event sequences. Own the full training stack: event tokenization, temporal and positional embeddings, self-supervised pretraining (e.g., masked modeling, contrastive learning), and downstream fine-tuning. Train large models efficiently on GPU infrastructure using mixed-precision training, gradient accumulation/checkpointing, efficient attention, and distributed strategies (DDP, FSDP, or equivalent). Build and optimize feature pipelines on Databricks and Spark, transforming raw behavioral events into high-quality model inputs. Translate prototypes into production ML systems — scalable, reliable, and observable — and drive inference performance through architectural and serving-side optimization. Contribute to MLOps practices: experiment tracking, model versioning, CI/CD, automated retraining, and

About the Team The Integrity team builds the systems that protect OpenAI’s products, users, and ecosystem from abuse. We work across product engineering, infrastructure, safety, and operations to detect and prevent harmful, fraudulent, deceptive, and adversarial activity at global scale. As OpenAI builds new ads experiences, we are establishing the integrity foundation that will keep the ads ecosystem safe and trustworthy from the start. This includes protecting advertiser onboarding, detecting unsafe or policy-violating ad content, preventing fraudulent and abusive advertiser behavior, and defending the ads ecosystem against spam, manipulation, and other forms of abuse. Ads Integrity is a new and highly cross-functional area. The team partners closely with Ads, Product, Safety, Policy, ML, Privacy, Security, and operations teams to build protections directly into the ads platform rather than layering them on after the fact. This is an opportunity to define how integrity works for a new ads ecosystem from first principles. About the Role We’re looking for an experienced Software Engineer to build the backend systems and infrastructure that keep OpenAI’s ads products safe, trustworthy, and resilient to abuse. In this foundational role, you will design systems that detect, prevent, and respond to harmful, deceptive, fraudulent, or policy-violating activity across the ads lifecycle. The problems span advertiser onboarding and verification, account and behavioral risk, content safety, spam and fraudulent interactions, detection and enforcement infrastructure, and the systems that connect integrity signals and models to real-time product decisions. This is not an ML-specialist role, but familiarity with ML for Ads integrity is always welcome. You’ll work closely with ML engineers and researchers and build systems that consume and operationalize ML-based signals, but your primary focus will be designing and operating robust backend and distributed systems. You’ll help det

Non-Financial Risk (Enterprise Risk) Consultant – All Levels Location: London (Hybrid) | Practice Area: Finance, Risk, Regulatory & Financial Crime | Type: Permanent Drive impactful change across enterprise risk, market abuse, and surveillance frameworks The Role Capco is looking for Management Consultants with expertise in Non-Financial Risk to join our growing Finance, Risk, Regulatory & Financial Crime (FRRF) capability. You'll work on a variety of projects for leading financial institutions, delivering risk transformation and advisory services across enterprise and operational risk. Acting as a trusted advisor, you'll help shape the future of risk frameworks, controls, governance, and surveillance capabilities. You'll also embrace AI-enabled ways of working, using approved AI tools to enhance analysis, improve delivery efficiency, and support better decision-making while applying appropriate human judgement and responsible AI practices. What You'll Do Support enterprise and operational risk transformation projects, leveraging AI-enabled analysis where appropriate to improve delivery, insight, and efficiency. Document, assess, and enhance risk processes and controls across the first and second lines of defence, identifying opportunities for automation and AI-enabled workflow improvements. Contribute to market abuse and trade surveillance initiatives by reviewing controls, detection scenarios, and the responsible application of AI to improve surveillance effectiveness and reduce false positives. Support AI model tuning and optimisation activities within surveillance environments, ensuring appropriate governance, validation, auditability, and human oversight. Engage stakeholders across business, technology, compliance, and risk functions to deliver collaborative, data-driven transformation initiatives. What We're Looking For Experience in enterprise or operational risk, ideally within financial services. Strong understanding of market abuse regulation and t

About the Team At OpenAI, our Trust, Safety & Risk Operations teams safeguard our products, users, and the company from abuse, fraud, scams, regulatory non-compliance, and other emerging risks. We operate at the intersection of operations, compliance, user trust, and safety working closely with Legal, Policy, Engineering, Product, Go-To-Market, and external partners to ensure our platforms are safe, compliant, and trusted by a diverse, global user base. The Global Safety Response Operations team provides 24/7 coverage for user safety, risk, and regulatory escalations across OpenAI’s products, handling the highest-priority cases that require human judgment and rapid response. The team operates as the core escalation and delivery arm of OpenAI’s safety operations, ensuring that our products remain safe and aligned with policy while enabling timely, empathetic, and consistent user support. About the Role The Global Safety Response Operations Lead is a hands-on team lead who both manages a regional Safety Response team and personally handles high-risk safety cases. This role combines frontline safety work with people leadership, operational ownership, and cross-functional coordination. You will lead a team of Safety Response Analysts who handle OpenAI’s most sensitive and high-impact cases, while also personally contributing to casework for complex, high-risk, or high-visibility issues. You will own the execution of high severity escalations in your region and ensure proper execution and communication to cross functional stakeholders You will be accountable for ensuring your region consistently meets utilization, quality, and SLA targets while serving as the operational interface with Product, Policy, Legal, Investigations, and regional stakeholders. This is a 24/7 global operation that requires flexibility to support rotating shifts, including nights, weekends, and holidays, as part of a leadership on-call model. In This Role, You Will: Lead and coach a regional te

About the Team At OpenAI, Trust & Safety Operations is central to protecting OpenAI’s platform, customers, and the public from abuse. We partner closely with Product, Engineering, Legal, Policy and Go To Market teams to identify emerging risks, build and mature enforcement systems, and ensure high-integrity operations while delivering a great user experience at scale. We’re building the Monetization Trust & Safety Operations team to ensure OpenAI can grow advertising in a way that is safe, trusted, and sustainable—for users, advertisers, and the business. This team sits at the intersection of operational scale, product risk, and rapid revenue growth, designing systems and operations that enable ads to scale without compromising user trust or safety. It’s critical to us that our Ads product be built in a way that corresponds to our Ads principles , and this team is key to that. About the Role We’re looking for a senior operator with strong analytical instincts to help build and scale Monetization Trust & Safety Operations at OpenAI. In this role, you’ll flex across the team’s highest-priority data and operational needs—from reporting and dashboard insights to budget and capacity planning, project-based analysis, and data automation —while partnering closely with Product, Policy, Engineering, Legal, Go To Market, and Data Science and Data Engineering teams. This role sits at the intersection of strategy, execution, and data: you’ll define ambiguous problems, query and validate data, build decision-support systems, and translate operational signals into clear recommendations and scalable, AI-first solutions. You should be comfortable moving from a high-level question to a rigorous analysis, a useful dashboard, an automated workflow, or a durable operating mechanism. As OpenAI introduces new revenue-generating formats and partnerships, you’ll help the team understand where risks, capacity constraints, quality gaps, and opportunities are emerging. You’ll brin

About the Team At OpenAI, Trust & Safety Operations is central to protecting OpenAI’s platform, customers, and the public from abuse. We partner closely with Product, Engineering, Legal, Policy and Go To Market teams to identify emerging risks, build and mature enforcement systems, and ensure high-integrity operations while delivering a great user experience at scale. We’re building the Monetization Trust & Safety Operations team to ensure OpenAI can grow advertising in a way that is safe, trusted, and sustainable—for users, advertisers, and the business. This team sits at the intersection of operational scale, product risk, and rapid revenue growth, designing systems and operations that enable ads to scale without compromising user trust or safety. It’s critical to us that our Ads product be built in a way that corresponds to our Ads principles , and this team is key to that. About the Role We’re looking for a senior operator to help build and scale Monetization Trust & Safety Operations at OpenAI. In this role, you’ll own critical Ads T&S workstreams from problem framing through scaled operation, partnering closely with Product, Policy, Engineering, Legal, and Go To Market to turn ambiguous priorities into durable operating models. This role sits at the intersection of strategy and execution: you’ll define scope, align owners, manage milestones and risks, resolve dependencies, and build the workflows, decision structures, and operating mechanisms that allow Ads Trust & Safety to scale. You’ll move between standing up new programs, stabilizing existing workflows, and handing off durable ownership as priorities evolve. As OpenAI introduces new revenue-generating formats and partnerships, you’ll bring structure to complex initiatives that balance user safety, advertiser experience, and business growth. You’ll use data and frontline signals to identify bottlenecks, quality gaps, capacity needs, and high-leverage interventions, and communicate clear

About the Role Adobe is seeking a Machine Learning Engineer to join the Adobe Genuine Engineering team. This group protects Adobe's ecosystem from fraud, abuse, and misuse using intelligent systems worldwide. In this position, you will build and develop machine learning models from scratch, including custom transformer-based frameworks, to identify fraudulent actions, stop account sharing, and protect the experience of hundreds of millions of users. You will manage the entire model lifecycle: raw behavioral data and feature engineering, architecture development, large-scale GPU training, deployment, and monitoring. The team is actively building in-house behavioral foundation models that learn identity-preserving representations from long sequences of user activity. This is a role for an engineer who wants to own deep learning systems end-to-end — not consume pre-built ones. Key Responsibilities Build and train deep learning models from scratch, including custom transformer and attention-based architectures for long behavioral event sequences. Own the full training stack: event tokenization, temporal and positional embeddings, self-supervised pretraining (e.g., masked modeling, contrastive learning), and downstream fine-tuning. Train large models efficiently on GPU infrastructure using mixed-precision training, gradient accumulation/checkpointing, efficient attention, and distributed strategies (DDP, FSDP, or equivalent). Build and optimize feature pipelines on Databricks and Spark, transforming raw behavioral events into high-quality model inputs. Translate prototypes into production ML systems — scalable, reliable, and observable — and drive inference performance through architectural and serving-side optimization. Contribute to MLOps practices: experiment tracking, model versioning, CI/CD, automated retraining, and

About the Team The Intelligence and Investigations team is dedicated to ensuring the safe, responsible deployment of AI by rapidly detecting and mitigating abuse. Our team leverages the latest testing methodologies to uncover vulnerabilities and emerging threats, helping safeguard OpenAI’s products and users. We work closely with cross-functional partners across product, policy, and engineering to drive a comprehensive defense strategy against evolving adversarial challenges. About the Role As a Red Team Specialist focused on cyber, you will help answer two practical questions: What cyber capabilities can our models provide to real-world attackers, and do our safeguards remain effective when those attackers use increasingly sophisticated techniques? The role combines scaled evaluation with expert-driven testing. You may bring deeper experience in cybersecurity and use that expertise to judge whether a model’s behavior meaningfully changes attacker capability. Alternatively, you may bring deeper experience in model evaluations, automation, or agentic harnesses and apply those skills to building rigorous cyber testing. We do not expect every candidate to be equally deep in both areas, but successful candidates will have a strong foundation in one and enough fluency in the other to work effectively across the boundary. Most of your work will focus on model cyber capabilities and safeguards; you will also spend a portion of your time testing novel abuse risks in agentic systems. This role is located in San Francisco, CA or Seattle, WA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees. In this role, you will: Design and run rigorous evaluations of model cyber capabilities and safeguards, including policy adherence, correct refusal, over refusal, and resilience to jailbreaking and other adversarial techniques. Conduct hands-on testing to understand what models can enable when used by experienced security practiti

About the Team The Intelligence and Investigations team is dedicated to ensuring the safe, responsible deployment of AI by rapidly detecting and mitigating abuse. Our team leverages the latest testing methodologies to uncover vulnerabilities and emerging threats, helping safeguard OpenAI’s products and users. We work closely with cross-functional partners across product, policy, and engineering to drive a comprehensive defense strategy against evolving adversarial challenges. About the Role As a Red Teamer focused on cyber, you will help answer two practical questions: What cyber capabilities can our models provide to real-world attackers, and do our safeguards remain effective when those attackers use increasingly sophisticated techniques? The role combines scaled evaluation with expert-driven testing. You may bring deeper experience in cybersecurity and use that expertise to judge whether a model’s behavior meaningfully changes attacker capability. Alternatively, you may bring deeper experience in model evaluations, automation, or agentic harnesses and apply those skills to building rigorous cyber testing. We do not expect every candidate to be equally deep in both areas, but successful candidates will have a strong foundation in one and enough fluency in the other to work effectively across the boundary. Most of your work will focus on model cyber capabilities and safeguards; you will also spend a portion of your time testing novel abuse risks in agentic systems. This role is located in San Francisco, CA or Seattle, WA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees. In this role, you will: Design and run rigorous evaluations of model cyber capabilities and safeguards, including policy adherence, correct refusal, over refusal, and resilience to jailbreaking and other adversarial techniques. Conduct hands-on testing to understand what models can enable when used by experienced security practitioners, in

About the Team At OpenAI, our User Safety & Risk Operations (USRO) team helps protect our products and users from abuse, fraud, safety risks, and other forms of misuse. We translate real-world user and operational signals into timely decisions, practical interventions, and improvements to our products and systems. This role will take on new, ambiguous, or underdeveloped operational risks and help mature them into scalable capabilities. We work across USRO and partner closely with Product, Engineering, Data Science, Product Policy, Legal, Safety, Support, and external vendors or partnership stakeholders. About the Role We are seeking a Senior Operations Analyst to take on complex, ambiguous safety and risk problems and turn them into practical operational solutions that can scale. This is a senior individual-contributor role for a versatile operator who is comfortable moving between queues, investigation, analysis, workflow design, hands-on execution, and cross-functional leadership. Depending on team needs, the role may focus on emerging-risk incubation, cloud deployment partnerships, or other new operational areas. You will be expected to move quickly, work hands-on, and create structure without waiting for perfect requirements or a large support team. The work starts with the problem, not a prescribed process. You may investigate unstructured user signals, stand up a lightweight workflow, build an AI-assisted tool, improve an existing operation, or help a new launch become operationally ready. The goal is to produce durable systems that other people can run, not simply complete a series of individual tasks. The portfolio will change with company priorities and may span established harm areas, emerging-risk incubation, cloud deployments and partnerships, device safety, or new product launches. Some hires may focus primarily on cloud deployment operations, including launch readiness, partner coordination, safety workflows, and operational monitoring. You will ty

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. We are hiring a Senior Security Engineer, dedicated to Product Security Incident Response. In this role, you will lead and architect Snowflake's product-integrated Incident Response strategy, with a primary focus on AI and LLM security. You'll design, plan, and drive the implementation of incident response capabilities across Snowflake's AI product surface - including Cortex AI, Cortex Agents, Snowflake Intelligence, and the data pipelines that power them. AS A SENIOR SECURITY ENGINEER, AI INCIDENT RESPONSE AT SNOWFLAKE, YOU WILL: Lead incident response for product-level security events, with deep focus on AI-specific threat vectors including prompt injection, model abuse, agent hijacking, and data exfiltration through AI workloads. Integrate IR into AI product pipelines - work directly with teams shipping Cortex features, Snowflake Intelligence, and AI-powered developer experiences to embed security requirements from design through deployment. Develop and codify our AI abuse response strategy - defining detection, containment, and remediation playbooks for LLM misuse, adversarial inputs, and AI-assisted attacks targeting Snowflake customers. Address tech debt across the AI product stack, ensuring that new Cortex and agentic architectures meet IR readiness requirements from

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. We are hiring a Senior Security Engineer, dedicated to Product Security Incident Response. In this role, you will lead and architect Snowflake's product-integrated Incident Response strategy, with a primary focus on AI and LLM security. You'll design, plan, and drive the implementation of incident response capabilities across Snowflake's AI product surface - including Cortex AI, Cortex Agents, Snowflake Intelligence, and the data pipelines that power them. AS A SENIOR SECURITY ENGINEER, AI INCIDENT RESPONSE AT SNOWFLAKE, YOU WILL: Lead incident response for product-level security events, with deep focus on AI-specific threat vectors including prompt injection, model abuse, agent hijacking, and data exfiltration through AI workloads. Integrate IR into AI product pipelines - work directly with teams shipping Cortex features, Snowflake Intelligence, and AI-powered developer experiences to embed security requirements from design through deployment. Develop and codify our AI abuse response strategy - defining detection, containment, and remediation playbooks for LLM misuse, adversarial inputs, and AI-assisted attacks targeting Snowflake customers. Address tech debt across the AI product stack, ensuring that new Cortex and agentic architectures meet IR readiness requirements from