Abuse Research Engineer Jobs

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role We are looking for software engineers to help build safety and oversight mechanisms for our AI systems. As a software engineer on the Safeguards team, you will work to monitor models, prevent misuse, and ensure user well-being. This role will focus on building systems to detect unwanted model behaviors and prevent disallowed use of models. You will apply your technical skills to uphold our principles of safety, transparency, and oversight while enforcing our terms of service and acceptable use policies. Responsibilities: Develop monitoring systems to detect unwanted behaviors from our API partners and potentially take automated enforcement actions; surface these in internal dashboards to analysts for manual review Build abuse detection mechanisms and infrastructure Surface abuse patterns to our research teams to harden models at the training stage Build robust and reliable multi-layered defenses for real-time improvement of safety mechanisms that work at scale You may be a good fit if you have: A Bachelor’s degree in Computer Science, Software Engineering or comparable experience Proficiency in Python and Typescript An ability to work across the stack Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders Strong candidates may also: 8+ years of experience in a software engineering position Have experience with integrity, spam, fraud, or abuse detection and mitigation Have experience building trust and safety detection mechanisms and intervention for AI/ML systems Have experience with prompt engineering, jailbreak attacks, and other adversarial inputs Have worked

At Rockstar Games, we create world-class entertainment experiences. Become part of a team working on some of the most rewarding, large-scale creative projects to be found in any entertainment medium - all within an inclusive, highly-motivated environment where you can learn and collaborate with some of the most talented people in the industry. Rockstar is on the lookout for a passionate Senior Cheat Software Engineer. As a Senior Cheat Software Engineer you’ll work closely with other engineering and product teams to research and implement solutions that mitigate threats to the player experience while staying ahead of evolving attack vectors. This is a full-time, permanent and in-office position based in Rockstar’s state-of-the-art game development studio in Dundee, Scotland. WHAT WE DO The Rockstar Games Cheat Software Engineering Team supports the entire cheat lifecycle including discovery, technical breakdown, reproduction, root cause analysis and remediation. We strive to understand the threat landscape affecting our titles and the gaming industry as a whole to maintain and continuously update our knowledge. We independently assess our applications, services, and builds to identify potential vulnerabilities and design flaws and work with development teams to remediate. RESPONSIBILITIES Reverse engineer, analyse, debug, and document application behaviours. Develop, fine-tune, and support anti-cheat measures and in-game abuse prevention systems. Drive root cause analysis efforts behind internally and publicly identified vulnerabilities. Collaborate with cross-functional teams to improve security controls and detection. Support the active development of internal tooling and anti-cheat solutions. Identify gaps in anti-cheat capabilities and detection&

At Rockstar Games, we create world-class entertainment experiences. Become part of a team working on some of the most rewarding, large-scale creative projects to be found in any entertainment medium - all within an inclusive, highly-motivated environment where you can learn and collaborate with some of the most talented people in the industry. Rockstar is on the lookout for a passionate Senior Cheat Software Engineer. As a Senior Cheat Software Engineer you’ll work closely with other engineering and product teams to research and implement solutions that mitigate threats to the player experience while staying ahead of evolving attack vectors. This is a full-time, permanent and in-office position based in Rockstar’s state-of-the-art game development studio in Edinburgh, Scotland. WHAT WE DO The Rockstar Games Cheat Software Engineering Team supports the entire cheat lifecycle including discovery, technical breakdown, reproduction, root cause analysis and remediation. We strive to understand the threat landscape affecting our titles and the gaming industry as a whole to maintain and continuously update our knowledge. We independently assess our applications, services, and builds to identify potential vulnerabilities and design flaws and work with development teams to remediate. RESPONSIBILITIES Reverse engineer, analyse, debug, and document application behaviours. Develop, fine-tune, and support anti-cheat measures and in-game abuse prevention systems. Drive root cause analysis efforts behind internally and publicly identified vulnerabilities. Collaborate with cross-functional teams to improve security controls and detection. Support the active development of internal tooling and anti-cheat solutions. Identify gaps in anti-cheat capabilities and detecti

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career. About the team The Radar ML team builds the fraud detection models that protect Stripe's $1.9 trillion payment network from fraud. The team owns 10+ real-time deep learning models that must constantly evolve to stay ahead of fraudsters. Each ML improvement translates directly into dollar impact for Stripe and its users. The team's models also power the Radar product suite that tens of thousands of businesses use to screen payments and manage fraud. Radar is growing fast, and the team is actively building new products like defenses against AI token theft, free trial abuse, and programmatic attacks. What you’ll do In this role, you will own ML work across the full lifecycle: researching new fraud patterns, building and deploying models, and sharing results directly with top Stripe customers. You will have opportunities to optimize Stripe’s most intensive ML models, and opportunities to ship 0-to-1 products from scratch. Responsibilities Build, train, evaluate, and deploy ML models that detect fraud across Stripe’s global payments network Research emerging fraud patterns like token theft and develop ML solutions to address them Apply advances in deep learning to improve model quality and detection rates at scale Co-build new fraud and abuse products directly with top users Who you are We're looking for someone who meets the minimum requirements to be considered for the role. If you meet these requirements, you are encouraged to apply. The p

About the Team The Integrity team at OpenAI is dedicated to ensuring that our cutting-edge technology is not only revolutionary, but also secure from a myriad of adversarial threats. We strive to maintain the integrity of our platforms as they scale. The Integrity team is at the front lines of defending against misuse in all its forms: content abuse, scaled attacks, and other actions that could undermine the user experience or harm our operational stability. About the Role As a Machine Learning Engineer in OpenAI's Integrity team, you will have the opportunity to work with some of the brightest minds in AI. You’ll work on state-of-the-art models and classifiers, experiment with new architecture and approaches, and push forward our abilities in content and user understanding. You’ll help turn research breakthroughs into tangible solutions that improve the trust and safety of our platform. If you're excited about training LLMs and building ML models, this role is your chance to make a significant mark. In this role, you will: Innovate and Deploy: Design and deploy advanced machine learning models that solve real-world problems. Bring OpenAI's research from concept to implementation, creating AI-driven applications with a direct impact. Collaborate with the Best: Work closely with researchers, software engineers, and product managers to understand complex business challenges and deliver AI-powered solutions. Be part of a dynamic team where ideas flow freely and creativity thrives. Optimize and Scale: Implement scalable data pipelines, optimize models for performance and accuracy, and ensure they are production-ready. Contribute to projects that require cutting-edge technology and innovative approaches. Learn and Lead: Stay ahead of the curve by engaging with the latest developments in machine learning and AI. Take part in code reviews, share knowledge, and lead by example to maintain high-quality engineering practices. Make a Difference: Monitor and maintain deployed m

About the Team Security is at the foundation of OpenAI’s mission to ensure that artificial general intelligence benefits all of humanity. The Security team protects OpenAI’s technology, people, and products. We are technical in what we build but are operational in how we do our work, and are committed to supporting all products and research at OpenAI. Our Security team tenets include: prioritizing for impact, enabling researchers, preparing for future transformative technologies, and engaging a robust security culture. About the Role As a Security Engineer you will join our OpenAI engineers and researchers in building, operating and securing transformational AI technologies. This role will focus on all aspects of Detection & Response but with a strong emphasis on detecting insider threats and influencing controls to safeguard OpenAI's most sensitive assets. In this role, you will: In this role, you will: Innovate on Detection and Response infrastructure to engineer and automate end-to-end detection and investigation workflows. Develop, measure, and tune detection rules to ensure effective and sustainable operations. Drive projects across OpenAI’s technology stack with a focus on insider threats, ranging from access abuse and intellectual property theft to novel risks emerging within AI infrastructure. Partner closely with cross-functional stakeholders, including HR, Legal, and peer investigative teams, providing technical expertise and evidence to support investigations. Collaborate on cutting-edge AI research, and use AI to improve OpenAI’s Security posture. You might thrive in this role if you: 5+ years experience working in a detection/response or insider-risk role.. We are seeking mid-level and senior candidates. You have broad familiarity with operating systems and platforms such as macOS, Windows, Linux, and Kubernetes, along with experience in cloud infrastructure. Knowledge of modern adversary tactics and attack paths, data exfiltration techniques, and h

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role We are looking for software engineers to help build safety and oversight mechanisms for our AI systems. As a software engineer on the Safeguards team, you will work to monitor models, prevent misuse, and ensure user well-being. This role will focus on building systems to detect unwanted model behaviors and prevent disallowed use of models. You will apply your technical skills to uphold our principles of safety, transparency, and oversight while enforcing our terms of service and acceptable use policies. We have multiple teams that are currently hiring within Safeguards. Team placement occurs after the interview process, taking into account your interests and experience alongside organizational needs. This flexible approach allows us to match talented engineers where they'll have the greatest impact and growth potential. Responsibilities: Develop monitoring systems to detect unwanted behaviors from our API partners and potentially take automated enforcement actions; surface these in internal dashboards to analysts for manual review Build abuse detection mechanisms and infrastructure Surface abuse patterns to our research teams to harden models at the training stage Build robust and reliable multi-layered defenses for real-time improvement of safety mechanisms that work at scale You may be a good fit if you: Bachelor’s degree in Computer Science, Software Engineering or comparable professional experience Proficiency in at least one programming language such as Python, Java, etc. Ability to work across the stack Strong communication skills and ability to explain complex technical concepts to non-technical stake

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. Note: this job post is for Fullstack Software Engineers only. If you are a Backend Engineer, please see our Backend Software Engineer post here . About the role We are looking for fullstack software engineers to help build safety and oversight mechanisms for our AI systems. As a software engineer on the Safeguards team, you will work to monitor models, prevent misuse, and ensure user well-being. This role will focus on building systems to detect unwanted model behaviors and prevent disallowed use of models. You will apply your technical skills to uphold our principles of safety, transparency, and oversight while enforcing our terms of service and acceptable use policies. We have multiple teams that are currently hiring within Safeguards. Team placement occurs after the interview process, taking into account your interests and experience alongside organizational needs. This flexible approach allows us to match talented engineers where they'll have the greatest impact and growth potential. Responsibilities: Design and build the internal review tools analysts use to investigate abuse — dashboards, case queues, and evidence viewers that make high-volume, high-stakes decisions fast and accurate. Build the interfaces where humans supervise agents: streaming output, interruption and approval flows, and clear provenance for every action an agent takes. Surface abuse patterns to our research teams through the visualizations and exploration tools that make emerging patterns legible. Own the frontend architecture for tools handling sensitive data at scale — performance under large datasets, correctness under real-time updates,

About the Team The Applied team brings OpenAI’s technology to the world through products used by hundreds of millions of people and by developers and businesses building on our APIs. We work across research, engineering, product, policy, safety, and operations to deploy frontier AI systems responsibly and safely. The Trust & Safety Data Engineering team builds the data foundations that help OpenAI understand, detect, investigate, and mitigate abuse and safety risks across our products. We partner with Integrity, Investigations, Safety Systems, Product Policy, Privacy, Data Science, Engineering, and Data Platform to create reliable, privacy-safe datasets and pipelines for fraud and abuse detection, enforcement workflows, safety measurement, ML feature generation, launch readiness, and transparency reporting. About the Role We are hiring a Technical Lead Manager to lead and grow the Trust & Safety Data Engineering team. This is a hands-on leadership role for someone who can set strategy, shape data architecture, align senior stakeholders, coach engineers, and drive execution on high-impact data systems. You will help turn fragmented launch and incident support into durable, reusable, privacy-safe data foundations that Trust & Safety teams can rely on. The systems your team builds will help OpenAI detect risk, investigate abuse, power operational workflows, develop and evaluate safety models, measure interventions, support product launches, and report accurately on platform integrity. In This Role, You Will Lead and grow a high-performing Trust & Safety Data Engineering team. Define the roadmap and technical strategy for Trust & Safety data systems. Build canonical, privacy-safe datasets and pipelines for abuse detection, fraud detection, risk signals, enforcement, scaled review, transparency reporting, and safety monitoring. Create reusable foundations for Trust & Safety model development, including features, labels, training data, backtesting,

About the role We’re looking for an engineering manager to lead a team building software systems that detect and prevent harmful misuse of frontier AI models—before incidents occur. This is a builder’s role: you’ll lead engineers shipping production services, detection pipelines, and mitigation mechanisms that protect frontier model integrity and reduce high-severity misuse risk. While this work intersects with frontier model development, security and risk, we’re explicitly seeking someone with a software engineering foundation who is comfortable building reliable systems that can operate at billions of users scale. In this role you will: Lead a team of software engineers building detection + mitigation systems for frontier model misuse, with an emphasis on model IP protection / distillation detection and emerging risk surfaces from autonomous agents. Set the technical roadmap and execution strategy: prioritize, design, ship, iterate, measure impact. Build production systems: services, pipelines, tooling, instrumentation, and automation that scale with frontier model usage. Partner deeply with Research and Product to translate evolving model capabilities into concrete tests, signals, and mitigations that can be deployed at scale. Drive strong engineering fundamentals: architecture, reliability, monitoring, performance, and operational excellence. Hire and grow an exceptional team across backend, data systems, and applied ML engineering domains as needed. Anticipate what breaks at scale as agentic workflows become more capable. You might thrive in this role if you: Experience building systems in adversarial, fast-evolving environments Are comfortable with ambiguity and novelty Have experience adjacent to security (e.g., abuse prevention, fraud, integrity, platform defense, auth/identity, malware/spam, adversarial environments) Communicate clearly and build trust quickly with senior stakeholders—pragmatic, collaborative, and calm under scrutiny. Significant experience

Perplexity is seeking a highly skilled, experienced and hands-on Offensive Security Engineer to join our dynamic security team, taking an adversarial approach to hardening Perplexity's infrastructure, applications, and AI systems. You'll plan and execute red team operations, penetration tests, and attack simulations across our cloud infrastructure, web and mobile applications, AI/ML pipeline, and corporate environment—finding real vulnerabilities before adversaries do and working directly with engineering teams to drive remediation. Responsibilities Plan and execute red team and purple team engagements simulating advanced threat actors across cloud infrastructure (AWS, Kubernetes), endpoints, and application surfaces Conduct continuous penetration testing of web applications, APIs, mobile clients, browser extensions, cloud infrastructure, and internal services Assess AI/ML-specific attack surfaces including prompt injection, model exfiltration, agent abuse, tool-use exploitation, and MCP security boundaries Develop and maintain custom offensive tooling, exploits, and automation to improve the efficiency and coverage of security testing Perform open-scope adversary simulations that test detection and response capabilities end to end, collaborating closely with the defensive security team Drive threat modeling sessions with engineering teams to identify and prioritize attack vectors in new features and architectures Deliver clear, actionable findings to both technical and executive audiences; partner with engineering to validate remediations Contribute to the security of CI/CD pipelines, supply chain integrity, and secrets management through offensive assessment Stay current on emerging attack techniques, vulnerability research, and adversary tradecraft; bring external perspective into Perplexity's security strategy Qualifications 5+ years of hands-on experience in offensive security, red teaming, or penetration testing Deep technical expertise in at least two of: clo

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Anthropic is dedicated to developing AI assistants that are helpful, harmless, and honest. As usage of our AI services grows, we need to ensure they are not misused. The Safeguards team is at the forefront of protecting our users from the risks of powerful AIs as well as ethical, technical, and social risks from the use of generative AI. The Safeguards team at Anthropic builds protections for new AI features enabled by the research teams and protects new products and surfaces developed by our product teams. As a Product Manager for the Safeguards team at Anthropic, you will own the ideation, design, development and deployment of Safeguards systems and relevant product UX to ensure we are advancing frontier models safely to users across various cloud platforms. You will work closely with our research and product teams to develop detections, evals, interventions, and tools to measure and mitigate deployment and user risks. We are looking for a product manager who is deeply committed to making AI safe and beneficial for humanity. You are aware of the risks and are committed to working with experts and coming up with ideas for Anthropic to implement. You have deep technical expertise in development, deployment and measurement of Safeguards systems. You thrive in rapidly moving and ambiguous environments. Responsibilities Determine how to build in safety by design upstream and leverage downstream defenses for Anthropic’s frontier models, AI products, customers on different surfaces - Claude.ai, 1P API, external Cloud providers. Ability to write safety evals and communicate externally about saf

About the Team Netlify runs on usage. Developers buy credits, teams consume compute and bandwidth, and enterprises commit to spend. The Accounts and Billing area owns how all of that works: the accounts foundation every customer signs into, the billing platform that meters and charges them, and the pricing and packaging model that sets what they pay. It sits at the center of how Netlify grows, and it touches Finance, Growth, UX, Sales, and the executive team. As a Staff Product Manager, you’ll help define and evolve Netlify’s monetization model, bringing a strong point of view while partnering across the company to make high-impact decisions, and you will build hands-on next to engineering, Finance, and design rather than run a team from above. You’ll collaborate closely with senior leaders, including the CEO and CFO, as we continue to evolve Netlify’s pricing and packaging strategy. What You'll Do Lead the strategy and evolution of pricing, packaging, and monetization, including plans and tiers, the credit and usage model, seat-versus-consumption economics, on-demand and overage rates, enterprise commitments and discounting, storage pricing, regional pricing, and annual plans. Ship billing as a product: metering accuracy, invoicing, payments, refunds, and customer-facing usage visibility, including the billing and usage interfaces enterprises are asking for. Steward the accounts foundation: sign-up and authentication, identity, orgs and teams and seats, roles and permissions, account security, and fraud and abuse at the top of the funnel. Build and lead the pricing and packaging experimentation program, using data, customer insight, and sound judgment to guide decisions: product analytics, conversion and activation, and credit-consumption telemetry. Partner with Finance to develop pricing approaches that balance customer value, business goals, and long-term sustainability. Partner with engineering and cross-functional stakeholders to set priorities, evaluate tradeo

About the Team The Intelligence and Investigations team seeks to rapidly identify and mitigate abuse and strategic risks to ensure a safe online ecosystem. We are dedicated to identifying emerging abuse trends, analyzing risks, and working with our internal and external partners to implement effective mitigation strategies to protect against misuse. Our efforts contribute to OpenAI's overarching goal of developing AI that benefits humanity. The Strategic Intelligence & Analysis (SIA) team provides safety intelligence for OpenAI’s products by monitoring, analyzing, and forecasting real-world abuse, geopolitical risks, and strategic threats. Our work informs safety mitigations, product decisions, and partnerships, ensuring OpenAI’s tools are deployed securely and responsibly across critical sectors. About the Role As an Agentic Risk Analyst, you will shape OpenAI’s operating picture for current agentic risk across products and platforms. You will bring a strategic, system-level perspective to current risks, connecting individual incidents, technical findings, abuse patterns, and external developments to relevant workstreams, mitigations, owners, dependencies, and residual gaps. You will analyze how risks emerge through autonomy, multi-step task execution, tool use, memory, retrieval, connectors, computer-use capabilities, and multi-agent workflows, with a particular focus on both adversarial misuse and unintended system behavior. By synthesizing signals from investigations, evaluations, red teaming, security reviews, product launches, external research, and real-world incidents, you will maintain a current view of material risks and evolving threat patterns. Your work will help turn complex and often ambiguous signals into coordinated decisions and measurable follow-through across product, safety, security, policy, and governance teams. You will work closely with investigators, engineers, product, policy, safety, and security teams, and measurement and forecasting

About the Team Our Safety Systems team is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency. Within Safety Systems, the Model Policy team aligns model behavior with desired human values and norms. We co-design policy with models and for models by driving rapid policy taxonomy iteration based on data and defining evaluation criteria for foundational models’ ability to reason about safety. About the Role Frontier AI systems are rapidly expanding what is possible in cybersecurity and software engineering. These capabilities create major defensive opportunities, but they also raise serious dual-use and misuse risks across areas such as malware development, exploit discovery, vulnerability chaining, credential abuse, cyber intrusion, and autonomous offensive operations. In this role, you will help define how OpenAI’s models should behave in high-risk cybersecurity contexts. You will develop policy frameworks, threat models, taxonomies, evaluations, and behavioral specifications that guide model behavior across training, deployment, and monitoring systems. This role sits at the intersection of cybersecurity, AI safety, threat modeling, evaluation science, and policy implementation. You will work closely with research, engineering, safety training, preparedness, and product teams to build policies that are technically grounded, measurable, enforceable, and responsive to real-world cyber risk. Your Responsibilities: Design and maintain model policies for cybersecurity and frontier-risk domains, especially dual-use and high-risk cyber capabilities. Translate cybersecurity threat models into clear behavioral specifications, evaluation criteria, grading guidance, and system-level mitigations. Define practical boundaries between legitimate security research, defensive workflows, and assistance that could materially enable harmful activity. Build policy artifacts that support i