Abuse Investigator Jobs

About the Team OpenAI’s Safety teams work to ensure our products are safe, trusted, and resilient as frontier AI systems scale globally. We tackle some of the company’s most important challenges across understanding and preventing misuse and misalignment, intercepting fraud and abuse, and protecting vulnerable users. We are hiring Data Scientists to help build the analytical foundations that allow OpenAI to deploy increasingly capable AI responsibly. We are hiring Data Scientists across several teams that contribute to safety in different ways, including: Safety Systems Integrity Product Policy This is a high-impact role operating at the intersection of product, safety, policy, and research. About the Role As a Data Scientist, Safety, you will help solve complex and ambiguous problems where rigorous analysis directly informs critical decisions. Depending on your background and team alignment, you may work on areas such as: Measure harmful or abusive behavior across OpenAI’s products Detect fraud, manipulation, coordinated misuse Evaluate and improve safety classifiers, rules systems, mitigation systems, and human review workflows Design experiments and causal analyses to understand product, policy, and mitigation impacts Build prevalence estimators, dashboards, monitoring systems, and executive decision frameworks Diagnose gaps in safety and integrity systems using behavioral and product data, and help quantify and navigate false positive / false negative tradeoffs Translate ambiguous safety risks into measurable problems and evidence-based recommendations Partner with Product, Engineering, Policy, Research, and Operations teams to improve safety outcomes Build zero-to-one analytical systems in rapidly evolving domains Ideal Candidate We’re looking for strong Data Scientists who thrive in ambiguous, high-leverage environments. You may be a fit if you have: Strong statistical reasoning and analytical judgment Experience with experimentation, causal inference, or obse

About the Team The Integrity team at OpenAI is dedicated to ensuring that our cutting-edge technology is not only revolutionary, but also secure from a myriad of adversarial threats. We strive to maintain the integrity of our platforms as they scale. The Integrity team is at the front lines of defending against misuse in all its forms: content abuse, scaled attacks, and other actions that could undermine the user experience or harm our operational stability. About the Role As a Machine Learning Engineer in OpenAI's Integrity team, you will have the opportunity to work with some of the brightest minds in AI. You’ll work on state-of-the-art models and classifiers, experiment with new architecture and approaches, and push forward our abilities in content and user understanding. You’ll help turn research breakthroughs into tangible solutions that improve the trust and safety of our platform. If you're excited about training LLMs and building ML models, this role is your chance to make a significant mark. In this role, you will: Innovate and Deploy: Design and deploy advanced machine learning models that solve real-world problems. Bring OpenAI's research from concept to implementation, creating AI-driven applications with a direct impact. Collaborate with the Best: Work closely with researchers, software engineers, and product managers to understand complex business challenges and deliver AI-powered solutions. Be part of a dynamic team where ideas flow freely and creativity thrives. Optimize and Scale: Implement scalable data pipelines, optimize models for performance and accuracy, and ensure they are production-ready. Contribute to projects that require cutting-edge technology and innovative approaches. Learn and Lead: Stay ahead of the curve by engaging with the latest developments in machine learning and AI. Take part in code reviews, share knowledge, and lead by example to maintain high-quality engineering practices. Make a Difference: Monitor and maintain deployed m

Figma is growing our team of passionate creatives and builders on a mission to make design accessible to all. Figma’s platform helps teams bring ideas to life—whether you're brainstorming, creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline workflows, move faster, and work together in real time from anywhere in the world. If you're excited to shape the future of design and collaboration, join us! As a Security Engineer you will identify and drive impactful projects to improve the security of Figma’s product, platform, and IT systems. We are hiring for multiple teams within Security Engineering: AI Security, Platform Security, Product Security, and Anti-Abuse. This is a remote first role. You will partner closely with teams across the company and focus on systemic security improvements and risk reduction. You will also participate in operational security responsibilities like security reviews, consulting, vulnerability triage, and security incident response. Examples of what you may work on across teams: AI Security Perform technical security assessments, code audits, and design reviews for new AI infrastructure, platforms, and products. Design and develop technical solutions to secure AI models, tooling, debugging workflows, and data pipelines. Advocate for secure practices across Figma’s AI infrastructure, platforms, and data systems. Build the next generation of internal AI-powered access insights and security tooling. Help run penetration testing and offensive security exercises against Figma’s AI infrastructure, platforms, and products. Platform Security Perform technical security assessments, code audits, and design reviews for changes to Figma’s cloud and corporate infrastructure. Design and develop solutions to prevent or mitigate cloud and corporate security risks. Advocate for secure practices within Figma’s cloud and corporate infrastructure. Build platforms and tooling t

About the Team The Safety Systems team is dedicated to ensuring the safety, robustness, and reliability of AI models and their deployment in the real world. Learn more about OpenAI’s approach to safety. Building on the many years of our practical alignment work and applied safety efforts, Safety Systems addresses emerging safety issues and develops new fundamental solutions to enable the safe deployment of our most advanced models and future AGI, to make AI that is beneficial and trustworthy. About the Role At OpenAI, we're dedicated to advancing artificial intelligence, and we know that creating a secure and reliable platform is vital to our mission. That's why we're seeking a software engineer to help us build out our trust and safety capabilities. In this role, you'll work with our entire engineering team to design and implement systems that detect and prevent abuse, promote user safety, and reduce risk across our platform. You'll be at the forefront of our efforts to ensure that the immense potential of AI is harnessed in a responsible and sustainable manner. Your Responsibilities: Architect, build, and maintain anti-abuse and content moderation infrastructure designed to protect us and end users from unwanted behavior. Work closely with our other engineers and researchers to utilize both industry standard and novel AI techniques to measure, monitor and improve AI models’ alignment to human values. . Diagnose and remediate active incidents on the platform and build new tooling and infrastructure that address the root causes of system failure. You might thrive in this role if: You have built and run production services in a high growth, rapidly scaling environment. You can debug live issues and restore systems quickly. You have worked on content safety, fraud, or abuse, or are motivated and excited to work on present-day (“now-term”) AI safety. You have experience with Python or with modern languages such as C++, Rust, or Go, and are able to quickly ramp up on Py

About the Team The Applied Foundations team at OpenAI is dedicated to ensuring that our cutting-edge technology is not only revolutionary but also secure from a myriad of adversarial threats. We strive to maintain the integrity of our platforms as they scale. The Applied Foundations team is at the front lines of defending against financial abuse, scaled attacks, and other forms of misuse that could undermine the user experience or harm our operational stability. Integrity Foundations provides the core building blocks and infrastructure for this work. About the Role At OpenAI, our mission is to advance AI in a way that is safe, reliable, and aligned with broad societal values. The applied foundations role is crucial for maintaining the trustworthiness of our platforms. You will be pivotal in developing robust defenses against a spectrum of adversarial behaviors that threaten our ecosystem. In this role, you'll work with our entire engineering team to design and implement systems that detect and prevent abuse, promote user safety, and reduce risk across our platform. You'll be at the forefront of our efforts to ensure that the immense potential of AI is harnessed in a responsible and sustainable manner. In this role, you will: Develop and enhance systems to detect and prevent various forms of abuse including financial fraud, botting, and scripting. Collaborate with cross-functional teams to design solutions that protect against and mitigate adversarial attacks without compromising user experience. Assist with response to active incidents on the platform and build new tooling and infrastructure that address the fundamental problems. You might thrive in this role if you: Have at least 3 years of professional software engineering experience. Have experience setting up and maintaining production backend services and data pipelines. Have a humble attitude, an eagerness to help your colleagues, and a desire to do whatever it takes to make the team succeed. Are self-directed

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible. At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI. Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here . We’re looking for an enthusiastic and thoughtful team player to join our Policy team as a Product Policy Lead for spam. The spam world is full of dynamic adversaries who change tactics regularly to avoid detection and we need to stay a step ahead of bad actors to keep Pinterest the inspiring place our users love. You will draft policies that define spam on Pinterest, create detailed policy enforcement guidance to help our Operations teams fight spam, and collaborate closely with many cross-functional partners across the company, including Product and Engineering teams, to tackle spam and abuse at scale. This role will sometimes involve reviewing graphic and disturbing content, discussing difficult subjects, and responding to escalations. What you’ll do Lead spam policy development for Pinterest. Partner with our Operations, Product and Eng

About Backblaze Backblaze is the object storage leader in the open cloud movement, fueling customer success with cloud storage built purposefully to unlock budgets, unburden administrators, and unleash innovators. Together with our partners, we’re helping customers break free from the restrictive, overpriced legacy solutions that hold them back, and blaze forward with the full power of the open cloud in their hands. Founded in 2007, we scaled the business with less than $3 million in outside funding until 2021, when we did a traditional IPO on the Nasdaq stock exchange. Today, Backblaze generates over $136M ARR and is the leading specialized storage cloud, managing over three billion gigabytes of data storage for 500K+ customers in 175+ countries, including businesses, developers, IT professionals, and individuals. But while there is a lot to celebrate in our past, there is almost as much opportunity ahead of us. We’re seeking a Red Team Security Engineer to join our team! About the Role The Red Team Security Engineer continuously validates whether vulnerabilities, configurations, identities, applications, infrastructure, and AI-enabled systems can be exploited by realistic adversaries. The role combines traditional offensive security with AI-assisted and agentic adversary emulation to validate exposure and continuously improve defensive controls. Key Responsibilities Emulate external attackers, malicious insiders, compromised identities, and autonomous adversarial agents. Validate whether vulnerabilities and configuration weaknesses identified are reachable and practically exploitable. Develop and execute realistic attack paths across web applications, APIs, cloud infrastructure, identity systems, endpoints, and other enterprise services. Use AI-assisted and agentic techniques for reconnaissance, vulnerability analysis, attack-path discovery, and controlled offensive testing. Test AI applications and agents for prompt injection, tool abuse, excessive privilege, ide

Who we are: Sardine is the leading agentic risk platform for fighting financial crime. Our integrated solution unifies data across risk teams to help organizations stop fraud in real time, prevent AI-driven attacks, and automate fraud and AML operations. Sardine’s platform is strengthened by one of the fastest-growing fraud consortiums in the market, spanning more than 6 billion profiled devices, 800 million consumers, and 3 million businesses worldwide. Leading companies including FIS, GoDaddy, Intuit, Edward Jones, ZoomInfo, and Checkout.com rely on Sardine to secure and grow trust in their products. Our culture: We hire talented, self-motivated individuals with extreme ownership and high growth orientation. We value performance and not hours worked. We believe you shouldn't have to miss your family dinner, your kid's school play, friends get-together, or doctor's appointments for the sake of adhering to an arbitrary work schedule. We're a remote-first team spread across time zones, so no office to report to - work from wherever helps you do your best work. Just a couple of things to keep in mind: pay is based on where you're located, and you'll need to keep a home base in the country you're hired in. So while we love the "coffee shop today, mountains tomorrow" life, this isn't a passport-optional, work-from-anywhere-on-Earth kind of remote - think flexible within your country, not borderless. Location: Remote - United States The role Sardine makes risk and payment decisions for banks and fintechs. Our customers audit us closely, and application security is a large part of what they examine. Money moves through this platform, so real adversaries study it. Your job is to find what they would find, especially authorization flaws and business logic abuse, and then make the whole class of bug go away. The application security team is small. The estate is large: Go, Node.js, Python, Ruby, and Java services running on multi-cloud and Kubernetes. That ratio shapes the wo

We believe that the way people interact with their finances will drastically improve in the next few years. We’re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with thousands of companies like Venmo, SoFi, several of the Fortune 500, and many of the largest banks to make it easy for people to connect their financial accounts to the apps and services they want to use. Plaid’s network covers 12,000 financial institutions across the US, Canada, UK and Europe. Founded in 2013, the company is headquartered in San Francisco with offices in New York, Seattle, Washington D.C., Raleigh, London, and Amsterdam. Plaid’s Network Health team protects Plaid and our network from fraud and abuse. We build robust, intelligent yet flexible risk platforms and services to empower risk detection, mitigation, and resolution across all Plaid products and applications. As Engineering Manager for Network Health, you will lead a growing, deeply technical team responsible for risk engineering at Plaid. You will set the long-term strategy and roadmap, translate evolving fraud scenarios and business requirements into technical priorities, and drive execution with a high technical bar. You will manage and grow software engineers, partner closely with embedded data scientists and machine learning engineers, and work hands-on with the data to identify trends and opportunities. This role is well suited to a high-agency leader who thrives in ambiguity and wants to remain close to the work while shaping a critical new team. Responsibilities: You’ll lead a team of 5 engineers and 2 embedded data scientists, developing them through clear goal setting, coaching, and feedback. You’ll drive the long-term Network Health strategy and roadmap, in close partnership with technical and product leaders across Plaid You’ll u

At Asana, security is foundational to our mission of helping humanity thrive by enabling the world's teams to work together effortlessly. Our security team protects Asana's employees, users, and customers by proactively addressing threats and fostering a culture of security throughout our product and operations. We're looking for a Product Security Engineer to join our Product Security team in Warsaw. You'll be a foundational member of the security presence in a key engineering hub, partnering directly with product and infrastructure teams to ensure we design and ship secure software. You will be instrumental in scaling our security practices by building secure-by-default frameworks, eliminating entire classes of vulnerabilities, and championing a security-first mindset across our web, mobile, and AI-powered product surfaces. This role is based in our Warsaw office with an office-centric hybrid schedule. The standard in-office days are Monday, Tuesday, and Thursday. Most Asanas have the option to work from home on Wednesdays. Working from home on Fridays depends on the type of work you do, and your recruiter can share more about the in-office requirements. We offer a Contract of Employment (UoP) for our employees in Poland. What you'll achieve Partner with product and engineering teams across the full software development lifecycle to ensure security is designed and built into Asana's products and platform. Conduct security architecture reviews, threat modeling, and code reviews for new features and services. Develop, implement, and maintain secure-by-default frameworks and libraries that empower engineering teams to build secure systems easily. Build and maintain automated security tooling (static and dynamic analysis rules, custom SAST/DAST checks, and automated red-teaming) to scale security coverage without scaling headcount. Identify and address AI-specific security risks such as prompt injection, insecure tool permissions, and abuse-resistant design in Asana's

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role As a Product Manager in the Internal Products and Technologies organization, you'll partner with Engineering, Design, Growth, Trust & Safety, Support, and Finance to build the billing experiences every Claude customer uses, from the first purchase to the monthly invoice: We own how customers buy and manage Claude: choosing and changing plans, viewing invoices, tracking usage and spend, and setting spend controls. Your work reaches everyone who pays for Claude: individuals upgrading a plan, teams adding seats, developers buying credits, and enterprise admins managing budgets across thousands of users. You'll define how Claude should explain a charge, change a plan, or set a spend limit for a customer. You'll also define how admins set spend controls for the agents their teams run. You'll own billing experiences that convert well, resist abuse, and let customers resolve billing questions on their own. Responsibilities Deeply understand customers across segments (consumers, developers, teams, and enterprise admins) and where billing friction costs us conversion, trust, or support volume. Partner with Growth on purchase, upgrade, and plan-change flows, balancing conversion against clarity and long-term customer trust. Partner with Trust & Safety to stop abuse of Claude plans and credits without adding friction for legitimate customers. Design agentic billing experiences: Claude answering billing questions, resolving common issues, and taking billing actions, with a confirmation step wherever a mistake would cost the customer money. Partner with Engineering and Design so every Claude product gives customers the same

Specialist Solutions Architect, Radar (Fraud) Who We Are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world's largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone's reach while doing the most important work of your career. About The Team Specialist Solutions Architects (SSA) are domain experts aligned to specific Stripe solutions and customer buying centers. We have in-depth knowledge of specific solution offerings and a deep understanding of customer challenges. We align with specialist product sellers on deals, advise the broader pre-sales team on complex opportunities, support pipeline development and revenue attainment, serve as an advisor on go-to-market sales plays, and provide critical insights to our product and engineering teams. Stripe Radar is Stripe's fully integrated fraud and risk management platform. The Radar team's mission is to evolve from a best-in-class payment fraud product into a unified risk intelligence platform that protects businesses from all forms of financial loss—from sophisticated payment fraud and account takeovers to first-party misuse and policy abuse. With Radar, businesses can confidently navigate the evolving fraud landscape, accept more good revenue, and focus on growth. What You'll Do You will collaborate closely with sales and pre-sales teams to drive pipeline and revenue targets, while also educating the product and engineering teams on market trends and strongly influencing the product roadmap. You will develop deep relationships with senior customer business leaders and grow Stripe's solution offerings with new and existing customers. As a subject matter expert, you will scale the broade

P-1489 About Databricks At Databricks, we are passionate about enabling data teams to solve the world's toughest problems, from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers, and customer obsessed, we leap at every opportunity to solve technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started. About the Role As a Staff Technical Program Manager (TPM) for Trust & Safety Engineering, you will drive technical execution across infrastructure initiatives that protect platform integrity, user identity, and data privacy at scale. You will work directly with Security Engineering, Identity Infrastructure, Machine Learning, and Core Platform teams to design, build, and deploy systems for authentication, access control, and anomaly detection. Working embedded within engineering groups, you will translate identity protocols, privacy-by-design principles, and threat mitigation models into clear technical specifications, system dependencies, and actionable execution roadmaps. This role is focused on technical execution, resolving complex engineering dependencies, and delivering scalable systems that guarantee identity integrity and prevent platform abuse. Key Responsibilities Define, articulate, and own the security program strategy and roadmap, ensuring alignment with Databricks’ business and product goals. Drive initiatives across Identity Infrastructure, Data Governance, Platform Security, Machine Learning, and Trust Engineering. Oversee execution of complex security engineering multi-half initiatives (AuthN/AuthZ/Secret/PKI/Cryptography,etc), demonstrating ownership from strategy through outcomes. Leverage

P-1489 About Databricks At Databricks, we are passionate about enabling data teams to solve the world's toughest problems; from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers and customer obsessed, we leap at every opportunity to solve technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started. About the Role As a Staff Technical Program Manager (TPM) for Trust & Safety Engineering, you will drive technical execution across infrastructure initiatives that protect platform integrity, user identity, and data privacy at scale. You will work directly with Security Engineering, Identity Infrastructure, Machine Learning, and Core Platform teams to design, build, and deploy systems for authentication, access control, and anomaly detection. Working embedded within engineering groups, you will translate identity protocols, privacy-by-design principles, and threat mitigation models into clear technical specifications, system dependencies, and actionable execution roadmaps. This role is focused on technical execution, resolving complex engineering dependencies, and delivering scalable systems that guarantee identity integrity and prevent platform abuse. Key Responsibilities Define, articulate, and own the security program strategy and roadmap, ensuring alignment with Databricks’ business and product goals. Drive initiatives across Identity Infrastructure, Data Governance, Platform Security, Machine Learning, and Trust Engineering. Oversee execution of complex security engineering multi-half initiatives (AuthN/AuthZ/Secret/PKI/Cryptography,etc), demonstrating ownership from strategy through outcomes. Leve

firsthand supports individuals living with SMI (serious mental illness). Our holistic approach includes a team of peer recovery specialists, benefits specialists and clinicians. Our teams focus on meeting each individual where they are and walking with them side by side as a trusted guide and partner on their journey to better health. firsthand's team members use their lived experience to build trust with these individuals and support them in reconnecting to the healthcare they need, while minimizing inappropriate healthcare utilization. Together with our health plan partners, we are changing the way our society supports those most impacted by SMI. We are cultivating a team of deeply passionate problem-solvers to tackle significant and complex healthcare challenges with us. This is more than a job—it's a calling. Every day, you will engage in work that resonates with purpose, gain wisdom from motivated colleagues, and thrive in an environment that celebrates continuous learning, creativity, and fun. The Compliance Manager runs the day-to-day compliance program for a multi-state, peer-workforce organization serving individuals. The organization employs and is led by people with lived experience, delivers peer support and certain clinical services across several states, and is subject to federal health care fraud and abuse law, state-level requirements (including Medicaid requirements), and the compliance program expectations set out in the OIG’s General Compliance Program Guidance. This is a hands-on execution role. Program direction, oversight, and board reporting are provided by the Compliance Officer; legal support is supplied by the General Counsel; employment administration sits with the organization. The Compliance Manager owns the operating work of the program - monitoring and auditing on a defined schedule, keeping policies current across all regulatory environments, ensuring training and screenings are accomplished on time, investi