Trust And Safety Specialist Jobs

About the Team The Integrity team builds the systems OpenAI uses to understand, prevent, and respond to misuse across our products. We partner with Product, Policy, Safety Systems, User Operations, Security, Legal, Privacy, OpenAI for Government, and research teams to turn policy and threat models into product controls, review workflows, measurement systems, and enforcement paths. About the Role We are hiring a Product Manager to own Integrity's product strategy for sensitive deployments: contexts where model capability, customer or deployment setting, privacy constraints, and misuse potential make the operating bar unusually high. This includes government and other high stakes deployments, regulated or high-trust enterprise contexts, zero data retention and privacy-constrained environments, and agentic workflows where harm can unfold across many steps rather than a single prompt. The Integrity PM will focus on high-consequence use cases relevant to government deployments and broader deployment-readiness questions for high-risk domains (e.g., healthcare), while building reusable Integrity capabilities for agentic detection and enforcements in these environments. This position is based in San Francisco, CA, with relocation assistance available. In this role, you will: Own the roadmap for sensitive deployment Integrity controls and readiness criteria. Define how we measure residual risk, decision quality, review quality, and mitigation effectiveness. Build agentic investigation and context-assembly workflows for complex, multi-step misuse patterns. Partner with Policy, Legal, Privacy, Safety Systems, User Ops, Government, and product teams to build shared capabilities. Create launch and deployment playbooks for sensitive customer, capability, and product contexts. You might thrive in this role if you: Have shipped complex product systems in AI, integrity, trust and safety, security, privacy, risk, government, regulated enterprise, or AI safety. Can turn ambiguous poli

About the Team The Integrity team builds the systems OpenAI uses to understand, prevent, and respond to misuse across our products. We partner with Product, Policy, Safety Systems, User Operations, Security, Legal, Privacy, OpenAI for Government, and research teams to turn policy and threat models into product controls, review workflows, measurement systems, and enforcement paths. About the Role We are hiring a Product Manager to own Integrity's product strategy for sensitive deployments: contexts where model capability, customer or deployment setting, privacy constraints, and misuse potential make the operating bar unusually high. This includes government and other high stakes deployments, regulated or high-trust enterprise contexts, zero data retention and privacy-constrained environments, and agentic workflows where harm can unfold across many steps rather than a single prompt. The Sensitive Deployments PM will focus on high-consequence use cases relevant to government deployments and broader deployment-readiness questions for high-risk domains (e.g., healthcare), while building reusable Integrity capabilities for agentic detection and enforcements in these environments. This position is based in San Francisco, CA, with relocation assistance available. In this role, you will: Own the roadmap for sensitive deployment Integrity controls and readiness criteria. Define how we measure residual risk, decision quality, review quality, and mitigation effectiveness. Build agentic investigation and context-assembly workflows for complex, multi-step misuse patterns. Partner with Policy, Legal, Privacy, Safety Systems, User Ops, Government, and product teams to build shared capabilities. Create launch and deployment playbooks for sensitive customer, capability, and product contexts. You might thrive in this role if you: Have shipped complex product systems in AI, integrity, trust and safety, security, privacy, risk, government, regulated enterprise, or AI safety. Can turn am

About the Role We are hiring a Business Control Manager to join Chime's Compliance Business Control Management team. You will own the control strategy, business relationships, and results for the Membership, App and AI Experience, and Trust and Safety portfolios. Working with the Enterprise BCM Lead and business partners, you will translate new initiatives, existing business activities, regulatory requirements, incidents, and other changes into clear control outcomes and practical plans. This is an individual contributor role for someone who can move comfortably between strategy and delivery. You will assess current control coverage, lead material control decisions and implementation work within your portfolios, and ensure controls are validated, documented, and maintained. Business and control owners remain responsible for implementing and operating their controls; you will provide the structure, challenge, and partnership needed to produce durable results. You will also contribute across the Enterprise BCM team by supporting Enterprise work when priorities and capacity require it, and by helping identify shared exposure themes and common control approaches across portfolios. In This Role You Can Expect To Own the control strategy and coverage view for assigned portfolios, using business activities, regulatory requirements, existing controls, gaps, and dependencies to set priorities. Evaluate new initiatives and the existing environment through reviews of process or product changes, incidents, complaints, findings, and current control practices. Determine whether controls should be reused, enhanced, created, consolidated, or retired. Lead control design and implementation with business and control owners, establishing clear objectives, scope, ownership, evidence, exception handling, delivery plans, and closure criteria while keeping control ownership and operation with the business. Assess control readiness, coordinate owner attestations, and determine whether cont

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role As a Product Manager focused on Enterprise Privacy, you'll collaborate with Privacy Engineering, Infrastructure, Trust and Safety, Legal, Security, GTM, enterprise and platform product teams, and our cloud partners to evolve and extend the controls that enterprises, regulated industries, and governments require in order to bring their most sensitive work to Claude. You will synthesize complex and fast-changing business needs and partner closely with the teams that retain, protect, and govern customer data across Anthropic's first-party platform and Claude on AWS, GCP, and Azure. Together, you will ensure that privacy guarantees are enforced by our systems and are verifiable by our customers. This is a high-visibility role with substantial scope. Anthropic offers layered controls over how customer data is retained and accessed, and you will build the product surface that lets customers understand, govern, and verify these controls. This includes retention and access controls, access logs and compliance reporting, customer-managed keys and custody, data residency, and self-serve user interfaces. Your stewardship of these privacy capabilities earns the customer trust that is essential to Anthropic's mission. Key responsibilities Deeply understand external customers with strict data handling requirements, from a bank's CISO to a healthcare system's compliance team to a government contractor's auditor, and the internal Trust and Safety, Legal, and GTM stakeholders whose needs pull in different directions. Partner with Privacy Engineering to ship controls that unblock regulated customers, balance impact against engineering co

About the Team The Private Computing team works across product, engineering, security, and safety to build advanced privacy products and infrastructure at OpenAI. Our mission is to provide world-class security features to users so their private data remains private, even from OpenAI. We use technologies like confidential computing, trusted execution environments, and end-to-end encryption to ship product features across ChatGPT, the API, and our future consumer devices. About the Role We’re looking for software engineers to design, build, and scale novel privacy features and infrastructure across ChatGPT, API, and future consumer devices. In this role, you will: Ship fast while balancing difficult trade-offs in complex domains Build core abstractions for trusted execution environments and end-to-end-encryption Build product features for private inference and storage across ChatGPT, API, and future consumer devices Update build systems to increase trust and verifiability Integrate with safety and integrity infrastructure Operate systems at scale with high reliability, including an on-call rotation Collaborate with a diverse set of cross-functional teams across product, engineering, security, safety, policy, and legal You might thrive in this role if you: Care deeply about user privacy and security Have 5+ years of experience in professional software engineering Have experience building and scaling confidential computing or encryption technologies in production environments Have experience with Kubernetes and cloud orchestration systems Take pride in building and operating scalable, reliable, secure systems Can collaborate well and drive alignment in the face of difficult trade-offs Are comfortable with ambiguity and rapid change Workplace & Location This role is based in San Francisco, CA. We follow a hybrid model with 4 days a week in the office and offer relocation assistance to new employees. About OpenAI OpenAI is an AI research and deployment company dedicat

About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career. About the team Did you know that only around 4% of the world’s GDP comes from internet commerce? At Stripe, we believe that this represents a future with almost limitless potential for innovation, creativity and global prosperity. While the promise of a global online economy is palpable, it doesn’t come without significant risk. Each day, bad actors disrupt the trust and safety of the internet and increase the barrier of entry for online businesses. The Financial Crimes team ensures that our platform remains safe, and that prohibited parties are not allowed to utilize our services. What you’ll do We are looking for someone who is passionate about fighting financial crimes and solving the puzzle of investigations, is naturally curious, and is comfortable operating in ambiguity and finding creative solutions. You will be responsible for conducting investigations and making account-level judgments and recommendations for regulatory reporting. You will be confident in looking through data, assessing various indicators, and making judgements on your findings. The right candidate for this role will have experience in financial crimes compliance, preferably within the fintech or e-commerce space Responsibilities Conduct a wide variety of analyses, including: Conducting screening (“watchlist” and “keyword”) reviews on merchants as part of Stripe’s sanctions program Analysing and investigating accounts for exposure to both listed persons and high-risk/prohibited jurisdictions

GitLab is the intelligent orchestration platform for DevSecOps. GitLab enables organizations to increase developer productivity, improve operational efficiency, reduce security and compliance risk, and accelerate digital transformation. More than 50 million registered users and more than 50% of the Fortune 100* trust GitLab to ship better, more secure software faster. The same principles built into our products are reflected in how our team works: we embrace AI as a core productivity multiplier, with all team members expected to incorporate AI into their daily workflows to drive efficiency, innovation, and impact. GitLab is where careers accelerate, innovation flourishes, and every voice is valued. Our high-performance culture is driven by our values and continuous knowledge exchange, enabling our team members to reach their full potential while collaborating with industry leaders to solve complex problems. Co-create the future with us as we build technology that transforms how the world develops software. * Fortune 500® is a registered trademark of Fortune Media IP Limited, used under license. Claim based on GitLab data. Fortune 100 refers to the top 20% ranked companies in the 2025 Fortune 500 list, published in June 2025. Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of GitLab. An overview of this role You will engineer security improvements to the GitLab product as well as building and maintaining the tools we use to detect and prevent abuse on our SaaS platforms. A strong software engineering background with experience in large Ruby/Rails codebases is required. As a senior engineer on the Trust and Safety team, you will predictively identify abuse patterns and trends and build anomaly detection and prevention systems to mitigate abusive users and their activities. This role is an ideal fit for candidates with software engineering backgrounds interested in moving into security engineering. Formal

About the Team The Integrity team at OpenAI is dedicated to ensuring that our cutting-edge technology is not only revolutionary, but also secure from a myriad of adversarial threats. We strive to maintain the integrity of our platforms as they scale. The Integrity team is at the front lines of defending against misuse in all its forms: content abuse, scaled attacks, and other actions that could undermine the user experience or harm our operational stability. About the Role As a Machine Learning Engineer in OpenAI's Integrity team, you will have the opportunity to work with some of the brightest minds in AI. You’ll work on state-of-the-art models and classifiers, experiment with new architecture and approaches, and push forward our abilities in content and user understanding. You’ll help turn research breakthroughs into tangible solutions that improve the trust and safety of our platform. If you're excited about training LLMs and building ML models, this role is your chance to make a significant mark. In this role, you will: Innovate and Deploy: Design and deploy advanced machine learning models that solve real-world problems. Bring OpenAI's research from concept to implementation, creating AI-driven applications with a direct impact. Collaborate with the Best: Work closely with researchers, software engineers, and product managers to understand complex business challenges and deliver AI-powered solutions. Be part of a dynamic team where ideas flow freely and creativity thrives. Optimize and Scale: Implement scalable data pipelines, optimize models for performance and accuracy, and ensure they are production-ready. Contribute to projects that require cutting-edge technology and innovative approaches. Learn and Lead: Stay ahead of the curve by engaging with the latest developments in machine learning and AI. Take part in code reviews, share knowledge, and lead by example to maintain high-quality engineering practices. Make a Difference: Monitor and maintain deployed m

About the Team The Integrity team at OpenAI is dedicated to ensuring that our cutting-edge technology is not only revolutionary, but also secure from a myriad of adversarial threats. We strive to maintain the integrity of our platforms as they scale. The Integrity team is at the front lines of defending against misuse in all its forms: content abuse, scaled attacks, and other actions that could undermine the user experience or harm our operational stability. About the Role As a Machine Learning Engineer in OpenAI's Integrity team, you will have the opportunity to work with some of the brightest minds in AI. You’ll work on state-of-the-art models and classifiers, experiment with new architecture and approaches, and push forward our abilities in content and user understanding. You’ll help turn research breakthroughs into tangible solutions that improve the trust and safety of our platform. If you're excited about training LLMs and building ML models, this role is your chance to make a significant mark. In this role, you will: Innovate and Deploy: Design and deploy advanced machine learning models that solve real-world problems. Bring OpenAI's research from concept to implementation, creating AI-driven applications with a direct impact. Collaborate with the Best: Work closely with researchers, software engineers, and product managers to understand complex business challenges and deliver AI-powered solutions. Be part of a dynamic team where ideas flow freely and creativity thrives. Optimize and Scale: Implement scalable data pipelines, optimize models for performance and accuracy, and ensure they are production-ready. Contribute to projects that require cutting-edge technology and innovative approaches. Learn and Lead: Stay ahead of the curve by engaging with the latest developments in machine learning and AI. Take part in code reviews, share knowledge, and lead by example to maintain high-quality engineering practices. Make a Difference: Monitor and maintain deployed m

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. As a Senior Content Designer , you’ll be a key member of the Accounts design team, playing a critical role in building the systems that keep Roblox safe, civil, and inclusive for a global community. You’ll focus on creating platform-level designs that make all accounts on Roblox accessible, authentic, and protected. Roblox’s mission is to connect a billion people with optimism and civility. The Safety organization is at the heart of that mission, working to ensure everyone has seamless and secure access to accounts tied to their identity. We also work on building a world-class account access and management system, ensuring safe and fun family experiences, supporting compliance with global regulations, and providing a healthy, inclusive environment for users of all ages. You’ll collaborate closely with cross-functional teams across product, design, engineering, and research, shaping the platform's approach to trust and safety through thoughtful design. This is an opportunity to work at the systems level—defining how safety and account are embedded across Roblox and designing reusable frameworks that power our vision of civil immersive online communities. You will: Own and deliver UX content

We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.) Our Mission: To actively connect people to their next great opportunity. Who We Are: ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android. Summary: Every application on ZipRecruiter comes out of two things: what we know about a job seeker, and the flow they go through to apply. The profile holds that knowledge: resume, work history, skills, preferences, and the trade-offs that matter in their job search. The apply flow turns interest in a job into an application an employer can act on. Together they decide how many job seekers who find a job they like go on to apply, and how well each application represents the person behind it. You will own Product for both. That means deciding what we ask job seekers and when, how we build and keep an accurate picture of each person, and how we get from a job click to a completed, high-quality application with as little effort from the user as possible. The goal is simple to state and hard to deliver: a job seeker should never have to tell us something twice, and every application should show an employer the right reasons to respond. Few Product roles at ZipRecruiter have more stakeholders. The apply flow is where employer requirements meet the job seeker experience. Employers ask screening questions and rely on applications arriving in their own systems. Trust and safety teams protect the marketplace from fraudulent and low-quality applications. Profile data feeds matching, messaging, and the resume database tools employers use. This is a high-stakes

We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.) Our Mission: To actively connect people to their next great opportunity. Who We Are: ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android. Summary: Every application on ZipRecruiter comes out of two things: what we know about a job seeker, and the flow they go through to apply. The profile holds that knowledge: resume, work history, skills, preferences, and the trade-offs that matter in their job search. The apply flow turns interest in a job into an application an employer can act on. Together they decide how many job seekers who find a job they like go on to apply, and how well each application represents the person behind it. You will own Product for both. That means deciding what we ask job seekers and when, how we build and keep an accurate picture of each person, and how we get from a job click to a completed, high-quality application with as little effort from the user as possible. The goal is simple to state and hard to deliver: a job seeker should never have to tell us something twice, and every application should show an employer the right reasons to respond. Few Product roles at ZipRecruiter have more stakeholders. The apply flow is where employer requirements meet the job seeker experience. Employers ask screening questions and rely on applications arriving in their own systems. Trust and safety teams protect the marketplace from fraudulent and low-quality applications. Profile data feeds matching, messaging, and the resume database tools employers use. This is a high-stakes

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible. At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI. Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here . The AI Platform team delivers essential tools and infrastructure utilized by hundreds of AI and ML engineers across Pinterest, powering crucial functions such as recommendations, ads, visual search, growth/notifications, and trust and safety. Our primary objectives are to ensure AI and ML systems maintain production-grade quality and enable rapid iteration for our customers. As a Senior Staff Software Engineer on the AI Platform team, you will shape and scale Pinterest’s AI/ML evaluation platform into a unified, reliable system adopted company-wide. You will identify modernization opportunities, elevate the roadmap, and execute technical strategy of a durable evaluation system for GenAI and ML workloads at Pinterest, partnering across engineering, research, product, and safety to improve quality, launch decisions, and trust in AI-powered experie

At Lyft, our mission is to improve people’s lives with the world’s best transportation. To do this, we start with our own community by creating an open, inclusive, and diverse organization. Lyft connects people to transportation to change the way we live and get around our communities. We are looking for product leaders who bring exceptional creative and analytical skills to drive forward a best in class product. Product management at Lyft leads the integration of engineering, data science, and design to achieve the company’s vision for reinventing transportation. We are looking for entrepreneurial and passionate product leaders to innovate and execute across a rapidly growing, fast paced company and industry from our San Francisco and New York offices. The Safety & Customer Care (SCC) Product team builds the platforms, products, and experiences that support riders and drivers when they need help most — and help keep them safe every time they ride. As the Director of Product, Customer Care, you’ll lead a team of product managers driving Lyft’s customer care strategy end to end: AI-powered support across chat and voice, the contact center platforms our support teams run on, and the underlying data layer which is critical to understand where our products can be improved. It’s a rare chance to shape how a category-defining company delivers support at scale — across emerging AI capabilities, global expansion, autonomous vehicle partnerships, and new lines of business. Responsibilities: Own the vision, strategy, and multi-year roadmap for Lyft’s Customer Care product portfolio — spanning AI-driven support automation, contact center platforms, self-service and issue resolution, and the trust and safety products underpinning every interaction Lead, coach, and grow a team of product managers, setting a high bar for product craft, execution, and career development Partner with senior leaders across engineering, data science, design, operations, and finance to set priorit

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies - from the world's largest enterprises to the most ambitious startups - use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone's reach while doing the most important work of your career. About the team The Risk Operations team is looking for an experienced fraud analyst to join an industry-leading global fraud operations team. This position is responsible for writing and maintaining fraud rulesets to prevent transaction fraud, conducting data analysis to identify and mitigate fraud attacks, while minimizing impact to users, and working collaboratively with fraud, operations, and product stakeholders to proactively implement fraud strategies and controls. They should have a deep understanding of fraud patterns and typologies, advanced SQL proficiency, strong analytical abilities, and experience writing and managing fraud rulesets. What you'll do Did you know that only around 4% of the world's GDP comes from internet commerce? At Stripe, we believe that this represents a future with almost limitless potential for innovation, creativity, and global prosperity. While the promise of a global online economy is palpable, it doesn't come without significant risk. Each day, bad actors disrupt the trust and safety of the internet and increase the barrier of entry for online businesses. Before we can fully realize the potential of a global internet economy, we must first address the burgeoning problem of fraud. We are looking for someone passionate about fighting fraud, identifying new trends and typologies, conducting complex data analysis, and working collaboratively with peers and partners in the fraud space. This position works closely with c