Trust And Safety Specialist Jobs

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role We are looking for software engineers to help build safety and oversight mechanisms for our AI systems. As a software engineer on the Safeguards team, you will work to monitor models, prevent misuse, and ensure user well-being. This role will focus on building systems to detect unwanted model behaviors and prevent disallowed use of models. You will apply your technical skills to uphold our principles of safety, transparency, and oversight while enforcing our terms of service and acceptable use policies. Responsibilities: Develop monitoring systems to detect unwanted behaviors from our API partners and potentially take automated enforcement actions; surface these in internal dashboards to analysts for manual review Build abuse detection mechanisms and infrastructure Surface abuse patterns to our research teams to harden models at the training stage Build robust and reliable multi-layered defenses for real-time improvement of safety mechanisms that work at scale You may be a good fit if you have: A Bachelor’s degree in Computer Science, Software Engineering or comparable experience Proficiency in Python and Typescript An ability to work across the stack Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders Strong candidates may also: 8+ years of experience in a software engineering position Have experience with integrity, spam, fraud, or abuse detection and mitigation Have experience building trust and safety detection mechanisms and intervention for AI/ML systems Have experience with prompt engineering, jailbreak attacks, and other adversarial inputs Have worked

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role We are looking for software engineers to help build the foundational pieces for safety, oversight and intervention mechanisms of our AI systems. As a software engineer on the Safeguards team, you will work to monitor models, prevent misuse, and ensure user well-being. This role will focus on building systems to detect unwanted model behaviors and prevent disallowed use of models. You will apply your technical skills to uphold our principles of safety, transparency, and oversight. Responsibilities: Develop the foundational systems which power Safeguards, including infrastructure for data storage and management, metric and evaluation systems, and tooling for human and agentic review. Ensure the day-to-day running of Safeguards systems and hold a high operational bar which serves both safety and customers while reducing the amount of human intervention and oversight required. Build robust and reliable multi-layered defenses for real-time improvement of safety mechanisms that work at scale You may be a good fit if you have: Bachelor’s degree in Computer Science, Software Engineering or comparable professional experience Proficiency in Python Ability to work across the stack Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders Strong candidates may also: 7+ years of experience in a software engineering position Have experience building trust and safety, anti-spam, fraud or abuse detection and mitigation mechanisms and interventions for AI/ML systems Have experience building metrics and measurement systems or data and privacy management systems Have worked closely with op

About the Role Chime is looking for a hands-on engineering leader to guide the Human Agent Tooling team within Trust & Safety. As a Tech Lead Manager, you’ll lead a squad of 3–5 engineers, set the hiring bar, coach and develop talent, and own execution and delivery. You’ll also remain deeply involved in the technical work, writing and shipping production code alongside your team. The Human Agent Tooling team builds the software Chime’s support agents use to understand member needs, take the right actions, and resolve issues quickly and safely. This includes the agent workspace, case management tools, real-time member context, and access controls. You’ll help modernize this platform and partner closely with Product, Operations, and support agents to make every human support interaction faster, safer, and more effective. In this role, you can expect to Drive technical design and architectural decisions, while mentoring engineers and fostering cross-functional collaboration Lead and contribute to multiple projects simultaneously, balancing ownership of key initiatives with support across broader team efforts Build and maintain robust, low-latency APIs and backend services that power our Trust and Safety platforms Become the domain expert in our platform architecture, providing technical decisions and solutions to refine our maturing platforms Partner with data engineers, analysts, and product managers to ship impactful features that enhance member protection and experience Improve platform reliability and performance through thoughtful system architecture, observability practices, and automation Evolve our experimentation, policy lifecycle, and ML integration capabilities to support smarter and faster decision-making at scale Engineers are required to participate in on-call rotation. Being on call may include responding to incidents outside of regular working hours when necessary. To thrive in this role, you have 5+ years of experience developing software in a prod

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. As a Quality Analyst, you will support the Quality Manager and the broader team in maintaining quality controls, executing calibration reviews, and ensuring smooth auditing operations with our vendor partners. You will play a crucial role in validating audit accuracy, analysing performance trends, and identifying grading discrepancies, helping to safeguard platform integrity and streamline vendor quality processes. You Will: Assist in executing regular quality compliance reviews and operational audits to ensure vendors adhere to established grading rubrics. Conduct daily audits of vendor customer service and moderation audits to verify accuracy and policy alignment. Gather, format, and maintain quality performance metrics and audit data to highlight recurring errors or vendor grading drift. Support the Lead in coordinating with Moderation, Customer Support, and Global Scaled Operations teams to resolve quality disputes. Participate in calibration sessions to ensure consistent interpretation of trust and safety policies across all vendor sites. Help test and implement new quality automation tools or auditing platforms introduced by the technical and leadership teams. You Have: 3-5 years of e

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. As a Quality Analyst, you will support the Quality Manager and the broader team in maintaining quality controls, executing calibration reviews, and ensuring smooth auditing operations with our vendor partners. You will play a crucial role in validating audit accuracy, analysing performance trends, and identifying grading discrepancies, helping to safeguard platform integrity and streamline vendor quality processes. You Will: Assist in executing regular quality compliance reviews and operational audits to ensure vendors adhere to established grading rubrics. Conduct daily audits of vendor customer service and moderation audits to verify accuracy and policy alignment. Gather, format, and maintain quality performance metrics and audit data to highlight recurring errors or vendor grading drift. Support the Lead in coordinating with Moderation, Customer Support, and Global Scaled Operations teams to resolve quality disputes. Participate in calibration sessions to ensure consistent interpretation of trust and safety policies across all vendor sites. Help test and implement new quality automation tools or auditing platforms introduced by the technical and leadership teams. You Have: 3-5 years of e

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. As a Quality Analyst, you will support the Quality Manager and the broader team in maintaining quality controls, executing calibration reviews, and ensuring smooth auditing operations with our vendor partners. You will play a crucial role in validating audit accuracy, analysing performance trends, and identifying grading discrepancies, helping to safeguard platform integrity and streamline vendor quality processes. You Will: Assist in executing regular quality compliance reviews and operational audits to ensure vendors adhere to established grading rubrics. Conduct daily audits of vendor customer service and moderation audits to verify accuracy and policy alignment. Gather, format, and maintain quality performance metrics and audit data to highlight recurring errors or vendor grading drift. Support the Lead in coordinating with Moderation, Customer Support, and Global Scaled Operations teams to resolve quality disputes. Participate in calibration sessions to ensure consistent interpretation of trust and safety policies across all vendor sites. Help test and implement new quality automation tools or auditing platforms introduced by the technical and leadership teams. You Have: 3-5 years of e

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. The Trust and Safety Operations team is focused (ok, maybe obsessed) on scaling Roblox's Operations organization and transforming our customer experience through our multi-year vision and strategy execution. The team provides support to Roblox's global players, developers, and advertisers. As a Lead, Product Support Ops on our Safety Ops Team, you’ll be mentor and lead the team that is focused on Escalations, Product Reliability, Process Improvement and Design and plays a critical role in managing and resolving escalations and high-impact incidents affecting our Roblox users and platform. Your team will be responsible for identifying trends, enhancing support processes, improving agent efficiency, and reducing operational costs while maintaining high reliability and service quality. You will be reporting to the Trust & Safety India Operations Manager and leading the Support Operations Excellence team, providing coverage across billing, accounts, creator, and adjacent domains. This is a player-coach role, weighted toward leadership. You'll still go deep on the hardest problems and stay close enough to the work to be a genuine execution expert, but your primary leverage is the team, and y

About Us Twitch is the world’s biggest live streaming service, with global communities built around gaming, entertainment, music, sports, cooking, and more. It is where thousands of communities come together for whatever, every day. We’re about community, inside and out. You’ll find coworkers who are eager to team up, collaborate, and smash (or elegantly solve) problems together. We’re on a quest to empower live communities, so if this sounds good to you, see what we’re up to on LinkedIn and X , and discover the projects we’re solving on our Blog . Be sure to explore our Interviewing Guide to learn how to ace our interview process. About the Team Community Trust (CT) exists to foster an environment where streamers and their communities thrive, while proactively reducing harm and ensuring support is accessible when needed. Our organization encompasses safety policy & enforcement, fraud prevention, and customer experience. Within CT, the Business Operations & Integrations team is the operational backbone – encompassing four functions (Business Operations, Financial & Contract Management, Go-to-Market, and Safety by Design) split across two sub-teams: BizOps and Integrations. The Integrations team – which this role sits on – is the connective tissue between Community Trust and the rest of Twitch. We own the CT Readiness Program, ensuring every product, monetization, regulatory, or business development launch is operationally ready before it reaches our community (200+ launches per year). We also co-own Safety By Design, the process by which safety risks are identified and mitigated before products ship. We're building a team that can anticipate what's coming and react to what's arrived – getting CT into planning conversations earlier, simplifying how Twitch launches safely at scale, and building the systems that allow a small team to have outsized impact. About the Role This is a Program Manager II role on the Integration

About Us: Future is building a personalized guidance system for lifelong health. We help people understand what to do next for their body, goals, and stage of life — then support them in turning those decisions into sustained behavior change. By combining AI, human expertise, personal health data, and accountability, Future helps members improve performance today while building the resilience, capacity, and healthspan they need for decades to come. ABOUT THE ROLE: We’re hiring a Staff Product Manager to own the core marketplace experience. We’re rethinking things from the ground up—you won’t be inheriting a roadmap, a backlog, or a set of conventions. You’ll be building the product from the ground up alongside the CPTO. This role requires someone who thinks in systems. A marketplace is not a single product—it’s an ecosystem. You’ll need to hold the consumer experience, the practitioner experience, the matching logic, the trust and safety layer, the business model, and the growth loops in your head simultaneously, and make smart tradeoffs between them every day. You will report directly to the CPTO and work alongside a small, senior engineering team. There are no layers between you and the work, and no layers between you and the decisions that shape the company. WHAT YOU’LL OWN: Product Strategy & Vision Define the product vision and strategy for the marketplace, grounded in deep user understanding, competitive analysis, and a clear-eyed view of the business model. Own the roadmap end-to-end. Decide what to build, what to kill, and what to sequence—with conviction, not consensus. Develop and maintain a strong point of view on where the wellness and longevity market is heading and how our product should evolve to lead, not follow. TRUE 0→1 product thinking: identify the fastest and cheapest ways to validate core assumptions before committing significant engineering investment. Marketplace Systems Thinking Design and optimize both sides of the marketplace: the cons

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Trust and confidence is fundamental to the Lyft marketplace, and the Pay, Integrity & Identity (PII) Analytics team is charged with providing and ensuring that trust and safety to all customers. The PII Analytics team is one of the most critical teams that helps protect Lyft and enables the company to grow in a sustainable way. The team is fast-paced, high-energy, and meticulous in diagnosing emerging fraud patterns and preventing fraud loss before it can happen. We drill holes in all the products we launch and obsess over how to make our business impervious to fraud vectors. The team conducts a rigorous analysis of complex data sets and sets up multiple layers of business rules, models, and other processes to prevent potential fraud. We are a highly cross-functional team and regularly engage in discussion and reviews with stakeholders to prioritize plans for reducing fraud impact and introducing safety features. We’re looking for a rock-star to join a fast-paced environment to contribute to Fraud-related analysis and operations. This individual is responsible for investigating and developing solutions to prevent and mitigate third party fraud. This person will proactively identify fraud patterns and sources to minimize the company’s exposure to financial and reputational risk. The Senior Analyst will take ownership over multiple discrete fraud segments to develop and execute a strategy which addresses fraud in the earliest stages of detection. The Senior Analyst will define fraud prevention measures that are mindful of the impact on good user experience while inhibiting fraud actors’ ability to reach our platform. This person is quantitatively driven, detail-focused, and operations-savvy while ensuring the best possible customer experience. This individual possesses a high level of subject matte

About Us Tamara is a leading fintech platform in Saudi Arabia and the GCC region with a mission to help people own their dreams built on being simple, trusted, and everywhere our customers need us. Today, more than 25 million customers and over 130,000 partner merchants depend on Tamara every day for reliable financial solutions across retail, travel, education, healthcare, and beyond. Tamara is backed by Sanabil Investments, a wholly owned company of the Public Investment Fund (PIF), and SNB Capital, among others. Your role We're seeking a Fraud Investigator for our Trust and Safety team. As a Fraud Investigator, you will be crucial in monitoring and investigating suspicious transactions and activities to help protect our company and our customers from financial losses and reputational damage. Drawing on your proficiency in identifying potentially harmful activities through in-depth investigations and clear reporting, you will be responsible for collaborating with teams, implementing effective anti-fraud solutions, and elevating overall security posture to create unique experiences only Tamara can provide. With a proven track record of analyzing complex data with precision, extracting valuable insights through keen observation, communicating clearly and persuasively, tailoring messages to diverse audiences in English, Arabic, and ultimately revolutionize the way millions of users shop, pay, and bank. You are a driven, determined, curious team player, knowing that collective strength means we all win. With a positive outlook, you are solution-oriented–persevering regardless of circumstances, always finding a way through, no matter the challenges. You will effectively find a way to work with everyone through empathy and respect. You will be driven and comfortable with responding quickly with urgency, with the ability to change course without losing momentum and energy, resulting in great success. Your responsibilities Monitor and analyze transactions and

We are seeking a dedicated and dynamic candidate to join Spotify’s EU Government Affairs team in Brussels as Senior Manager - EU Government Affairs. The Government Affairs team is charged with understanding the global and local policy landscape in relation to Spotify’s business objectives and advocating on the company’s behalf on critical public policy issues. We represent the company before legislators and regulators, interact with civil society and industry, see around corners, and mitigate potential risks. In this role you will be an active member and will provide advice and external advocacy on policy matters that have an impact on Spotify in Europe. You will report to our Senior Director of European Policy and will be based in our Brussels office. What You'll Do Engage regularly with EU policymakers including the Commission, Parliament, Council, and policymakers at national level Work on the priority public policy issues affecting Spotify in the EU - with a focus on platforms and content regulation, consumer rules, as well as trade and tech regulation in general. You will be responsible for managing these files and developing and implementing effective advocacy strategies. Work closely with other groups and departments inside Spotify -- including legal, licensing, communications, social impact, compliance and trust and safety -- to understand the priorities of internal partners, and create approaches to key policy issues that advance the interests of Spotify Develop engagement and partnerships with external organizations such as trade associations and civil society organizations Who You Are 10+ years of experience in EU government affairs, for a governme

About the role Chime’s Cards org is hiring an engineer to help scale and evolve Cards portfolio. In this role, you’ll dive into high-impact projects across our service architecture, collaborating with product, risk, and design partners to deliver resilient, secure systems. While your focus will be backend, we're looking for someone who’s excited to roll up their sleeves and contribute wherever it’s needed most to move the team forward In this role, you can expect to Drive technical design and architectural decisions, while mentoring engineers and fostering cross-functional collaboration Lead and contribute to multiple projects simultaneously, balancing ownership of key initiatives with support across broader team efforts Build and maintain robust, low-latency APIs and backend services that power our Trust and Safety platforms Become the domain expert in our platform architecture, providing technical decisions and solutions to refine our maturing platforms Partner with data engineers, analysts, and product managers to ship impactful features that enhance member protection and experience Improve platform reliability and performance through thoughtful system architecture, observability practices, and automation Evolve our experimentation, policy lifecycle, and ML integration capabilities to support smarter and faster decision-making at scale Engineers are required to participate in on-call rotation. Being on call may include responding to incidents outside of regular working hours when necessary. To thrive in this role, you have 5+ years of experience developing software in a production environment at scale Prior experience serving as a technical lead for a team and on complex projects—driving architectural decisions, coordinating execution, and aligning cross-functional teams Proven experience with Ruby on Rails or comparable frameworks Experience with transactional databases and caching systems Deep understanding of architectural patterns for large-scale web applicat

Join us in developing a remotely piloted reusable spaceplane that combines the demanding performance of a rocket with the reusability of an aircraft. We're looking for an experienced Certification Engineer who enjoys taking ownership of risks and mitigations in the flight operations domain. We need someone who can analyse the safety risks of complex UAS operations, interpret high level safety objectives, and work with engineering and flight operations teams to establish our operations are safe. You will directly contribute to the safety case that demonstrates frequent unmanned, rocket-powered flights to space are safe. If you want a narrow, heavily structured role, this is probably not for you. We are looking for someone practical, organised, and capable of taking ownership in a fast-moving environment. This role works within the Spaceplane Certification Team reporting to the Certification Team Lead. You will not have a team working directly for you but will have a high level of interaction with the Flight Operations and Systems Engineering teams. What You'll Do Manage Certification Projects and Liaison with Civil Aviation Authorities and External Stakeholders • Engage directly with authorities to come to agreement on acceptable risk mitigations. • Where there is disagreement in acceptable approaches to safety, resolve in a manner that builds trust and enables progress. • Work closely with Flight Operations and Systems Engineering teams to provide requirements, safety objectives, set expectations, provide guidance and review their work packages. • Ensure certification deliverables are provided when needed, and work with the authorities to enable review to occur efficiently. Develop Operational Risk Assessment and Safety Case • Systematically identify all risks associated with unmanned aircraft operations using industry practices (JARUS SORA). • Decide the mitigations, standards and p

About the Team OpenAI for Government works with U.S. and allied government institutions to support the responsible adoption of AI across defense, intelligence, federal civilian, state and local, and international public-sector missions. We help public servants use frontier AI in ways that are effective, trusted, and grounded in real-world requirements for safety, reliability, security, compliance, and accountability. Government Trusted Access programs help eligible public-sector organizations and practitioners use advanced capabilities for approved, high-value work in sensitive domains. These programs bring together OpenAI for Government, Product Policy, Legal, Security, International, Research, User Operations, Technical Success, Global Affairs, and domain experts. Each program has distinct eligibility criteria, safeguards, and decision owners; our job is to make the overall government experience coherent and executable. About the Role We are seeking a Program Manager to coordinate OpenAI’s Government Trusted Access portfolio across high-trust domains, such as cyber and bio. You will build and run the operating mechanisms that move government participants from initial interest through review, onboarding, activation, ongoing support, and program improvement. The right person is a highly organized, low-ego operator who can move between strategy and detail. You are comfortable working across technical, policy, legal, safety, security, customer, and operational teams; you build durable systems without adding unnecessary process; and you communicate clearly when facts, ownership, or requirements are still evolving. This role is based in Washington, DC. We use a hybrid work model of three days in the office per week and offer relocation assistance to new employees. In this role, you will: Coordinate government participation across domain-specific Trusted Access programs, including cyber and biology, while helping stand up future programs as the portfolio evolves. Own the