Trust And Safety Ads Operations Analyst in United States

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join: Our hosts are opening their homes or providing experiences to guests from around the world. We’re creating new relationships & placing people in vulnerable situations. Therefore trust is the fundamental currency of Airbnb. We are the Trust & Safety team, composed of engineers, data scientists, designers, product managers, and operations, responsible for earning this trust by building for safety at each moment of the guest and host journey. We build cutting edge machine learning models to detect risk, defenses to deter risky actors, and operations tools that enable investigators worldwide. We define community standards and policies, set high expectations, and keep bad actors out while providing delightful experiences for good users. The Difference You Will Make: As a Product Manager in the Trust & Safety team, you will identify customer pain points, business opportunities, and define/deliver the products that help us create a safe and trusted community around the world. Your work will be pivotal to shaping the future of hospitality and travel. Within the Trust & Safety team, you’ll be focused on Safety: To reduce safety incidents (e.g. interpersonal harm and illegal activities). A Typical Day: Creating vision and strategy for Trust & Safety products and platforms. Leading a cross-functional working group of engineers, data scientists, designers, operations experts, and policy experts to ensure alignment, execution, and launches Maintaining product backlog and the product roadmap. Own prioritization process of product solutions based on business v

Replit is the agentic software creation platform that enables anyone to build applications using natural language. With millions of users worldwide, Replit is democratizing software development by removing traditional barriers to application creation. About the Role We're redefining how software is built and who gets to build it. Our mission is to achieve Autonomy for All: making programming accessible, collaborative, and powered by AI. Realizing that vision requires a platform that legitimate users can trust and adversarial actors cannot exploit. We're hiring a Data Scientist to help build Replit's Trust & Safety and Anti-Abuse program from the ground up. You'll turn noisy behavioral, identity, payment, infrastructure, and content signals into the measurement systems, detections, and decisions that protect Replit's users, platform, and economics. You'll work closely with Engineering, Support, Legal, Security, Infrastructure, Money, and Growth to make abuse economically unviable while keeping friction low for legitimate users. Replit sits at the frontier of AI-native abuse. Our platform is a target for phishing and scam hosting, cryptomining, LLM token farming, card and coupon fraud, referral abuse, and increasingly, abuse driven by AI agents themselves. You'll help define how we identify, measure, and respond to these threats without compromising the experience of good users. Who You Are You're a data scientist who moves fast, goes deep, and thinks adversarially. You can spin up an analysis in hours that would take others days, not by cutting corners, but because you've built the intuition and technical toolkit to get to the right answer quickly. You dig past the top-line abuse rate to understand selection effects, missing labels, policy changes, attacker adaptation, and the false positives hidden inside an aggregate metric. You understand that Trust & Safety data is imperfect and outcomes are high stakes. Ground truth is delayed, biased, and often incomple

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. Roblox is looking for a Finance Business Partner, Trust & Safety to join our Finance team, reporting to the Senior Manager, FP&A. You will be leading finance support to the Trust and Safety team. This cross functional role involves collaboration with Safety, Legal, and Infrastructure teams. You will be supporting a variety of FP&A functions including short-term planning management, business partnering, financial modeling, and finance operations. You will communicate, use analytical skills, and organize with several teams on multiple deliverables. You Will: Support monthly financial cycles, including collaboration with Accounting at month-end and quarter-end, consolidation of budgets and reporting packages Review important financial metrics with senior leadership Provide leadership in identifying ad hoc or opportunistic discussions around our financial trends Leading many cross functional projects with Safety ops team on cost efficiencies and new product introductions by identifying opportunities/gaps, providing insights and solutions. Consistently support various business decisions across the organization by surfacing spending trends, developing ROI analysis for new strategic in

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible. At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI. Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here . As a Staff Product Manager for the GenAI Safety team within Trust & Safety, you'll define and drive the product strategy for ensuring Pinterest's GenAI-powered systems are safe, fair, and trustworthy. You'll be responsible for building proactive safety frameworks that scale with our growing AI capabilities, partnering deeply with engineering, policy, data science, and design to protect our users while enabling Pinterest to innovate responsibly. This is a high-impact role for someone who is passionate about the intersection of AI and user safety, and who thrives in ambiguous, fast-evolving problem spaces. You'll work at the frontier of responsible AI - anticipating novel harms before they emerge, red-teaming new AI features, and translating complex policy goals into measurable product requirements. What you'll do: GenAI Safety Strategy: Own a

About the Team Our Safety Systems team is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency. Within Safety Systems, the Model Policy team works to ensure that increasingly capable models behave safely and reliably in real-world environments. We investigate emerging model failures, define the behavior models should exhibit instead, and develop the data, evaluations, monitoring, and safeguards needed to improve and validate that behavior. Our work connects alignment research with the practical challenges of training and deploying frontier models. About the Role In this role, you will shape how OpenAI understands and addresses real-world risks that emerge from model misalignment as models become more autonomous and operate over longer horizons. You will investigate how misaligned behavior emerges across extended trajectories - including when models persist toward the wrong objective, take unsafe shortcuts, lose track of instructions, exploit weaknesses in their environment, or circumvent constraints - and translate these insights into behavioral policies, evaluations, monitoring, and safeguards. This role is ideal for someone who wants to turn alignment and safety concerns into concrete, empirically grounded improvements to frontier AI systems. Your Responsibilities: Identify vulnerabilities that emerge as models interact with tools, data, and external systems, and translate them into model- and system-level safeguards. Develop threat models and empirical frameworks for understanding harmful outcomes from misaligned behavior. Build frameworks for understanding harmful outcomes arising from model misalignment. Identify the underlying behaviors and system conditions that drive those outcomes. Turn findings into policy frameworks, evaluation criteria, online measurement and safeguards. Develop human data campaigns and gold sets to ground measurement and evaluation of eme

Replit is the agentic software creation platform that enables anyone to build applications using natural language. With millions of users worldwide, Replit is democratizing software development by removing traditional barriers to application creation. Role Summary Replit is the agentic software creation platform that enables anyone to build applications using natural language. With millions of users worldwide, Replit is democratizing software development by removing traditional barriers to application creation. As a Disputes and Chargeback Program Manager at Replit, you’ll be part of our Trust and Safety Operations team, who owns customer-facing workflows that handle sensitive and policy-driven interactions across the Support organization. This includes areas such as privacy requests, DMCA and intellectual property claims, law enforcement requests, and abuse appeals. You'll own Replit's disputes and chargeback function end-to-end: from the individual case in front of you to the policies, playbooks, and automation that let it hold up as we scale to millions of users. This role combines strategic ownership with hands-on execution: you'll determine dispute and chargeback strategy, and build the systems that make those decisions repeatable at scale, working closely with Engineering, Legal and Finance. In this role you will… Own the full dispute lifecycle: investigate incoming chargebacks and disputes, decide whether and how to represent, gather evidence, and respond within network deadlines. Design and maintain the policies, decision trees, and SOPs that govern how disputes and chargebacks are handled. Define the key metrics, health targets, and goals for the disputes program and track performance against them, reporting to leadership. Monitor chargeback rates and dispute trends to identify the underlying drivers of volume, and partner with Engineering and Finance to address root causes. Partner with Engineering and Support Operations to automate manual parts of the wor

About the Team The Safety Systems team is dedicated to ensuring the safety, robustness, and reliability of AI models and their deployment in the real world. Learn more about OpenAI’s approach to safety. Building on the many years of our practical alignment work and applied safety efforts, Safety Systems addresses emerging safety issues and develops new fundamental solutions to enable the safe deployment of our most advanced models and future AGI, to make AI that is beneficial and trustworthy. About the Role At OpenAI, we're dedicated to advancing artificial intelligence, and we know that creating a secure and reliable platform is vital to our mission. That's why we're seeking a software engineer to help us build out our trust and safety capabilities. In this role, you'll work with our entire engineering team to design and implement systems that detect and prevent abuse, promote user safety, and reduce risk across our platform. You'll be at the forefront of our efforts to ensure that the immense potential of AI is harnessed in a responsible and sustainable manner. Your Responsibilities: Architect, build, and maintain anti-abuse and content moderation infrastructure designed to protect us and end users from unwanted behavior. Work closely with our other engineers and researchers to utilize both industry standard and novel AI techniques to measure, monitor and improve AI models’ alignment to human values. . Diagnose and remediate active incidents on the platform and build new tooling and infrastructure that address the root causes of system failure. You might thrive in this role if: You have built and run production services in a high growth, rapidly scaling environment. You can debug live issues and restore systems quickly. You have worked on content safety, fraud, or abuse, or are motivated and excited to work on present-day (“now-term”) AI safety. You have experience with Python or with modern languages such as C++, Rust, or Go, and are able to quickly ramp up on Py

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. As a Distinguished Machine Learning Engineer/Technical Director in the Safety organization at Roblox, you will drive the overall technical vision and execution for all machine learning initiatives focused on maintaining the safety and civility of our users. Our industry-leading safety features ensure Roblox remains a safe and inclusive environment for our community to express themselves creatively and share experiences without fear. The Safety org is the reason why Roblox is the safest place on the internet, protecting users You will provide technical leadership on AI/ML efforts for Trust and Safety as the Roblox platform scales to serve different age groups and geographic locations. You Will: Own the technical direction and implementation of machine learning solutions for safety-related systems Lead and mentor other engineers, fostering a culture of technical excellence and inclusivity Break down long-term product requirements into iterative deliverable stages, ensuring continuous improvement Craft and build large-scale machine learning models with billions of parameters, ensuring production-readiness Facilitate challenging technical decisions across multiple teams, demonstrating empathy a

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. As a Senior Product Designer, you’ll be a key member of the Safety design team, playing a critical role in building the systems that keep Roblox safe, civil, and inclusive for a global community. You’ll focus on creating platform-level designs and frameworks that support users in moments of need and uphold community standards across the entire Roblox ecosystem, across Creator, Player, and Brands. Roblox’s mission is to connect a billion people with optimism and civility. The safety organization is at the heart of that mission, working to detect, remove, and prevent problematic content and behavior at scale. We also ensure account security, platform compliance with global regulations, and a healthy, inclusive environment for users of all ages. You’ll collaborate closely with cross-functional teams across product, engineering, and research, shaping the platform's approach to trust and safety through thoughtful design. This is an opportunity to work at the systems level—defining how safety is embedded across Roblox and designing reusable frameworks that power our vision of civil immersive online communities. You will: Create clear, compelling, and empathetic experiences that help users underst

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join: Fraud & Safety Investigations (FSI) is at the heart of keeping Airbnb safe for the millions of hosts and guests who trust our platform every day. As part of Global Operations, FSI investigates and enforces on fraud and safety cases across the full user lifecycle — from account creation to post-stay — leveraging a team of internal and partner agents operating 24/7 across the globe. We're entering a new chapter: building AI-native, self-service operational infrastructure that lets our teams move faster, make better decisions, and focus their energy where it matters most. The Difference You Will Make: We're building a new team — Scaled Services —focused on the foundational capabilities that the entire FSI organization depends on: how we launch, how we measure quality, how we build tools, and how we use data. As the Senior Manager leading Scaled Services, you'll be on the FSI leadership team and report directly to the Director of Fraud and Safety Investigations. You will lead three teams spanning scaled implementation, data & internal tooling, and quality assurance and standards. This is a high-impact and leadership role: the process, tools, and systems your team builds and governs enables our global operational team to make the right decisions for our Airbnb community. You'll own three outcomes for the org: Scaled infrastructure: Build the tools, automated data models, and automated workflows the entire org needs to function. Self-service velocity: Create shared AI-ready data, metric definitions, and self-service infra so every domain and agent can move faster without dep

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible. At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI. Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here . The Compliance product and engineering team is responsible for ensuring that Pinterest scalably complies with all new and existing regulations, and advocates for Pinner privacy and safety, data governance, and rights holders. What you’ll do: Understand global and domestic legislative landscape, specifically related to content and IP laws, to inform prioritization Own and drive the Compliance Engineering product roadmap, including tools for rights holders, legal reporting channels, and associated internal workflows Partner with Engineering to identify and build systems and features that scale across legislation Own and improve suite of copyright and trademark tools to allow rights holders to manage their content at scale Lead key compliance projects, partnering with Legal, Operations, Policy, Engineering and o

About the Team The Integrity team builds the systems OpenAI uses to understand, prevent, and respond to misuse across our products. We partner with Product, Policy, Safety Systems, User Operations, Security, Legal, Privacy, OpenAI for Government, and research teams to turn policy and threat models into product controls, review workflows, measurement systems, and enforcement paths. About the Role We are hiring a Product Manager to own Integrity's product strategy for sensitive deployments: contexts where model capability, customer or deployment setting, privacy constraints, and misuse potential make the operating bar unusually high. This includes government and other high stakes deployments, regulated or high-trust enterprise contexts, zero data retention and privacy-constrained environments, and agentic workflows where harm can unfold across many steps rather than a single prompt. The Sensitive Deployments PM will focus on high-consequence use cases relevant to government deployments and broader deployment-readiness questions for high-risk domains (e.g., healthcare), while building reusable Integrity capabilities for agentic detection and enforcements in these environments. This position is based in San Francisco, CA, with relocation assistance available. In this role, you will: Own the roadmap for sensitive deployment Integrity controls and readiness criteria. Define how we measure residual risk, decision quality, review quality, and mitigation effectiveness. Build agentic investigation and context-assembly workflows for complex, multi-step misuse patterns. Partner with Policy, Legal, Privacy, Safety Systems, User Ops, Government, and product teams to build shared capabilities. Create launch and deployment playbooks for sensitive customer, capability, and product contexts. You might thrive in this role if you: Have shipped complex product systems in AI, integrity, trust and safety, security, privacy, risk, government, regulated enterprise, or AI safety. Can turn am

About the Team The Private Computing team works across product, engineering, security, and safety to build advanced privacy products and infrastructure at OpenAI. Our mission is to provide world-class security features to users so their private data remains private, even from OpenAI. We use technologies like confidential computing, trusted execution environments, and end-to-end encryption to ship product features across ChatGPT, the API, and our future consumer devices. About the Role We’re looking for software engineers to design, build, and scale novel privacy features and infrastructure across ChatGPT, API, and future consumer devices. In this role, you will: Ship fast while balancing difficult trade-offs in complex domains Build core abstractions for trusted execution environments and end-to-end-encryption Build product features for private inference and storage across ChatGPT, API, and future consumer devices Update build systems to increase trust and verifiability Integrate with safety and integrity infrastructure Operate systems at scale with high reliability, including an on-call rotation Collaborate with a diverse set of cross-functional teams across product, engineering, security, safety, policy, and legal You might thrive in this role if you: Care deeply about user privacy and security Have 5+ years of experience in professional software engineering Have experience building and scaling confidential computing or encryption technologies in production environments Have experience with Kubernetes and cloud orchestration systems Take pride in building and operating scalable, reliable, secure systems Can collaborate well and drive alignment in the face of difficult trade-offs Are comfortable with ambiguity and rapid change Workplace & Location This role is based in San Francisco, CA. We follow a hybrid model with 4 days a week in the office and offer relocation assistance to new employees. About OpenAI OpenAI is an AI research and deployment company dedicat

GitLab is the intelligent orchestration platform for DevSecOps. GitLab enables organizations to increase developer productivity, improve operational efficiency, reduce security and compliance risk, and accelerate digital transformation. More than 50 million registered users and more than 50% of the Fortune 100* trust GitLab to ship better, more secure software faster. The same principles built into our products are reflected in how our team works: we embrace AI as a core productivity multiplier, with all team members expected to incorporate AI into their daily workflows to drive efficiency, innovation, and impact. GitLab is where careers accelerate, innovation flourishes, and every voice is valued. Our high-performance culture is driven by our values and continuous knowledge exchange, enabling our team members to reach their full potential while collaborating with industry leaders to solve complex problems. Co-create the future with us as we build technology that transforms how the world develops software. * Fortune 500® is a registered trademark of Fortune Media IP Limited, used under license. Claim based on GitLab data. Fortune 100 refers to the top 20% ranked companies in the 2025 Fortune 500 list, published in June 2025. Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of GitLab. An overview of this role You will engineer security improvements to the GitLab product as well as building and maintaining the tools we use to detect and prevent abuse on our SaaS platforms. A strong software engineering background with experience in large Ruby/Rails codebases is required. As a senior engineer on the Trust and Safety team, you will predictively identify abuse patterns and trends and build anomaly detection and prevention systems to mitigate abusive users and their activities. This role is an ideal fit for candidates with software engineering backgrounds interested in moving into security engineering. Formal

About the Team The Integrity team at OpenAI is dedicated to ensuring that our cutting-edge technology is not only revolutionary, but also secure from a myriad of adversarial threats. We strive to maintain the integrity of our platforms as they scale. The Integrity team is at the front lines of defending against misuse in all its forms: content abuse, scaled attacks, and other actions that could undermine the user experience or harm our operational stability. About the Role As a Machine Learning Engineer in OpenAI's Integrity team, you will have the opportunity to work with some of the brightest minds in AI. You’ll work on state-of-the-art models and classifiers, experiment with new architecture and approaches, and push forward our abilities in content and user understanding. You’ll help turn research breakthroughs into tangible solutions that improve the trust and safety of our platform. If you're excited about training LLMs and building ML models, this role is your chance to make a significant mark. In this role, you will: Innovate and Deploy: Design and deploy advanced machine learning models that solve real-world problems. Bring OpenAI's research from concept to implementation, creating AI-driven applications with a direct impact. Collaborate with the Best: Work closely with researchers, software engineers, and product managers to understand complex business challenges and deliver AI-powered solutions. Be part of a dynamic team where ideas flow freely and creativity thrives. Optimize and Scale: Implement scalable data pipelines, optimize models for performance and accuracy, and ensure they are production-ready. Contribute to projects that require cutting-edge technology and innovative approaches. Learn and Lead: Stay ahead of the curve by engaging with the latest developments in machine learning and AI. Take part in code reviews, share knowledge, and lead by example to maintain high-quality engineering practices. Make a Difference: Monitor and maintain deployed m