Trust And Safety Policy in United States

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join: Our hosts are opening their homes or providing experiences to guests from around the world. We’re creating new relationships & placing people in vulnerable situations. Therefore trust is the fundamental currency of Airbnb. We are the Trust & Safety team, composed of engineers, data scientists, designers, product managers, and operations, responsible for earning this trust by building for safety at each moment of the guest and host journey. We build cutting edge machine learning models to detect risk, defenses to deter risky actors, and operations tools that enable investigators worldwide. We define community standards and policies, set high expectations, and keep bad actors out while providing delightful experiences for good users. The Difference You Will Make: As a Product Manager in the Trust & Safety team, you will identify customer pain points, business opportunities, and define/deliver the products that help us create a safe and trusted community around the world. Your work will be pivotal to shaping the future of hospitality and travel. Within the Trust & Safety team, you’ll be focused on Safety: To reduce safety incidents (e.g. interpersonal harm and illegal activities). A Typical Day: Creating vision and strategy for Trust & Safety products and platforms. Leading a cross-functional working group of engineers, data scientists, designers, operations experts, and policy experts to ensure alignment, execution, and launches Maintaining product backlog and the product roadmap. Own prioritization process of product solutions based on business v

About the Team Our Safety Systems team is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency. Within Safety Systems, the Model Policy team works to ensure that increasingly capable models behave safely and reliably in real-world environments. We investigate emerging model failures, define the behavior models should exhibit instead, and develop the data, evaluations, monitoring, and safeguards needed to improve and validate that behavior. Our work connects alignment research with the practical challenges of training and deploying frontier models. About the Role In this role, you will shape how OpenAI understands and addresses real-world risks that emerge from model misalignment as models become more autonomous and operate over longer horizons. You will investigate how misaligned behavior emerges across extended trajectories - including when models persist toward the wrong objective, take unsafe shortcuts, lose track of instructions, exploit weaknesses in their environment, or circumvent constraints - and translate these insights into behavioral policies, evaluations, monitoring, and safeguards. This role is ideal for someone who wants to turn alignment and safety concerns into concrete, empirically grounded improvements to frontier AI systems. Your Responsibilities: Identify vulnerabilities that emerge as models interact with tools, data, and external systems, and translate them into model- and system-level safeguards. Develop threat models and empirical frameworks for understanding harmful outcomes from misaligned behavior. Build frameworks for understanding harmful outcomes arising from model misalignment. Identify the underlying behaviors and system conditions that drive those outcomes. Turn findings into policy frameworks, evaluation criteria, online measurement and safeguards. Develop human data campaigns and gold sets to ground measurement and evaluation of eme

Replit is the agentic software creation platform that enables anyone to build applications using natural language. With millions of users worldwide, Replit is democratizing software development by removing traditional barriers to application creation. About the Role We're redefining how software is built and who gets to build it. Our mission is to achieve Autonomy for All: making programming accessible, collaborative, and powered by AI. Realizing that vision requires a platform that legitimate users can trust and adversarial actors cannot exploit. We're hiring a Data Scientist to help build Replit's Trust & Safety and Anti-Abuse program from the ground up. You'll turn noisy behavioral, identity, payment, infrastructure, and content signals into the measurement systems, detections, and decisions that protect Replit's users, platform, and economics. You'll work closely with Engineering, Support, Legal, Security, Infrastructure, Money, and Growth to make abuse economically unviable while keeping friction low for legitimate users. Replit sits at the frontier of AI-native abuse. Our platform is a target for phishing and scam hosting, cryptomining, LLM token farming, card and coupon fraud, referral abuse, and increasingly, abuse driven by AI agents themselves. You'll help define how we identify, measure, and respond to these threats without compromising the experience of good users. Who You Are You're a data scientist who moves fast, goes deep, and thinks adversarially. You can spin up an analysis in hours that would take others days, not by cutting corners, but because you've built the intuition and technical toolkit to get to the right answer quickly. You dig past the top-line abuse rate to understand selection effects, missing labels, policy changes, attacker adaptation, and the false positives hidden inside an aggregate metric. You understand that Trust & Safety data is imperfect and outcomes are high stakes. Ground truth is delayed, biased, and often incomple

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible. At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI. Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here . As a Staff Product Manager for the GenAI Safety team within Trust & Safety, you'll define and drive the product strategy for ensuring Pinterest's GenAI-powered systems are safe, fair, and trustworthy. You'll be responsible for building proactive safety frameworks that scale with our growing AI capabilities, partnering deeply with engineering, policy, data science, and design to protect our users while enabling Pinterest to innovate responsibly. This is a high-impact role for someone who is passionate about the intersection of AI and user safety, and who thrives in ambiguous, fast-evolving problem spaces. You'll work at the frontier of responsible AI - anticipating novel harms before they emerge, red-teaming new AI features, and translating complex policy goals into measurable product requirements. What you'll do: GenAI Safety Strategy: Own a

Replit is the agentic software creation platform that enables anyone to build applications using natural language. With millions of users worldwide, Replit is democratizing software development by removing traditional barriers to application creation. Role Summary Replit is the agentic software creation platform that enables anyone to build applications using natural language. With millions of users worldwide, Replit is democratizing software development by removing traditional barriers to application creation. As a Disputes and Chargeback Program Manager at Replit, you’ll be part of our Trust and Safety Operations team, who owns customer-facing workflows that handle sensitive and policy-driven interactions across the Support organization. This includes areas such as privacy requests, DMCA and intellectual property claims, law enforcement requests, and abuse appeals. You'll own Replit's disputes and chargeback function end-to-end: from the individual case in front of you to the policies, playbooks, and automation that let it hold up as we scale to millions of users. This role combines strategic ownership with hands-on execution: you'll determine dispute and chargeback strategy, and build the systems that make those decisions repeatable at scale, working closely with Engineering, Legal and Finance. In this role you will… Own the full dispute lifecycle: investigate incoming chargebacks and disputes, decide whether and how to represent, gather evidence, and respond within network deadlines. Design and maintain the policies, decision trees, and SOPs that govern how disputes and chargebacks are handled. Define the key metrics, health targets, and goals for the disputes program and track performance against them, reporting to leadership. Monitor chargeback rates and dispute trends to identify the underlying drivers of volume, and partner with Engineering and Finance to address root causes. Partner with Engineering and Support Operations to automate manual parts of the wor

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible. At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI. Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here . The Compliance product and engineering team is responsible for ensuring that Pinterest scalably complies with all new and existing regulations, and advocates for Pinner privacy and safety, data governance, and rights holders. What you’ll do: Understand global and domestic legislative landscape, specifically related to content and IP laws, to inform prioritization Own and drive the Compliance Engineering product roadmap, including tools for rights holders, legal reporting channels, and associated internal workflows Partner with Engineering to identify and build systems and features that scale across legislation Own and improve suite of copyright and trademark tools to allow rights holders to manage their content at scale Lead key compliance projects, partnering with Legal, Operations, Policy, Engineering and o

About the Team The Integrity team builds the systems OpenAI uses to understand, prevent, and respond to misuse across our products. We partner with Product, Policy, Safety Systems, User Operations, Security, Legal, Privacy, OpenAI for Government, and research teams to turn policy and threat models into product controls, review workflows, measurement systems, and enforcement paths. About the Role We are hiring a Product Manager to own Integrity's product strategy for sensitive deployments: contexts where model capability, customer or deployment setting, privacy constraints, and misuse potential make the operating bar unusually high. This includes government and other high stakes deployments, regulated or high-trust enterprise contexts, zero data retention and privacy-constrained environments, and agentic workflows where harm can unfold across many steps rather than a single prompt. The Sensitive Deployments PM will focus on high-consequence use cases relevant to government deployments and broader deployment-readiness questions for high-risk domains (e.g., healthcare), while building reusable Integrity capabilities for agentic detection and enforcements in these environments. This position is based in San Francisco, CA, with relocation assistance available. In this role, you will: Own the roadmap for sensitive deployment Integrity controls and readiness criteria. Define how we measure residual risk, decision quality, review quality, and mitigation effectiveness. Build agentic investigation and context-assembly workflows for complex, multi-step misuse patterns. Partner with Policy, Legal, Privacy, Safety Systems, User Ops, Government, and product teams to build shared capabilities. Create launch and deployment playbooks for sensitive customer, capability, and product contexts. You might thrive in this role if you: Have shipped complex product systems in AI, integrity, trust and safety, security, privacy, risk, government, regulated enterprise, or AI safety. Can turn am

About the Team The Private Computing team works across product, engineering, security, and safety to build advanced privacy products and infrastructure at OpenAI. Our mission is to provide world-class security features to users so their private data remains private, even from OpenAI. We use technologies like confidential computing, trusted execution environments, and end-to-end encryption to ship product features across ChatGPT, the API, and our future consumer devices. About the Role We’re looking for software engineers to design, build, and scale novel privacy features and infrastructure across ChatGPT, API, and future consumer devices. In this role, you will: Ship fast while balancing difficult trade-offs in complex domains Build core abstractions for trusted execution environments and end-to-end-encryption Build product features for private inference and storage across ChatGPT, API, and future consumer devices Update build systems to increase trust and verifiability Integrate with safety and integrity infrastructure Operate systems at scale with high reliability, including an on-call rotation Collaborate with a diverse set of cross-functional teams across product, engineering, security, safety, policy, and legal You might thrive in this role if you: Care deeply about user privacy and security Have 5+ years of experience in professional software engineering Have experience building and scaling confidential computing or encryption technologies in production environments Have experience with Kubernetes and cloud orchestration systems Take pride in building and operating scalable, reliable, secure systems Can collaborate well and drive alignment in the face of difficult trade-offs Are comfortable with ambiguity and rapid change Workplace & Location This role is based in San Francisco, CA. We follow a hybrid model with 4 days a week in the office and offer relocation assistance to new employees. About OpenAI OpenAI is an AI research and deployment company dedicat

About the Team The Safety Systems team is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency. The Model Policy team aligns model behavior with desired human values and norms. We co-design policy with models and for models by driving rapid policy taxonomy iteration based on data and defining evaluation criteria for foundational models’ ability to reason about safety. Key focus areas include: catastrophic risk, mental health, teen safety and multimodal safety. About the Role Providing access to frontier AI systems raises complex questions around dual-use science and catastrophic risk. How should models respond to requests involving chemical synthesis, biological experimentation, or pathogen research? Where is the boundary between legitimate scientific inquiry and information that could enable misuse? How do we design policies that meaningfully reduce risk without unnecessarily restricting beneficial research? This is a senior role in which you’ll help shape policy creation and development at OpenAI for addressing biological and chemical risks. You will develop structured policy frameworks and taxonomies to guide safe model behavior. This role sits at the intersection of biosecurity expertise, AI safety research, and policy design. You will help ensure that frontier AI systems can support beneficial life sciences research, such as drug discovery, public health, and biosafety, while reducing the risk that these capabilities could be misused. This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees. In this role, you’ll: Design and maintain model policies governing chemical and biological risk, defining how models should safely handle dual-use scenarios. Develop structured taxonomies of chemical and biological risk that inform model training data, evaluation benchmarks, and safet

About the Team Our Safety Systems team is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency. Within Safety Systems, the Model Policy team aligns model behavior with desired human values and norms. We co-design policy with models and for models by driving rapid policy taxonomy iteration based on data and defining evaluation criteria for foundational models’ ability to reason about safety. About the Role Frontier AI systems are rapidly expanding what is possible in cybersecurity and software engineering. These capabilities create major defensive opportunities, but they also raise serious dual-use and misuse risks across areas such as malware development, exploit discovery, vulnerability chaining, credential abuse, cyber intrusion, and autonomous offensive operations. In this role, you will help define how OpenAI’s models should behave in high-risk cybersecurity contexts. You will develop policy frameworks, threat models, taxonomies, evaluations, and behavioral specifications that guide model behavior across training, deployment, and monitoring systems. This role sits at the intersection of cybersecurity, AI safety, threat modeling, evaluation science, and policy implementation. You will work closely with research, engineering, safety training, preparedness, and product teams to build policies that are technically grounded, measurable, enforceable, and responsive to real-world cyber risk. Your Responsibilities: Design and maintain model policies for cybersecurity and frontier-risk domains, especially dual-use and high-risk cyber capabilities. Translate cybersecurity threat models into clear behavioral specifications, evaluation criteria, grading guidance, and system-level mitigations. Define practical boundaries between legitimate security research, defensive workflows, and assistance that could materially enable harmful activity. Build policy artifacts that support i

About the Team Our Safety Systems team is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency. The Model Policy team aligns model behavior with desired human values and norms. We co-design policy with models and for models by driving rapid policy taxonomy iteration based on data and defining evaluation criteria for foundational models’ ability to reason about safety. Key focus areas include: catastrophic risk, mental health, teen safety and multimodal safety. About the Role Providing access to frontier AI systems raises complex questions around dual-use science and catastrophic risk. How should models respond to requests involving chemical synthesis, biological experimentation, or pathogen research? Where is the boundary between legitimate scientific inquiry and information that could enable misuse? How do we design policies that meaningfully reduce risk without unnecessarily restricting beneficial research? This is a senior role in which you’ll help shape policy creation and development at OpenAI for addressing biological and chemical risks. You will develop structured policy frameworks and taxonomies to guide safe model behavior. This role sits at the intersection of biosecurity expertise, AI safety research, and policy design. You will help ensure that frontier AI systems can support beneficial life sciences research, such as drug discovery, public health, and biosafety, while reducing the risk that these capabilities could be misused. Our relevant publications: Preparedness framework Preparing for future AI capabilities in biology Safety evaluations hub OpenAI GPT5 System Card Evaluating Fairness in ChatGPT Improving Model Safety Behavior with Rule-Based Rewards OpenAI Model Spec Your Responsibilities: Design and maintain model policies governing chemical and biological risk, defining how models should safely handle dual-use scenarios. Develop structured taxonomi

About the Team The Safety Systems org is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit the society and is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency. The Safety Engineering team builds the platforms and tools that make OpenAI’s models safe to use in the real world. We partner closely with researchers, product teams, and policy to turn safety ideas into reliable, scalable systems: measuring risk, enforcing safeguards, and continuously improving how models behave in production. Our work sits at the intersection of product engineering, data, and AI, and directly shapes how millions of people experience OpenAI’s technology. About the Role We’re looking for a self-starter engineer who loves building products in an iterative, fast-moving environment—especially internal tools that unlock real-world impact. In this role, you’ll build full-stack tooling for our Safety Systems teams that directly improves the safety and reliability of OpenAI’s models, including in sensitive areas like mental health and other vulnerable-user protections. Your work will increase the team’s velocity in identifying and fixing safety issues and help tighten the feedback loop between policy, data, and the model training cycle. In this role, you will: Own the end-to-end development of internal tools that help improve the safety of OpenAI’s models (with a focus on areas like mental health and other vulnerable-user protections) Partner closely with Safety Systems researchers, engineers, and model policy creators to understand workflows, pain points, and requirements—and translate them into durable product solutions Build full-stack experiences to support core model policy workflows, such as labeling and inspecting data, analyzing and reviewing failure cases, and surfacing insights for iteration Optimize internal applications f

About the Team Like every team at OpenAI, the Marketing team contributes to our broader mission of ensuring that artificial intelligence benefits all of humanity. We develop and execute strategies that build understanding of OpenAI, deepen engagement with our key audiences, and communicate why we build, how our technology is creating value, and how we approach its broader societal impact. We work closely with Global Affairs, Communications, Creative, Research, Product, and other teams to translate complex topics into clear, relevant, and compelling stories. Our work spans national campaigns and locally tailored efforts, helping people understand both the opportunities created by AI and the important issues surrounding its development and adoption. About the Role We are seeking an experienced Integrated Marketing Lead to lead policy- and reputation-focused campaigns that strengthen the OpenAI brand nationally and within local communities. This person will spearhead integrated campaigns and corporate communications initiatives that help people understand why OpenAI builds, the impact of our technology, and how we are engaging with some of the most consequential issues surrounding AI—including infrastructure and data centers, jobs and economic opportunity, and youth safety. The role combines national paid media with locally relevant marketing and engagement efforts. The ideal candidate understands policy, public affairs, and civic audiences while also being a sophisticated brand marketer who can make complex subjects accessible and meaningful to a broader public. This person will bring strategic vision, sound judgment, organizational clarity, and exceptional execution to highly visible work. They will collaborate closely with Global Affairs, Communications, Creative, Research, and external agency partners to build trust and shape understanding of OpenAI at both the national and local levels. In this role, you will: Lead policy and brand campaign strategy: Develop integ

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. Senior Engineering Manager, Safety Platform You will lead engineering pods within the Safety Platform organization, driving the technical vision and execution for the foundational systems that power every safety workflow at Roblox. You will own the core safety platform end-to-end: from the shared infrastructure and APIs that enable trust & safety capabilities across the company, to the tooling ecosystem that empowers internal operators to investigate, intervene, and resolve issues at scale. The scope also includes the Safety agentic platform — AI-powered systems that automate and augment safety workflows across detection, enforcement, and review pipelines. As the platform layer beneath every safety surface, your work will define how quickly and reliably Roblox can respond to emerging threats. This role requires a leader with a strong platform mindset who can balance technical rigor with broad organizational impact — working across User Safety, Trust & Safety Policy, Data Science, and Machine Learning to deliver scalable, extensible, and high-availability systems for one of the world's largest platforms. You Will: Lead and Develop: Recruit, hire, mentor, and inspire a diverse team of

About the Team OpenAI's mission is to ensure that artificial intelligence benefits all of humanity. OpenAI for Government works with U.S. and allied government institutions to support the responsible adoption of AI across defense, intelligence, federal civilian, state and local, and international public-sector missions. We work at the intersection of technology, policy, operations, security, and delivery to help public servants use frontier AI in ways that are effective, trusted, aligned with democratic values, and grounded in real-world consequences. The team helps government agencies transform how they work through secure, compliant AI tools and mission-aligned deployments, including ChatGPT Enterprise, ChatGPT Gov, APIs, Codex, and emerging frontier capabilities. We partner with government leaders, operators, technologists, and policy stakeholders to translate cutting-edge AI into measurable mission impact while meeting government requirements for safety, reliability, security, compliance, and trust. Cyber is a critical government mission area. OpenAI's government cyber work brings together OpenAI for Government, Product, Research, Security, Product Policy, Legal, Global Affairs, and Communications to help trusted public-sector defenders responsibly use AI to protect government networks, critical infrastructure, and national-security systems. About the Role We are seeking a senior government cyber leader to serve as Head of Government Cyber Integration for OpenAI for Government. This role will integrate OpenAI's government cyber work across strategy, testing and evaluation, trusted access, deployment, policy, security, and external engagement. This is a matrix leadership role, not a replacement for line management. Product teams still own product roadmaps. Research and Safety still own model capability measurement and risk mitigation. Security still owns OpenAI's security posture and customer security requirements. Product Policy, Legal, and Global Affairs still