About the Team The Monetization team is a new cross-functional group working across engineering, product, research, and design to build the foundational systems that will help OpenAI scale access to intelligence responsibly. Our mission is to develop user-first, privacy-preserving monetization products—including next-generation ads experiences—that strengthen user trust, unlock economic opportunity, and support OpenAI’s long-term innovation. Monetization plays a critical role in enabling OpenAI to continue pushing the boundaries of AI capabilities while ensuring the benefits of AGI are broadly shared. We believe monetization must be aligned with user value, uphold rigorous privacy and safety standards, and sustain a healthy ecosystem of developers and businesses. This team operates in a greenfield environment and moves quickly through prototyping, experimentation, and iterative deployment. We partner closely with Product, Design, and Research to bring research breakthroughs into real-world systems at global scale. About the Role We’re looking for an experienced Software Engineer to help build the machine learning infrastructure that powers OpenAI’s monetization and ads systems. In this foundational role, you’ll design and develop the platform layer that enables teams to build, train, deploy, serve, monitor, and continuously improve machine learning models used across advertising and monetization products. You’ll work across the full ML lifecycle, from large-scale data pipelines and feature infrastructure to training systems, model serving, experimentation platforms, and monitoring frameworks. The systems you build will support high-throughput, low-latency advertising workloads while maintaining strict standards for reliability, privacy, security, and performance. This role sits at the intersection of machine learning systems, distributed infrastructure, and monetization, offering the opportunity to shape the core platforms that help translate model innovation into m
Jobs in United States
Trust And Safety Policy in San Francisco
200 active opportunities · Updated October 2026
Showing
15 jobs
Explore current trust and safety policy jobs in San Francisco. Filter by work mode, employment type, experience, department, date posted and distance.
About the Team The Monetization team is a new cross-functional group working across engineering, product, research, and design to build the foundational systems that will help OpenAI scale access to intelligence responsibly. Our mission is to develop user-first, privacy-preserving monetization products—including next-generation ads experiences—that strengthen user trust, unlock economic opportunity, and support OpenAI’s long-term innovation. Monetization plays a critical role in enabling OpenAI to continue pushing the boundaries of AI capabilities while ensuring the benefits of AGI are broadly shared. We believe monetization must be aligned with user value, uphold rigorous privacy and safety standards, and sustain a healthy ecosystem of developers and businesses. This team operates in a greenfield environment and moves quickly through prototyping, experimentation, and iterative deployment. We partner closely with Product, Design, and Research to bring research breakthroughs into real-world systems at global scale. About the Role We’re looking for an experienced Software Engineer to help build the core infrastructure behind OpenAI’s monetization and ads systems. In this foundational role, you’ll architect and implement distributed systems that power OpenAI’s monetization stack—focusing on reliability, performance, privacy, and large-scale operation. You’ll work across backend, systems, and platform layers to define and implement 0→1 infrastructure, partnering closely with Product, Design, and Research to shape the future of monetized AI experiences. Your work will enable both internal and external teams to build on safe, scalable, and robust monetization primitives. This role is exclusively based across our San Francisco & Seattles sites. We offer relocation assistance to new employees. In this role, you will: Design and build the foundational backend and infrastructure powering OpenAI’s monetization and ads systems Architect large-scale distributed systems that
About the Team The Monetization team is a new cross-functional group working across engineering, product, research, and design to build the foundational systems that will help OpenAI scale access to intelligence responsibly. Our mission is to develop user-first, privacy-preserving monetization products, including next-generation ads experiences, that strengthen user trust, unlock economic opportunity, and support OpenAI’s long-term innovation. Monetization plays a critical role in enabling OpenAI to continue pushing the boundaries of AI capabilities while ensuring the benefits of AGI are broadly shared. We believe monetization must be aligned with user value, uphold rigorous privacy and safety standards, and sustain a healthy ecosystem of developers, advertisers, and businesses. This team operates in a greenfield environment and moves quickly through prototyping, experimentation, and iterative deployment. We partner closely with Product, Design, and Research to bring new ad experiences into real-world systems across OpenAI surfaces at global scale, including thoughtfully integrating them into the core ChatGPT experience. About the Role We’re looking for an Android Engineer to help build the native Android experiences and client-side systems that power how ads are structured, rendered, and delivered across OpenAI’s ads ecosystem. This role sits within the Ads Formats team, which owns the creative rendering and presentation layer for next-generation ads experiences across different surfaces and media types. You’ll help build the Android infrastructure and tooling that support formats such as text, image, video, native, conversational, and interactive ads, while ensuring they render reliably and perform efficiently across platforms. You’ll work closely with backend, Product, Design, Research, and Safety partners to shape Android architecture that supports user-first, privacy-preserving monetization experiences within ChatGPT and OpenAI’s broader mobile ecosystem. In th
$230K – $260K/yr
Who We Are Notion is the collaborative AI workspace where teams and agents think together . We're building one place where your knowledge, projects, meetings, and AI tools live side by side, so work is faster, clearer, and less fragmented. Millions of individuals, small teams, and large companies run their work on Notion. Notinos (our employees) are customer zero in bringing this future of work to life. We care about craft, building things that last, and the belief that great work is still fundamentally human. Our goal isn’t to ship the next feature. Each and every team of Notinos is working to set the standard for how humans work together in the AI era. From building a business’s system of record to making and managing AI agents to automating away the busy work, we care deeply about giving our customers more time for their life’s work. About The Role Millions of people rely on Notion to do their most important work, and protecting that trust is foundational to everything we build. We’re looking for a hands-on Detection Engineer to build and operate the systems and workflows we use to detect and respond to attacks across Notion’s cloud-native environment. You’ll ship high-signal detections, improve the platform that powers them, participate in incident response, and help shape how detection and response engineering scales at Notion. You’ll work closely with Engineering, Corporate Security, and Infrastructure, with broad latitude to identify gaps, prioritize investments, and build what’s needed next. We view detection and response as a software engineering discipline: detections are code, platforms are products, and measurement matters What You'll Achieve Design and maintain high-signal detections across cloud, identity, endpoints, and SaaS environments. Build and improve the detection platform, including rule lifecycle management, tuning, measurement, and rollout safety. Develop tooling and automation that accelerate triage, enrichment, investigation, and detection
About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible. At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI. Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here . TwoTwenty is Pinterest's innovation lab, building visual-first AI products — assistants, Gen-AI creation tools, and editing experiences — with startup speed at Pinterest scale. We're looking for a Senior Director of Engineering to lead a team of 10 (7 direct reports across ML engineering, software engineering, data science, and product management), own the technical strategy for TwoTwenty's AI product portfolio, and scale the org from scrappy to enduring without losing what makes it fast. This role reports to the VP of Product Management, Core, and partners closely with Pinterest's Core Product & Engineering, Advanced Technologies Group, and Trust & Safety teams to ship AI features that reach hundreds of millions of Pinners. What you'll do: Drive execution of TwoTwenty's 1–3 year technical strategy across visual AI assistants, gen-AI cre
About the Team The Plugin Developer Platform team builds the APIs, SDKs, and tools that let people extend ChatGPT and Codex. We work on plugins, connectors, the Model Context Protocol (MCP), and interactive apps. We want anyone to be able to turn a useful workflow into a plugin, share it, and have other people use it. A plugin can package instructions and skills with connections to the tools and data it needs. Our work covers plugin creation and publishing, the systems that run plugins across our products, and open standards that developers can build on. About the Role We’re looking for platform-minded engineers who know what it takes to build a platform developers want to use. You’ll work across developer-facing interfaces, APIs, and backend systems. You’ll own features from the first developer conversation through implementation and release. You’ll talk directly with developers, partners, and the open-source community. Their experience will inform the APIs and abstractions you design, the problems you prioritize, and the tradeoffs you make. This role is based in San Francisco. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees. What You’ll Do Design and ship APIs, SDKs, and services that developers use to extend ChatGPT and Codex. Make plugins easier to create, test, publish, update, and share. Improve compatibility and consistency across ChatGPT and Codex, including interactive app experiences. Contribute to MCP and other open standards, bringing practical developer needs into their design. Work with developers and partners to understand recurring problems and improve the platform, tooling, and documentation. Work with Product, Research, Security, and Trust & Safety on permissions, compatibility, and safe, reliable execution. You Might Thrive Here If You Have built software that other developers use. Your experience might include an open-source project, an API or SDK, a developer platform, internal too
About the team The Applied team safely brings OpenAI's technology to the world. We released ChatGPT; Plugins; DALL·E; and the APIs for GPT-5, embeddings, and fine-tuning. We also operate inference infrastructure at scale. There's a lot more on the immediate horizon. Our customers build fast-growing businesses around our APIs, which power product features that were never before possible. ChatGPT is a prime example of what is currently possible. We simultaneously ensure that our powerful tools are used responsibly. Safe deployment is more important to us than unfettered growth. The Fraud Engineering team works within our Applied Engineering organization identifying and responding to fraudsters on our platform. We are looking for a software engineer with anti fraud & abuse experience to help architect and build our next-generation anti-fraud systems. About the role The Scaled Abuse team protects OpenAI’s products and customers by detecting, preventing, and responding to fraudulent and abusive behavior at scale. We build and operate the backend and data systems that power real-time detection, investigation workflows, and enforcement — balancing strong protections with a great user experience as the platform grows. Our work sits at the intersection of engineering and abuse expertise: we partner closely with Trust & Safety, Security, and Product to understand emerging attack patterns, translate messy signals into clear system behavior, and continuously harden our defenses. The problems are dynamic and ambiguous by default, so we value engineers who can quickly dive into an unfamiliar codebase, develop strong intuition about how it works end-to-end, and propose pragmatic improvements that make the entire stack more resilient. In this role, you will: Design and build systems for fraud detection and remediation while balancing fraud loss, cost of implementation, and customer experience Work closely with finance, security, product, research, and trust & safety ope
About the Team Security is foundational to OpenAI’s mission to ensure that artificial general intelligence benefits all of humanity. The Security organization protects OpenAI’s technology, people, and products by building and operating deeply technical systems that must work reliably at massive scale. Our work underpins OpenAI’s commitments around safety, privacy, and security across research, products, and emerging platforms. The Host Assurance team exists to make bare metal and VMs dependable & scalable foundations for OpenAI: secure by default, verifiable in practice, and resilient across providers and operating models. We operate at the trust boundary between hardware and cloud-scale orchestration, ensuring that hosts are eligible to safely run workloads with predictable security properties and auditability. About the Role OpenAI is seeking a Software Engineer, Host Assurance to build and operate the services, APIs, and host software that establish and maintain trust in our compute infrastructure. You will own production software from design and implementation through testing, rollout, observability, and operation. Your work will support capabilities such as machine identity, certificate issuance and enrollment, secure bootstrap, and host attestation across bare-metal and VM environments. Success in this role requires strong technical judgment, the ability to reason across software and host-system boundaries and learn unfamiliar parts of the stack, and a practical mindset for building systems that are secure, reliable, and usable in fast-moving production environments. The systems you build will sit on the critical path of OpenAI’s frontier infrastructure investments and will directly shape how large amounts of compute are brought online - securely, responsibly, and at global scale - underpinning long-lived commitments around privacy, security, and reliability. You will partner closely with infrastructure, research, and confidential computing initiatives—inc
About the Team Security is foundational to OpenAI’s mission to ensure that artificial general intelligence benefits all of humanity. The Security organization protects OpenAI’s technology, people, and products by building and operating deeply technical systems that must work reliably at massive scale. Our work underpins OpenAI’s commitments around safety, privacy, and security across research, products, and emerging platforms. The Host Assurance team exists to make bare metal a dependable, scalable foundation for OpenAI: secure by default, verifiable in practice, and resilient across providers and operating models. We operate at the trust boundary between physical hardware and cloud-scale orchestration, ensuring that hosts are eligible to safely run workloads with predictable security properties and auditability. About the Role OpenAI is seeking a Security Engineer, Host Assurance to help build the trust foundations for bare-metal platforms across OpenAI’s global infrastructure. This is a deeply hands-on engineering role for a builder who can design, implement, and operate the core security infrastructure that establishes trust in hardware platforms before they are eligible to run workloads. Success in this role requires strong technical judgment, the ability to work comfortably at low levels of the stack, and a practical mindset for building systems that are secure, reliable, and usable in fast-moving production environments. The systems you build will sit on the critical path of OpenAI’s frontier infrastructure investments and will directly shape how large amounts of compute are brought online - securely, responsibly, and at global scale - underpinning long-lived commitments around privacy, security, and reliability. You will partner closely with infrastructure, research, and confidential computing initiatives—including novel hardware platforms and emerging deployment models– to make the secure path the easiest path. This role is well suited for engineers who enjo
About the Team Governance, Risk, and Compliance (GRC) is foundational to Security delivering mission outcomes at OpenAI. The GRC team provides security assurances and builds compliance for OpenAI’s technology, people, and products. We are technical in what we build but operational in how we do our work, and we partner deeply with Product, Security, Legal, Privacy, GTM, and Field Security to help OpenAI move quickly while maintaining trust with customers, auditors, regulators, and the public. About the Role We are looking for an experienced Product Lifecycle Assurance IC to help scale OpenAI’s GRC function across our product stack to ensure products address customer and regulatory compliance requirements at launch and regressions are detected promptly and corrected. You will partner closely with Product, Security, Legal, and Privacy teams to make sure OpenAI can move quickly while maintaining our security, privacy and compliance claims and giving customers, auditors, and regulators assurance about how OpenAI handles user data. You are responsible for product assurance end-to-end from inception to post-launch (continuous) monitoring. You leverage existing workflows, reviews, and data and enhance, augment and build the components needed to create an end-to-end product assurance program. This role is not about supporting SOC or ISO audits; it's a highly cross-functional and deeply technical operations role to ensure that OAI products meet the compliance bar at launch, regressions are prevented and detected, and our compliance state can be evidenced. This role also helps ensure that our product launch governance program operates effectively across key safety, privacy, legal and security stakeholders and lessons-learned from incidents and regressions are used to improve the program. You or in partnership with engineering teams, build key controls in our infrastructure stack, developer workflows and launch tooling to provide developers with guardrails, perform CI/CD confor
About the Team OpenAI’s mission is to ensure that artificial general intelligence benefits all of humanity. The Creator Partnerships team supports that mission by building trusted relationships with creators, talent, experts, and organizations that help people understand and use AI in meaningful ways. We work closely with teams across OpenAI to develop thoughtful partnerships and programs grounded in trust, usefulness, cultural relevance, and measurable impact. Our focus extends beyond promoting individual product features. We aim to help partners discover valuable applications of AI, share credible insights with their communities, and create lasting value for both OpenAI and the people we work with. About the Role We are seeking a Scaled Partnerships Manager to own the agency relationships and operating systems that enable OpenAI to work with influencers and creators at scale. This person will manage key creator marketing agencies and platforms, establish clear standards for selection, pricing, deliverables, brand safety, execution, and measurement, and ensure our programs are both culturally credible and operationally rigorous. You will translate go-to-market priorities into repeatable creator programs across a mix of micro, mid-tier, and larger creators. You will be accountable for the full agency and campaign lifecycle, from annual planning and briefing through execution, paid amplification, reporting, optimization, and post-program learning. This role is based in San Francisco, CA. We use a hybrid work model of three days in the office per week and offer relocation assistance to new employees. In This Role, You Will Lead scaled creator marketing programs aligned to business priorities. Own the creator agency portfolio, including partner selection, scopes, budgets, staffing, performance expectations, operating cadence, and business reviews. Build a clear agency model that defines each partner’s role, internal and external ownership, and how work moves from brief
About the Role OpenAI’s brands are trusted by hundreds of millions of users around the world. As awareness and adoption of OpenAI’s products continue to grow, so does the volume and sophistication of brand abuse, including impersonation, scams, copycat applications, fraudulent websites, social media misuse, and other forms of online infringement. We are seeking an experienced Brand Protection Manager to build and operate OpenAI’s global brand protection program. This role will lead efforts to identify, prioritize, and address misuse of OpenAI’s brands across websites, social media platforms, app stores, marketplaces, advertising networks, and other online ecosystems. The ideal candidate combines strong operational execution, investigative instincts, and program management skills. They are comfortable working across Legal, Marketing, Comms, Security, Trust & Safety, and external partners to address emerging threats and develop scalable enforcement programs. This role will lead OpenAI’s Brand Protection & Operations function and help ensure that OpenAI’s brands remain trusted, protected, and resilient as the company continues to grow globally. This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees. In this role, you will: Build and operate OpenAI’s global brand protection program. Monitor and respond to misuse of OpenAI brands across websites, social media, marketplaces, app stores, advertising platforms, and emerging online ecosystems. Develop and manage programs to protect OpenAI products, services, and associated brands. Coordinate investigations and enforcement efforts across online and offline channels. Partner with product, marketing, security, trust & safety, and legal teams to address brand abuse and emerging threats. Develop enforcement playbooks, prioritization frameworks, and escalation processes. Manage relationships with brand protection vendors, mon
About the Team The Support team is central to ensuring that our customers' experience with our products is nothing short of exceptional. We resolve complex issues, provide technical guidance, and support customers in maximizing value and adoption from deploying our products. We work closely with Sales, Technical Success, Product, Engineering and others to deliver the best possible experience to our customers at scale. OpenAI's customers represent a range of diverse backgrounds and maturity, from early-stage startups to established global enterprises. Given OpenAI’s breakneck shipping cadence and growth – and the expectation that it will only accelerate – our ability to architect automation systems and agentic workflows for scale is central to our ability to maintain exceptional support quality in the face of AGI. About the Role As a Support Vendor Manager, you will own the health, performance, and long-term scalability of multiple support partner and vendor relationships. This is a vendor leadership role first and foremost: you will drive commercial and operational accountability (SLAs, QBRs, escalation paths, remediation plans), while also building the operating model that enables support to scale without linear headcount growth. You’ll collaborate closely with User Operations teams (e.g., Trust & Safety, Fraud & Risk), Systems/Tooling, Data partners, and Product/PM stakeholders as we launch new workflow and launch and scale new programs. You’ll be responsible for: End-to-end vendor leadership: Own day-to-day oversight, relationship health, and executive-level accountability for multiple support vendors/BPOs. Performance management & remediation: Define and manage SLA/KPI performance expectations, run WBRs/QBRs, identify performance gaps, and drive structured turnaround plans with clear owners and timelines. Escalation and risk management: Serve as the primary escalation point for vendor issues, including incident response, surge events, quality regress
About the Team OpenAI’s Financial Engineering and Identity data science team owns how revenue flows through our products and builds the systems that enable people and organizations to access OpenAI products safely, seamlessly, and at global scale. Identity sits at the critical intersection of growth, trust, and user experience. The team owns the experiences and infrastructure behind sign up, sign in, account recovery, authentication, and identity integrations across both consumer and enterprise products. As OpenAI expands across products and markets, Identity plays an increasingly important role in helping more users get started quickly while protecting them from abuse, fraud, and account compromise. About the Role We're looking for the first dedicated Data Scientist to partner with the Identity organization. In this role, you will define how we measure success across the entire identity journey—from first-time sign up and onboarding through authentication, account recovery, and enterprise identity experiences. You'll develop the experimentation frameworks, metrics, and analytical approaches that guide product decisions while helping the team navigate one of Identity's core challenges: optimizing growth while maintaining trust and security. You'll work closely with Product, Engineering, Design, Abuse, Risk, and Go-to-Market teams to identify opportunities, quantify trade-offs, and influence strategy. Some questions can be answered through A/B tests. Others require observational analyses, causal inference, and judgment under uncertainty. This is an opportunity to shape the analytical foundations of a high-impact product area from the ground up. This role is based in San Francisco, CA. We use a hybrid model (3 days/week in office) and offer relocation support. In this role, you will Define the north-star metrics and measurement frameworks used to evaluate the identity experience across consumer and enterprise products. Design and analyze experiments to optimize top-of
About the Team The Cybersecurity Products team builds products at the frontier of AI and cybersecurity. Our work includes Codex Security and related cyber products that turn advances in model capability into dependable tools for defenders. We help teams find, validate, and remediate vulnerabilities, continuously improve the security of software, and test AI-powered applications before they reach production. About the Role As a Full Stack Software Engineer, you will build the product experiences and systems that make AI-powered security useful in real engineering environments. You will work across web surfaces, APIs, orchestration, data models, and integrations to help security and engineering teams move from a codebase or application to evidence-backed findings, prioritized remediation, and revalidation. You will collaborate closely with product engineers, security researchers, and customer-facing teams. The work spans fast-moving product development and hard systems problems: long-running workflows, large repositories, sensitive data, reliability, observability, and a high bar for earning user trust. This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees. In this role, you will: Build end-to-end workflows for vulnerability discovery, security scanning, red teaming, findings review, remediation, and reruns. Design and operate backend services for long-running security work, including APIs, asynchronous orchestration, durable state, and integrations with developer workflows. Make complex security results actionable through clear product surfaces, strong evidence, thoughtful prioritization, and reliable reporting. Partner with security researchers, product teams, and users to evaluate quality, reduce noise, improve coverage, and ship safely. You might thrive in this role if you: Have experience shipping production full-stack products across modern web frontends and backend s
Other cities to consider
More places hiring for this role
Get new trust and safety policy jobs in San Francisco, United States by email
Daily job updates · Unsubscribe anytime