Measurement Lead Jobs

About the Team The Statsig team within OpenAI builds the experimentation, feature rollout, dynamic configuration, and analytics systems that help OpenAI ship products with speed, safety, and evidence. Our work sits on the critical path for how product, engineering, research, and go-to-market teams learn from real-world usage and make high-confidence decisions. Statsig began as an independent company focused on helping builders move faster through trustworthy experimentation and feature management. After Statsig joined OpenAI, the team began the next chapter: bringing that deep product expertise, customer intuition, and mature platform infrastructure into OpenAI as the experimentation and rollout platform for every product we ship. Today, we support teams across ChatGPT, Codex, model measurement, consumer experiences including ads, business subscriptions, developer products, and the shared infrastructure that connects them. These teams rely on Statsig to safely introduce new capabilities, compare product and model behavior, measure impact, and roll changes forward or back with confidence. We are at a defining moment in the platform journey. OpenAI has the data, product surface area, and pace of innovation to learn faster than almost any organization in the world, but that potential only becomes real if teams can experiment responsibly, measure clearly, and roll out changes safely. Adoption of the platform is accelerating rapidly across the company, and recent SDK and server-side infrastructure work has already produced measurable wins in latency, reliability, memory usage, and compute efficiency for important services. Based out of OpenAI’s Bellevue office, we are a close-knit team that values in-person collaboration, urgency, craft, and impact. We build for other builders, and the best version of this team is one where every OpenAI product team can move faster because the experimentation and rollout layer is dependable, fast, and easy to use. About the Role We are l

About the Team Models are becoming increasingly capable—moving from tools that assist humans to agents that can plan, execute, and adapt in the real world. Mitigating the frontier risks resulting from these capabilities is paramount to OpenAI’s ability to continue deploying models safely. The Preparedness team is dedicated to addressing these critical risks. Our work includes: Measurement. Monitoring and predicting the evolving capabilities of frontier AI systems. Mitigation. Keeping misuse and misalignment safeguards, alignment tools, and security measures on track to adequately address extreme threats that might arise in the future. Coordination. Setting mitigation targets by maintaining OpenAI’s preparedness framework , and partnering with other staff to achieve these targets. This is urgent, fast-paced work that has far-reaching implications for the company and for society. About the Role We are seeking exceptional researchers who can push the frontier of safety mitigations. You will help derisk frontier models by developing novel safety mitigations, developing and applying new techniques from domains like interpretability, control, and alignment to ensure the safety of OpenAI’s deployed models. You will play a critical role in defining how a safe AI system should look in the future at OpenAI, making a significant impact on our mission to build and deploy safe AGI. This role requires strong technical depth and close cross-functional collaboration to ensure our safety mitigations are enforceable, scalable, and effective. We seek researchers who can partner with experts across domains such as misalignment, cybersecurity, and biology in order to develop the best possible end-to-end safety stack. In this role, you will: Work on identifying emerging AI safety risks and new methodologies for exploring and mitigating the impact of such risks Build (and then continuously refine) the evaluations that enable us to assess the extent of these risks; this might include worki

About the team Models are becoming increasingly capable—moving from tools that assist humans to agents that can plan, execute, and adapt in the real world. Mitigating the frontier risks resulting from these capabilities is paramount to OpenAI’s ability to continue deploying models safely. The Preparedness team is dedicated to addressing these critical risks. Our work includes: Measurement. Monitoring and predicting the evolving capabilities of frontier AI systems. Mitigation. Keeping misalignment safeguards, alignment tools, and on track to adequately address extreme threats that might arise in the future. Coordination. Setting mitigation targets by maintaining OpenAI’s preparedness framework , and partnering with other staff to achieve these targets. This is urgent, fast-paced work that has far-reaching implications for the company and for society. About the role Preparedness is hiring strong technical executors to support preparations for accelerated AI development, which may culminate in recursive self-improvement. This work relies on anticipating misalignment risks that might exist in the future, but might not exist now; so it’s especially important that people in this role are tasteful and strategic. The role is wide-ranging, covering any mitigation for loss of control risk, spanning the design and implementation of better pre-deployment risk-assessment , control measures , RSI-relevant training interventions, and turning one’s technical work into established institutional practices and external-facing communications. Below is a subset of our focus areas: Scalable oversight: Establishing practices for model misbehavior monitoring and oversight which remain effective in superhuman model capability regimes, with a focus on bridging from today’s monitoring approaches to future-proof ones. Automated auditing: As model capabilities increase, we’ll increasingly rely on automated approaches for finding the most severe forms of model misalignments. We’ll both need to s

About the Team GTM Growth Engineering builds AI-native products and systems that help OpenAI's go-to-market and B2B marketing organizations operate with greater speed, focus, and leverage. Our mandate is revenue leverage: products tied directly to pipeline quality, customer engagement, seller and marketer productivity, and the speed at which OpenAI can bring its technology to customers. We build the infrastructure and user experiences behind high-impact GTM workflows, including customer context, prioritization, routing, campaign execution, review surfaces, feedback loops, and measurement. Our work combines product craft, applied AI, reliable systems, and thoughtful operational design. About the Role We’re looking for a product-minded Software Engineer to build AI-powered products and full-stack experiences for GTM Growth Engineering. You will own meaningful product slices end to end, from user experience and frontend implementation to backend APIs, integrations, data models, instrumentation, and launch readiness. This is a role for engineers who want to build products that do real work in production. You will partner with Product, Design, Data Science, Sales, B2B Marketing, and operations teams to understand high-value workflows and ship systems that improve customer engagement, pipeline, conversion, and team productivity. The role is ideal for a strong product engineer who can move between product craft, systems engineering, applied AI, and measurable business outcomes. You should be excited to build from ambiguous problem statements, ship quickly, and improve products based on real user feedback. What You'll Do Build AI-powered products and workflows that help sales and B2B marketing teams identify opportunities, coordinate work, and engage customers more effectively. Own full-stack product experiences from prototype through launch, instrumentation, iteration, and production hardening. Design intuitive user journeys that combine polished interfaces, reliable servi

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. As the Senior, Internal Audit AI Enablement & Automation, you will own the day-to-day build, adoption, and measurement of Okta Internal Audit's AI automation program — turning auditor problem statements into working tools, tracking every measurable metric to a verified strategic outcome, and representing Internal Audit across Finance and company-wide AI networks. Okta Internal Audit has moved past the proof-of-concept stage. The AI enablement program is live, tools are in production, and meaningful audit capacity has already been recovered and redeployed into higher-value work — without external development spend. This role exists to scale that engine. The role is the hands-on builder, program coordinator, and adoption driver at the center of that effort. This is not a strategy or advisory role — it is a delivery role. The person in this seat ships tools, closes the loop on problem statements, translates recovered audit capacity into documented strategic value, and represents Internal Audit's automation program in the Finance AI Champions and Company-wide AI Champions networks. What You Will Own Automation Delivery - This is the core of the role. Everything else supports it. Build and maintain AI automations across all Internal Audit functions using the department's existing AI Hub and SOX testing engine as the foundation. Manage the problem statement intake pipeline, acknowledging every submission with a clear disposition (built, deferred, or declined

Replit is the agentic software creation platform that enables anyone to build applications using natural language. With millions of users worldwide, Replit is democratizing software development by removing traditional barriers to application creation. About the Role We're redefining how software is built and who gets to build it. Our mission is to achieve Autonomy for All: making programming accessible, collaborative, and powered by AI. Realizing that vision requires a platform that legitimate users can trust and adversarial actors cannot exploit. We're hiring a Data Scientist to help build Replit's Trust & Safety and Anti-Abuse program from the ground up. You'll turn noisy behavioral, identity, payment, infrastructure, and content signals into the measurement systems, detections, and decisions that protect Replit's users, platform, and economics. You'll work closely with Engineering, Support, Legal, Security, Infrastructure, Money, and Growth to make abuse economically unviable while keeping friction low for legitimate users. Replit sits at the frontier of AI-native abuse. Our platform is a target for phishing and scam hosting, cryptomining, LLM token farming, card and coupon fraud, referral abuse, and increasingly, abuse driven by AI agents themselves. You'll help define how we identify, measure, and respond to these threats without compromising the experience of good users. Who You Are You're a data scientist who moves fast, goes deep, and thinks adversarially. You can spin up an analysis in hours that would take others days, not by cutting corners, but because you've built the intuition and technical toolkit to get to the right answer quickly. You dig past the top-line abuse rate to understand selection effects, missing labels, policy changes, attacker adaptation, and the false positives hidden inside an aggregate metric. You understand that Trust & Safety data is imperfect and outcomes are high stakes. Ground truth is delayed, biased, and often incomple

We are looking for an Analytics and Tag Manager Implementation Specialist to join our digital marketing team. The ideal candidate will be passionate about web analytics, an expert in Google Tag Manager and possess strong Javascript skills. This professional will play a crucial role in improving our digital marketing strategies, ensuring the correct implementation of measurement and analytics tools. Responsibilities: 1. Implement and maintain data tracking solutions using Google Tag Manager to ensure accurate and complete data collection. 2. Collaborate closely with the marketing team to understand specific tracking objectives and requirements. 3. Develop and maintain JavaScript scripts to customize and enhance data collection. 4. Set up and manage Google Analytics 4 to analyze campaign performance and user behavior. 5. Perform regular audits to ensure data integrity and troubleshoot tracking issues. 6. Collaborate with other teams to integrate analytics data into marketing reports and dashboards. Requirements: 1. Demonstrated experience implementing and managing Google Tag Manager. 2. Advanced Javascript skills for tracking customization and troubleshooting. 3. Hands-on experience with Google Analytics 4, including event and goal configuration. 4. Deep understanding of digital marketing principles and the importance of analytics in digital strategies. 5. Strong analytical skills and ability to translate data into actionable recommendations. 6. Excellent communication skills and ability to work in a team environment.

1671 About the Role We are seeking a Senior Signal Integrity Engineer to develop, validate, and optimize high-speed signaling solutions across blade- and rack-level architectures for advanced compute platforms. This role sits at the intersection of silicon, package, interconnect, board, and system design , with a strong emphasis on hands-on measurement, simulation correlation, and cross-functional technical communication. Key Responsibilities End-to-end signal integrity analysis for blade- and rack-level system architectures. Analyze and optimize high-speed and low-speed I/O interfaces, including PCIe Gen4/5/6, Ethernet, DDR, SerDes, SPI , I2C, etc . and related interconnects. Perform time-domain and frequency-domain simulations using tools such as Ansys HFSS, Keysight ADS, Cadence Sigrity, CST, SPICE , or similar. Support hands-on lab validation using VNA, TDR, BERT, and high-speed oscilloscopes . Correlate simulation results with lab measurements to identify margin gaps, debug issues, and improve design methodology. Collaborate with silicon, package, board, connector, cable, and system design teams to optimize I/O channel performance. Work with interconnect vendors and ODMs to guide board layout, stack-ups, routing rules, and system design decisions. Review schematics, layouts, simulation results, and validation data for blade, backplane, and rack-level hardware. Prepare and communicate clear validation reports, measurement summaries, debug findings, and technical recommendations to internal teams, vendors, and senior technical stakeholders. Required Qualifications Bachelor’s or Master’s degree in Electrical Engineering, Computer Engineering, or a related field . Strong experience in signal integrity for high-speed digital systems. Hands-on measurement expertise using VNAs, TDRs, BERTs, and high-speed oscilloscopes . Experience measuring and analyzing S-parameters, impedance profiles, eye diagrams, jitter, timing margins, insertion loss, return loss, and cro

About the Team The Integrity team builds the systems OpenAI uses to understand, prevent, and respond to misuse across our products. We partner with Product, Policy, Safety Systems, User Operations, Security, Legal, Privacy, OpenAI for Government, and research teams to turn policy and threat models into product controls, review workflows, measurement systems, and enforcement paths. About the Role We are hiring a Product Manager to own Integrity's product strategy for sensitive deployments: contexts where model capability, customer or deployment setting, privacy constraints, and misuse potential make the operating bar unusually high. This includes government and other high stakes deployments, regulated or high-trust enterprise contexts, zero data retention and privacy-constrained environments, and agentic workflows where harm can unfold across many steps rather than a single prompt. The Sensitive Deployments PM will focus on high-consequence use cases relevant to government deployments and broader deployment-readiness questions for high-risk domains (e.g., healthcare), while building reusable Integrity capabilities for agentic detection and enforcements in these environments. This position is based in San Francisco, CA, with relocation assistance available. In this role, you will: Own the roadmap for sensitive deployment Integrity controls and readiness criteria. Define how we measure residual risk, decision quality, review quality, and mitigation effectiveness. Build agentic investigation and context-assembly workflows for complex, multi-step misuse patterns. Partner with Policy, Legal, Privacy, Safety Systems, User Ops, Government, and product teams to build shared capabilities. Create launch and deployment playbooks for sensitive customer, capability, and product contexts. You might thrive in this role if you: Have shipped complex product systems in AI, integrity, trust and safety, security, privacy, risk, government, regulated enterprise, or AI safety. Can turn am

About the Team Our infrastructure team helps deliver OpenAI’s most capable models and products to the world by scaling infrastructure and turning demand into useful FLOPS. We collaborate across research, engineering, design, and business to turn cutting-edge AI advancements into impactful, real-world applications. Our team ensures the right compute is available—at the right time and place—to support some of the world’s most demanding workloads. We empower all of OpenAI’s products and research by scaling the infrastructure behind them. Our work makes it possible to launch new models and products reliably and at scale. About the Role As a Data Scientist on the Infra team, you will play a key role in shaping how we scale the infrastructure that powers OpenAI’s products and research. This is critical as we operate one of the largest and most advanced compute fleets in the world, supporting millions of users and businesses globally. We focus on aligning infrastructure measurement, planning, scaling, allocation, and efficiency to drive measurable impact across the company. You should expect to guide the definition of foundational datasets for infrastructure resources, develop metrics that inform key decisions, build forecasting and optimization models, and establish source of truth dashboards and analyses that enable teams to understand and improve infra usage. Most importantly, you should expect to be a core partner to engineering, research, and product teams in shaping the infrastructure that powers everything OpenAI builds. This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees. In this role, you will: Build and maintain foundational datasets and metrics that reflect infrastructure usage, efficiency, and scaling. Develop forecasting and optimization models to support infra planning and resource allocation. Partner with engineering, research, and product teams to shape infrast

Team description At Datadog, AI agents are becoming first-class consumers of observability, security, and software delivery data — from third-party coding agents like Claude Code, Cursor, and Copilot, to our own Bits SRE, Bits Assistant, and Bits Dev Agent. The Agentic Interfaces team owns the platform that connects these agents to Datadog: the MCP Server, the tools and retrieval surfaces agents call into, and — critically — the evaluation systems that tell us whether an agent's experience on Datadog data is actually getting better over time. This role is about that last piece. We're hiring a Staff Applied Scientist to define what "good" means for an Agentic interface at Datadog and to build the measurement systems that make it true. "Good" isn't one number — it spans answer quality, tool-selection accuracy, retrieval relevance, latency, token cost, and end-to-end agent success on real customer workflows. You'll design the evals, build the datasets, define the metrics, and partner with the AI engineers on the team to land the platform that lets every product group at Datadog ship integrations that are demonstrably better release over release. The space is full of open research questions. How do you evaluate an agent end-to-end when the trajectory is non-deterministic? How do you score tool selection when the tool catalog has hundreds of entries and grows weekly? How do you build a measurement system that catches regressions across first-party and third-party agents at once, without each team writing their own harness? If those are the problems you want to spend your time on, come build this with us. Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply. What You’ll Do: Own the evaluation strategy for Datadog's AI agent integrations. Define the metrics — offline and online, quali

About the Team OpenAI's Marketing team helps customers understand, adopt, and get value from OpenAI's products and platform. Within Ads Marketing, Partner Marketing is responsible for building the ecosystem that helps advertisers access, activate, measure, and grow on ChatGPT through the partners they already work with. Our team brings that ecosystem to life by meeting advertisers where they already work, while also helping them discover new platforms and capabilities that can strengthen their advertising strategy. We partner with technology, measurement, agency, and other strategic partners to make it easier for advertisers to access ChatGPT Ads, launch and optimize campaigns, measure performance, and grow their investment over time. About the Role ChatGPT Ads is creating a new environment for how people discover products, evaluate options, and make decisions. As advertising in ChatGPT grows, our partner ecosystem will play a critical role in helping advertisers access, measure, and get more value from this new channel. We’re looking for an experienced individual to focus on ads partner marketing to help build and scale the partner marketing function for ChatGPT Ads. In this role, you will develop the strategy, programs, and go-to-market frameworks that activate our ecosystem of technology, measurement, and other strategic partners. You will work closely with partners ranging from global advertising platforms and measurement companies and emerging technology providers. Your goal will be to turn partnerships into meaningful business impact by helping partners bring advertisers onto ChatGPT Ads, accelerate adoption, increase investment, and demonstrate the value of advertising in a conversational environment. This is a highly cross-functional role at the intersection of partnerships, product marketing, sales, communications, and growth. You will help define how we bring partners to market, where we invest, and how we scale successful programs as the ecosystem grows.

About the Team The Statsig team within OpenAI owns the experimentation, rollout, dynamic configuration, and analytics infrastructure that sits on the launch path for OpenAI products. Our systems help teams ship safely, evaluate product and model changes in production, and make high-confidence decisions from real-world usage. Statsig began as an independent company built around experimentation, feature management, and product analytics at scale. After Statsig joined OpenAI, the team began the next chapter: bringing that platform expertise and infrastructure into OpenAI as the experimentation and rollout foundation for every product we ship. This is infrastructure with a very direct product consequence. Teams working on ChatGPT, Codex, model measurement, consumer experiences including ads, business subscriptions, developer products, and shared platform systems depend on Statsig to evaluate configurations, move traffic safely, ingest experiment data, serve analytics, and roll changes forward or back when production reality demands it. We are at a critical point in the platform journey. Adoption is accelerating quickly across OpenAI, and the systems that were already important are becoming load-bearing for how the company launches. The infrastructure needs to stay fast under sharply increasing evaluation volume, reliable when more services depend on it, observable enough to debug quickly, and efficient enough to support OpenAI-wide scale. Recent SDK and server-side infrastructure work has already produced measurable wins in latency, reliability, memory usage, and compute efficiency across important services. The next phase is to make those gains systematic: a platform that can absorb rapidly growing product velocity while preserving low latency, data quality, operational safety, and developer trust. Based out of OpenAI's Bellevue office, we are a close-knit team that values in-person collaboration, technical depth, operational ownership, and building infrastructure that

About the Team OpenAI's Human Data Team creates custom data solutions driving groundbreaking research. Our work enhances and evaluates our flagship models and products like ChatGPT, GPT-5, and Sora, and contributes to safety initiatives through collaboration with our Preparedness and Safety Systems teams. About the Role As a Research Program Manager (RPM) in the Human Data team you will partner with research and engineering to design and implement pragmatic solutions for collecting high-quality data. You will be a key interface between our research roadmap, external vendors, AI trainers, and the Human Data engineering team. This role is based in our San Francisco HQ. In this role, you will: Collaborate with Research: Partner with researchers to scope data collection needs, define success metrics, and establish quality measurement frameworks. Design & Execute Data Collection Campaigns: Translate research needs into actionable plans and accelerate execution by leveraging existing tooling and iterating to reach the desired outcome. In many cases, you will need to implement scrappy new solutions while partnering with engineering to design robust/scalable solutions. Unblock Yourself: You must be deeply uncomfortable with the idea of sitting around waiting for external dependencies, and have the technical acumen and drive to figure out how to achieve at least partial success in the interim. Optimize Systems & Processes: Build and optimize dashboards to track campaign performance, leveraging SQL and Python for data analysis and actionable insights. Drive Technical Roadmaps: Collaborate with engineers to enhance data platforms, resolve blockers, and ensure security best practices such as access management. Scale Your Impact : Advise and empower program managers and vendors to drive day-to-day execution so that you can focus on addressing high priority opportunities. You might thrive in this role if you: Are proficient in SQL and Python for data analysis, including q

About the Team Enterprise Verticals builds role-specific ChatGPT Work experiences for high-value enterprise workflows. We combine product engineering, plugins and skills, connectors, data, evaluations, and customer evidence to turn useful demos into reliable daily work. This opening sits within the Technology vertical inside Enterprise Verticals. The group focuses on repeatable workflows for people at technology companies, beginning with functions such as data and analytics, sales, and design, and carries the shared platform needs—tool integration, permissions, quality measurement, and safe rollout—across those experiences. We work closely with Design, Research, GTM, Security, and platform teams, as well as with customers and design partners. Success means that people can reach a trustworthy first result, understand what the system did, and keep using the workflow—not merely that a prototype exists. About the Role We are looking for a full-stack product engineer who can own ambiguous enterprise workflows end to end: understand a customer problem, shape the product, build across frontend and backend, work through platform dependencies, instrument quality, and learn quickly with design partners. You will build across ChatGPT Work surfaces, services, plugins, connectors, and data or permission boundaries when the experience requires it. You will make quality and rollout observable through evaluations, product and operational signals, and clear fallback or rollback paths. This is a product-engineering role for someone who can move between user problems and system details without losing ownership of either. The strongest candidates will be able to turn specific customer evidence into a generalizable product, explain scope and architecture tradeoffs, and carry a feature from an early prototype through a bounded production rollout. In this role, you will: Build and ship role-specific workflows across ChatGPT Work surfaces, services, plugins, and connectors. Turn customer a