Jobs in United States

Quality Lab Supervisor in United States

7,211 active opportunities · Updated October 2026

Explore current quality lab supervisor jobs across United States. Filter by work mode, employment type, experience, department, date posted and distance.

D
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -88.9%

From $276K/yr

Quick readStrong listing-quality and freshness signals

Team description At Datadog, AI agents are becoming first-class consumers of observability, security, and software delivery data — from third-party coding agents like Claude Code, Cursor, and Copilot, to our own Bits SRE, Bits Assistant, and Bits Dev Agent. The Agentic Interfaces team owns the platform that connects these agents to Datadog: the MCP Server, the tools and retrieval surfaces agents call into, and — critically — the evaluation systems that tell us whether an agent's experience on Datadog data is actually getting better over time. This role is about that last piece. We're hiring a Staff Applied Scientist to define what "good" means for an Agentic interface at Datadog and to build the measurement systems that make it true. "Good" isn't one number — it spans answer quality, tool-selection accuracy, retrieval relevance, latency, token cost, and end-to-end agent success on real customer workflows. You'll design the evals, build the datasets, define the metrics, and partner with the AI engineers on the team to land the platform that lets every product group at Datadog ship integrations that are demonstrably better release over release. The space is full of open research questions. How do you evaluate an agent end-to-end when the trajectory is non-deterministic? How do you score tool selection when the tool catalog has hundreds of entries and grows weekly? How do you build a measurement system that catches regressions across first-party and third-party agents at once, without each team writing their own harness? If those are the problems you want to spend your time on, come build this with us. Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply. What You’ll Do: Own the evaluation strategy for Datadog's AI agent integrations. Define the metrics — offline and online, quali

AIGoRustSpring
D
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -88.9%

From $204K/yr

Quick readStrong listing-quality and freshness signals

We’re looking for a Staff Product Designer to join the APM (Application Performance Monitoring) team. This team is focused on helping engineers agentically troubleshoot and optimize their applications. You'll learn the domain and proactively spot areas for improvement, getting stakeholder buy-in as needed. You'll own your design work end-to-end while helping shape broader product direction. You'll also hold a high bar for quality across the team and help other designers build support for their decisions. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Become a design leader within APM by proactively identifying opportunities and shaping the design strategy across multiple product areas and workflows. Partner closely with PMs and Engineers to ship intuitive experiences, balancing user needs with platform scalability and engineering constraints. Conduct and synthesize qualitative and quantitative research to identify pain points, validate solutions, and guide roadmap decisions. Communicate design rationale clearly and persuasively across design, engineering, product, and executive stakeholders. Mentor and support other designers by providing feedback, sharing frameworks and workflows, and helping raise the overall design quality bar across the organization. Prototype in code to rapidly explore ideas and validate concepts. Contribute to production code using AI-assisted workflows to ensure execution matches design intent. Help the team adopt AI-enabled design workflows. Who You Are: You have 10+ years of experience in digital product design. Your portfolio demonstrates a strong track record of designing and shipping complex technical products. You use AI-assisted workflows to prototype and rapidly iterate. You have a track record of connecting

GitRestAIGo
D
📍 San Francisco, California, United States· Full-time
✓ High-confidence listingCompany trend -88.9%

From $148K/yr

Quick readStrong listing-quality and freshness signals

At Datadog we’re growing our investment in AI and Developer focused events. As we scale this program we’re looking to hire a Program Manager on our Community team to support our content and advocacy team efforts across these events. The Datadog Technical Advocacy team are focused on our local user communities, and bringing our technical content directly to our customers globally. You’ll be responsible for planning and execution to deliver AI and Developer events, working across multiple teams at Datadog to ensure our event is high quality and a positive experience for our customers. At Datadog, we place value in our office culture - the relationships that it builds, the creativity it brings to the table, and the collaboration of being together. We operate as a hybrid workplace to ensure our employees can create a work-life harmony that best fits them. What You’ll Do: Growing Datadog’s presence at AI events and identifying opportunities for meetups, hands-on learning, and sponsored events, with a focus on AI or Developer events Planning technical programming for AI or developer events that Datadog hosts or sponsors Supporting AI and developer focused content at larger global events such as DASH, Datadog’s annual conference Tracking deadlines and deliverables for our content and events, including digital and physical assets, and working with vendors and procurement teams as needed to ensure event success Identifying and resolving risks and blockers for our event programing Maintaining our internal tools and public website for event agenda and speaker content Owning our onsite speaker experience for both internal and customer speakers Managing event programming onsite, coordinating rehearsals, staffing, and ensuring smooth onsite operations Collaborate closely with our Community teams, external stakeholders, and the VP of Community Create and refine processes; maintain focus on continual improvements, automat

GitAIGoRust
D
📍 Massachusetts, New York, United States· Full-time
✓ High-confidence listingCompany trend -88.9%

From $152K/yr

Quick readStrong listing-quality and freshness signals

The Manager of Networking at Datadog leads the global management of network services across all Datadog offices worldwide. This role is responsible for ensuring seamless, high-performance Wi-Fi and direct internet access in our global offices and conference room technology, supporting a rapidly growing global enterprise. As Datadog continues to grow rapidly, this role plays a critical part in scaling both the team and network infrastructure to meet increasing demand. This is a hybrid role that sits in global headquarters in New York city and requires three days in the office each week with occasional travel to our offices around the world. What You’ll Do: Lead the global network engineering teams, managing both full-time employees and third-party vendors to ensure consistent and high-quality service delivery for Datadog offices worldwide. Oversee the design, deployment and scaling of office network infrastructure, including Wi-Fi (Cisco Meraki) and edge networking devices (Cisco, Palo Alto, Juniper, and others), ensuring these services operate according to Datadog's defined service level objectives. Define and implement standards, policies, and processes for network infrastructure to ensure security, reliability and scalability. Collaborate with IT Security, Enterprise Technology, and Workplace teams to align network services with broader IT and business objectives. Develop and track operational metrics for service availability, network performance, driving continuous improvement and optimization. Who You Are: An experienced people manager with at least 5+ years of leadership experience managing teams of network engineers. Proven expertise in Wi-Fi network engineering, including deep knowledge of Cisco Meraki and edge networking solutions from vendors like Cisco, Palo Alto and Juniper. Experience managing large-scale office technology projects in global enterprises with more than 10 offices and 7,000+ employees, ensuring infrastructure keeps pace with ra

D
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -88.9%

From $192K/yr

Quick readStrong listing-quality and freshness signals

Today, everyone from PMs to Sales to SREs uses AI to query their business data - but every answer is a one-off with no governance, no consistency, and no visibility for data teams. We're building the system that fixes this: a context layer that learns from existing data tools driving high quality and consistent answers, an AI-powered query experience, full governance for data teams, and rich analysis surfaces to present and share the results. You'd be building a zero to one product of what we believe will become a major new product line for Datadog. At Datadog, we place value in our office culture - the relationships and collaboration it builds, and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What you'll do Drive the product vision and roadmap spanning the Data agent experience, the semantic/context layer, governance console, chat experience and analysis surfaces (dashboards, notebooks, sheets) Own the end-to-end product lifecycle from discovery to launch, working with a cross-functional team of engineers, designers and other PMs Deeply understand the needs of two key personas: data teams (who govern and curate) and data consumers (PMs, engineers, SREs, executives who ask questions) Design the context and governance layer that makes AI-powered analytics trustworthy - including auto-generation from existing BI tools, eval frameworks, confidence scoring, and self-improvement loops Define how observability data and business data come together to serve unique use cases Engage directly with early customers and internal dogfooding users to iterate on accuracy, usability, and trust Independently research the competitive landscape across legacy BI vendors, warehouse-native analytics, AI-first startups, and AI labs Work on the product pricing Work with GTM teams to define positioning, packaging, and the path to displacing entrenched tools Who you are 5+ years of experience

SQLAIGoRust
M
📍 United States· Full-time
✓ High-confidence listingCompany trend -97.2%

From $126K/yr

Quick readStrong listing-quality and freshness signals

Our Database Experience (DBX) Team A great MongoDB experience starts with great tools. The Database Experience team builds the libraries and tools that developers use day-to-day working with MongoDB. Our mission is to increase developer adoption, satisfaction and retention by providing a reliable, enjoyable interface for developers and other end-users. Our senior engineers are typically specialists in a particular programming language, but are capable of contributing to projects in other languages as well. For this role, we're looking for someone who will enjoy designing, writing, and supporting open source libraries for the Python ecosystem developers that use MongoDB. This is an opportunity to make a major impact at MongoDB as Python is one of the most popular runtimes for MongoDB users, and our driver has over 3 million daily pypi downloads. You might be right for this role if you... Have substantial experience writing high-quality software in Python Have extensive knowledge in Python tools and frameworks, scientific python and web development frameworks Have practical experience with AI/ML frameworks and technologies in Python, including large language models and agentic tools are a plus Have an interest in learning and staying up-to-date with Python ecosystem trends and best practices and incorporating them into your work Can make pragmatic design decisions, balancing tradeoffs such as usability, maintainability and delivery time Want to, or already do, participate in open source software development and communities, both online via e.g. GitHub and optionally through conferences and speaking engagements Communicate well, internally and externally, both verbally and in writing Enjoy collaborating with teammates, and mentoring junior engineers and interns Are self-motivated, organized, and have strong time management skills You'll be on the team responsible for... Developing and supporting the MongoDB Python drivers and subsidiary libraries ( PyMongo , Django Mon

PythonMongoDBAWSAzure
M
📍 United States· Full-time
✓ High-confidence listingCompany trend -97.2%

From $109K/yr

Quick readStrong listing-quality and freshness signals

The Agent Research and Tooling team, part of MongoDB's AI Builder Experience organization, owns the platform layer around agents: how teams author, distribute, evaluate, monitor, and improve agent skills and agent behavior. We are hiring a software engineer to build and maintain the tooling, evaluation systems, and quality gates behind MongoDB's agent skills. This is a software engineering role at the intersection of developer tooling, applied AI, and software quality. You will take loosely defined agent and tooling problems, break them into workable plans, and ship durable internal systems: command-line tools, reusable libraries, evaluation harnesses, and CI workflows. This role is open to remote work in the US or can be based out of any of our US offices. What you'll do Build and maintain agent skills and the infrastructure to validate, evaluate, publish, and maintain them Design evaluation datasets and workflows that compare agent behavior against a baseline and produce actionable quality signals Build agent metrics and observability: skill selection and routing, success and failure outcomes, tool calls, latency, and token usage Design safety and quality gates for agent-authored content: rule packs, static analysis, confidence thresholds, structured verdicts, and bounded suppression Create CLIs, libraries, and MCP integrations that other repositories adopt and that run in local development and CI Integrate tooling into GitHub Actions and other CI workflows, including secrets, annotations, exit codes, and artifacts Build code-generation quality checks, such as anti-pattern catalogs and linting for AI-generated MongoDB code Investigate real failures such as nondeterministic results, false positives, and unsafe generated guidance, and turn them into reusable improvements Collaborate with engineers, security partners, and product teams; communicate trade-offs, risks, and ownership across teams Examples of the problems you'll solve How can tests verify an agent tool's

JavaScriptTypeScriptPythonJava
A
📍 United States· Full-time
✓ High-confidence listingCompany trend -99%
Quick readStrong listing-quality and freshness signals

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join: The Chief Business Officer organization plays a pivotal role in driving the company’s growth and expansion efforts worldwide. Our teammates work on commercializing Airbnb’s new and existing businesses, helping Airbnb expand beyond its core offering as a place to stay. This includes recruiting and developing Airbnb’s global supply of high-quality stays, Experiences, and Services, and executing Airbnb’s global strategy in the market. With a focus on business strategy, quality supply and international expansion, the team is leading the way for Airbnb’s continued growth and success in its next chapter. The Global Markets Team, which sits within CBO, ensures that Airbnb is locally relevant and serves the needs of our global hosts and guests, helping regions more efficiently plan and execute growth strategies across supply, demand, and other surfaces in a way that will resonate with our communities. The Difference You Will Make : You will work closely with the cross-functional leaders and teams, and play a key role in scaling our community growth and optimization-focused programs. The successful candidate will report to the Director, Programs and Business Operations. A Typical Day: Align all functions to achieve Americas’s regional business objectives in partnership with the Director, Regional Business Operations and Growth. Own the conception, execution, and measurement of cross-functional initiatives end-to-end. Concretely, this means defining a crisp problem statement, articulating the ideal solution to that problem, identifying key dependencie

A
📍 United States· Full-time
✓ High-confidence listingCompany trend -99%

From $212K/yr

Quick readStrong listing-quality and freshness signals

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Difference You Will Make: Airbnb is entering a new era—reimagining how fraud, safety, and quality are measured, protected, and elevated across the digital landscape. Reporting to the Director of Advanced Analytics, Fraud & Safety, you will lead a dispersed team of ~8 advanced analysts tasked with turning safety measurement into governed, self-serve decision systems for Policy, Ops, Legal, Product, and Engineering. You will be a pivotal leader safeguarding Airbnb’s global community. You’ll steer a multidisciplinary team that designs, delivers, and scales state-of-the-art analytics for: Safety (physical & digital) Connected-account & circumvention detection Privacy protection & risk management This role isn’t just about reporting what happened; it’s about building the systems that help Airbnb see around corners. You will democratize data access, build always-on scenario simulators for fraud and safety, and turn incident impacts into seamless signals for continuous improvement. Your insights and systems will empower every stakeholder—from legal to operations, policy to product—to make bold, data-driven, and context-aware decisions in real time. A Typical Day: Own end-to-end analytical workflows for platform safety controls: data ingestion, feature engineering, modeling, experimentation, and visualization. A core mandate is to co-own and drive the enterprise-wide “Safety Single Source of Truth” (SSoT) strategy —a unified, structured data asset and taxonomy that underpins decision-making across Product, Operations, Policy, and Legal. Ensure metrics are future-proof, privacy-compliant, and g

PythonSQLGitAI
A
📍 United States· Full-time
✓ High-confidence listingCompany trend -99%

From $168K/yr

Quick readStrong listing-quality and freshness signals

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join: As a key part of the Localization Operations team, you will be responsible for driving the future process, tooling and automation of how Airbnb delivers high-quality, culturally resonant experiences to users around the world at large scale. The Difference You Will Make: Airbnb Localization team is seeking a Technical Program Manager (TPM) to lead high-impact initiatives at the intersection of localization, technology, and global scale. This role calls for a unique blend of deep technical expertise, strategic program leadership, and the ability to deliver innovative, scalable solutions that transform how localization is executed. You’ll partner across engineering, product, and external vendors to ensure our tools, processes, and technologies evolve in step with the fast-changing global tech landscape. A Typical Day: Own and drive complex, cross-functional localization programs from strategy through execution, acting as the single point of accountability for technical localization operations. Serve as a trusted operating partner to Localization Operations and Localization leadership, translating strategic priorities into executable technical roadmaps and surfacing tradeoffs early. Lead the design, innovation, and implementation of scalable solutions leveraging technology including AI and machine translation to improve on the quality, cost and efficiency of localization delivery. Shape the technical direction of Localization at Airbnb through alignment with Localization Leadership on vision and business goals, leveraging SME expertise across the Localization organizati

A
📍 United States· Full-time
✓ High-confidence listingCompany trend -99%

From $248K/yr

Quick readStrong listing-quality and freshness signals

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join: The Media Foundation team builds the core platforms and infrastructure that power photo and video capture, upload, processing, storage, and delivery across Airbnb's products, at a massive global scale. We partner closely with Product, Design, Data Science, Trust, and Infrastructure teams to ensure every image and video guests and Hosts see is fast, high-quality, and reliable, from the moment a Host uploads a photo to the moment a Guest views it in search results. The Difference You Will Make: As the Senior Engineering Manager for Media Foundation, you will lead a team of engineers to build and operate Airbnb's media infrastructure, the foundation powering every photo, video, and document that users interact with on the platform. Capabilities include uploads, AI/ML transformations, distribution, and presentation within the product. You will shape the team’s vision and help steer the organization towards our larger goals. This includes day-to-day operations, technical deep dives, community engagement with internal engineering teams, and strategic planning. As the technical and organizational leader for Media Foundation, you own the reliability, scalability, and evolution of the systems that power every media interaction on the Airbnb platform from the moment a host uploads a photo to the instant a guest streams a listing video. Your experience in both media technology and people management will be essential to the maintenance, modernization, and innovation of Airbnb's media platform. You set the bar for engineering excellence, define what great looks like for your team, and crea

A
📍 United States· Full-time
✓ High-confidence listingCompany trend -99%

From $248K/yr

Quick readStrong listing-quality and freshness signals

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join: The Data Stewardship team is a group of passionate data practitioners with a diverse background in analytics, data modeling, governance, compliance, and scaled data quality. We are responsible for ensuring Airbnb is meeting its compliance obligations across our data ecosystem and ensuring data consumers are able to easily identify the best data for their needs. We support the pipelines, programs, and policy-bodies that make this possible. You’ll be part of the overall Data Infrastructure organization that is responsible for online and offline data infrastructure across the company, and the components that transition data between these environments. The Difference You Will Make Set the North Star: you will define the multi-year vision for Data Governance and Data Quality that scales with our global business and evolving AI landscape. Organizational Influence: Act as a primary consultant for executive leadership on data governance, ensuring that compliance and stewardship are integrated into the data product lifecycle from day one. A Typical Day Architect Ecosystems: Lead the design of overarching data architectures that don't just solve today’s batch needs but anticipate future real-time and AI-driven requirements. Scale Best Practices: Rather than just "ensuring quality," you will define the best practices, tooling, and culture that enable data organizations to maintain high-quality data autonomously. Policy Stewardship: Lead cross-functional task forces (Infosec, Legal, Privacy) to navigate complex regulatory landscapes (like GDPR or AI Act) and translate them int

JavaSQLAIGo
S
📍 United States· Full-time
✓ Quality checkedCompany trend -95.9%

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world's largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone's reach while doing the most important work of your career. About the team The Product Design team is made up of several groups that define, create, and deliver all user-facing aspects of the Stripe brand and product. Product Designers are strategic partners to Engineering and Product Management within their product area. In close collaboration with product teams, they shape user experiences, then translate them into high-quality designs that can be tested, shipped, and refined. Designers are responsible for building elegant, functional products that users love—and want to tell others about. The Dashboard team ensures Stripe works seamlessly for every merchant—regardless of how their business is structured or which products they use. Our goal is to make Stripe feel like it was built just for them. What you'll do In this role, you will help build and enhance the Stripe Dashboard by designing, concepting, and prototyping high-quality core dashboard and product experiences. Responsibilities Develop a deep understanding of the Stripe ecosystem, users, and UI to inform product direction Deliver high-quality, user-centered designs that evolve core surfaces and elevate the overall user experience Collaborate with designers, product managers, engineers, user researchers, and content designers to shape strategy and execution Share work regularly in design reviews and actively contribute to a strong culture of feedback and iteration Who you are We're looking for someone who meets the minimum requirements to be considered for

S
📍 United States· Full-time
✓ Quality checkedCompany trend -95.9%

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career. About the team Brand Studio lays the foundations that help Stripe accelerate. We do this by creating, evolving, and maintaining Stripe's high-quality, versatile, and forward-looking brand design systems, experiences, and advertising campaigns. We sweat the details. We make it seem effortless. Motion is at the core of how we bring the brand to life—from live event stages to digital campaigns, motion design is our most expressive storytelling medium. What you’ll do Motion Designers at Stripe demonstrate a passion for the craft of movement and a deep understanding of how motion communicates brand character. You will be responsible for defining and advancing Stripe's motion language across event experiences, digital surfaces, and mainstage scenic and creative content. You work at the intersection of design systems and cinematic storytelling, creating motion frameworks that scale while still feeling intentional and human. The ideal candidate is technically fluent, conceptually strong, crisply articulates motion decisions, and collaborates seamlessly with creative directors, producers, marketers, and engineering partners. Responsibilities Execute motion design direction across Stripe's internal and external event experiences—from concept through final delivery Contribute to and maintain Stripe's motion design system: principles, timing tokens, animation guidelines, and reusable motion components Create high-quality motion graphics, title sequences, animated bran

S
📍 United States· Full-time
✓ Quality checkedCompany trend -95.9%

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career. About the team Brand Studio lays the foundations that help Stripe accelerate. We do this by creating, evolving, and maintaining Stripe’s high-quality, versatile, and forward-looking brand design systems, experiences, and advertising campaigns. We sweat the details. We make it seem effortless. What you’ll do This is an individual contributor role embedded directly within the Link brand team. You'll be the sole producer for Link, owning the full scope of creative operations end-to-end. You will be responsible for leading creative operations and creative production across our consumer brand Link, in close partnership with the Link Creative Director. This role is a hybrid mix of program management, project management, and creative production depending on the project phase. During certain periods you'll be focused on the 10,000 foot view of the program, and at other times you'll be working side-by-side with the creative team overseeing execution of every design detail during production. Responsibilities Lead all Link brand program management, including roadmap development, budget oversight, and project scoping, timelines, and resourcing Manage a high volume of simultaneous projects, ranging from small to large scale, and across surfaces — creative strategy, web, digital, social, brand systems, integrated campaigns, and email Scale and evolve Link brand design systems in partnership with the Link Creative Director; continuously refine processes to keep pace with

🔔

Get new quality lab supervisor jobs in United States by email

Daily job updates · Unsubscribe anytime