Quality Systems Specialist in United States

Who are we? Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems. We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that. We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft. We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us! Why this role? Our team is a fast-growing group of committed researchers and engineers. The mission of the team is to build reliable machine learning systems and optimize audio inference serving efficiency using innovative techniques. As an engineer on this team, you will work on advancing core audio model serving metrics, including latency, throughput, and quality by diving deep into our systems, identifying bottlenecks, and delivering creative solutions for audio processing and streaming workloads. You’ll collaborate closely with both the training and serving infrastructure teams to ensure seamless integration between model development and deployment, with a special focus on real-time and streaming audio inference. Please Note: We have offices in Toronto, Montreal, San Francisco, New York, Paris, Seoul and London. We embrace a remote-friendly environment, and as part of this approach, we strategically distribute teams based on interests, expertise, and time zones to promote collaboration and flexibility. You'll find the Model Efficiency team concentrated in the EST and PST time zones, these are our preferred locations. You may

At ClickUp, we're building the future of work: the first truly converged AI workspace unifying tasks, docs, chat, calendar, and enterprise search, all supercharged by context-driven AI. We are an AI-native company. Every team member is expected to leverage AI daily, and we evaluate AI fluency as part of our hiring process. Join us and help redefine what's possible. 🚀 ClickUp is seeking a talented and experienced Senior Search Engineer to join our team and help revolutionize our search capabilities. As a key member of our engineering team, you'll be responsible for optimizing and enhancing our search functionality, which is a critical feature of our platform and underpins our AI efforts. Your impact at ClickUp As a Senior Engineer on the Search squad, you'll be responsible for designing, optimizing, and scaling our search infrastructure. Our platform is built as backend services on top of Postgres and OpenSearch, focused on real-time search ingestion and serving. You'll work hands-on with these systems to ensure users can instantly find exactly what they need across their workspace. Your expertise will directly contribute to making ClickUp the most intuitive and responsive productivity platform available. Core Responsibilities Design and implement robust search solutions that scale with our rapidly growing user base Improve search relevance, accuracy, and speed to deliver the most relevant results to users at blazing fast speeds Improve our real-time indexing pipelines to ensure search results remain up-to-date Create measurement frameworks to evaluate and improve search quality Build and enhance vector search capabilities to power next-generation search experiences Collaborate with AI, backend, and product teams to integrate search into new features Troubleshoot complex search-related issues at scale Design and implement robust search solutions that scale with our rapidly growing user base Improve search relevance, accuracy, and speed to deliver the most relevant r

At ClickUp, we're building the future of work: the first truly converged AI workspace unifying tasks, docs, chat, calendar, and enterprise search, all supercharged by context-driven AI. We are an AI-native company. Every team member is expected to leverage AI daily, and we evaluate AI fluency as part of our hiring process. Join us and help redefine what's possible. 🚀 ClickUp is seeking a talented and experienced Senior Search Engineer to join our team and help revolutionize our search capabilities. As a key member of our engineering team, you'll be responsible for optimizing and enhancing our search functionality, which is a critical feature of our platform and underpins our AI efforts. Your impact at ClickUp As a Senior Engineer on the Search squad, you'll be responsible for designing, optimizing, and scaling our search infrastructure. Our platform is built as backend services on top of Postgres and OpenSearch, focused on real-time search ingestion and serving. You'll work hands-on with these systems to ensure users can instantly find exactly what they need across their workspace. Your expertise will directly contribute to making ClickUp the most intuitive and responsive productivity platform available. Core Responsibilities Design and implement robust search solutions that scale with our rapidly growing user base Improve search relevance, accuracy, and speed to deliver the most relevant results to users at blazing fast speeds Improve our real-time indexing pipelines to ensure search results remain up-to-date Create measurement frameworks to evaluate and improve search quality Build and enhance vector search capabilities to power next-generation search experiences Collaborate with AI, backend, and product teams to integrate search into new features Troubleshoot complex search-related issues at scale Design and implement robust search solutions that scale with our rapidly growing user base Improve search relevance, accuracy, and speed to deliver the most relevant r

At ClickUp, we're building the future of work: the first truly converged AI workspace unifying tasks, docs, chat, calendar, and enterprise search, all supercharged by context-driven AI. We are an AI-native company. Every team member is expected to leverage AI daily, and we evaluate AI fluency as part of our hiring process. Join us and help redefine what's possible. 🚀 As Director, CX Operations (Support) at ClickUp, you will own strategy, vision, and execution for the Support Operations function , partnering closely with Support and CX leadership while serving as the operational leader for the systems, automation, planning, quality, and insights that power our Support organization. You will set the operating model and performance standards for Support Operations while owning the AI agent harness and automation layer of our CX operating model. You will shape the rhythm of business for our Support organization and unlock data insights, coach organizational performance, transform internal capabilities, and influence strategic decisions across Support, CX, and cross-functional leadership. You will architect, ship, operate, and iterate on AI-driven workflows that enhance and automate customer intake and response, escalation, full support lifecycle management, quality and customer experience, workflow orchestration, and decision support across Support and CX. You'll use AI tools in your own workflow daily while applying strong judgment to validate outputs, manage risk, and improve the repeatable systems the team uses. About the role AI & Automation Architecture Own and operate the AI agent harness and automation layer of our Support operating model Design, ship, manage, and iterate on AI-driven workflows that enhance and automate customer intake and response, escalation, full support lifecycle management, workflow orchestration, quality, and customer experience across Support and CX Build scalable, multi-step agentic systems that Support and CX leaders rely on for pla

About Sentry Software runs the world and the pace is faster than ever. Sentry helps developers fix errors and performance issues before users notice, so teams can spend less time firefighting and more time building. Trusted by 200,000+ organizations, Sentry is today’s application monitoring standard and our team is building its AI-native future. About the role Sentry provides tools that help developers find and fix issues in their applications. The Developer Infrastructure team owns the systems that make every engineer at Sentry more effective at shipping high quality software: developer environments, CI/CD for our open source and closed source codebases, the golden path for building new services, our SDK and library publishing tooling, and the metrics and dashboards that keep it all healthy. Our goal is straightforward: developers should spend their time thinking about the software they build for customers, not the software they use to build it. That means everything from local and cloud development environments, to the CI/CD pipeline that gets code out safely and quickly, to the tooling that catches flaky tests before they cost someone a day. As AI coding agents become part of how engineers work, we're also investing in making sure our environments, CI, and deployment systems support that shift. As a Software Engineer on Dev Infra, you'll help build and scale this infrastructure end to end. In this role, you will Build and maintain the tooling that powers local and cloud-based developer environments Improve CI for our codebases and CD for our deployment pipeline, keeping both fast and reliable as the org and its infrastructure grow Define and evolve the golden path for building new services and libraries at Sentry Contribute to our SDK and library publishing tooling and release processes Build the metrics, dashboards, and flaky test detection that give the org visibility into deployment health and CI reliability Build tooling that gives engineers, and the AI codin

About Pinecone Pinecone is the knowledge infrastructure for AI at scale. Its leading vector database and knowledge engine, Pinecone Nexus, power accurate, performant AI applications for more than 9,000 customers and 800,000 developers worldwide. Pinecone's mission is to make AI knowledgeable. Pinecone is based in New York and raised $138M in funding from Andreessen Horowitz, ICONIQ, Menlo Ventures, and Wing Venture Capital. About the Team and Role: We are hiring a senior/staff software engineer to help design and build core components of our next-generation knowledge retrieval system built for the AI era – search and retrieval infrastructure that powers high-quality, scalable, and enterprise-grade agentic systems. You’ll build the framework that allows our customers to connect knowledge–synthesized from structured and unstructured data–to modern LLM-powered applications, leveraging the world’s best-in-class vector DB supporting semantic search and hybrid retrieval. This role is ideal for someone who loves backend system architecture, distributed systems, and applied AI infrastructure. It is a high impact role with significant ownership across architecture, performance, and system reliability. Responsibilities: Design and build scalable platform components leveraging advanced retrieval via query planning, semantic and hybrid search, metadata-aware search, and LLM generation Design and build optimized indexing pipelines for structured and unstructured data Build backend services for semantic and hybrid retrieval, knowledge graph construction, and retrieval orchestration Improve retrieval quality through evaluation and observability frameworks Design APIs for internal and external user and agentic consumers Optimize latency, throughput and cost across large-scale inference and retrieval workloads Drive technical direction for reliability and security What You’ll Bring to the Table: To thrive in this role, you don't need to check every single box, but you should be deep

About Pinecone Pinecone is the knowledge infrastructure for AI at scale. Its leading vector database and knowledge engine, Pinecone Nexus, power accurate, performant AI applications for more than 9,000 customers and 800,000 developers worldwide. Pinecone's mission is to make AI knowledgeable. Pinecone is based in New York and raised $138M in funding from Andreessen Horowitz, ICONIQ, Menlo Ventures, and Wing Venture Capital. About the Team and Role: We are hiring a senior/staff software engineer to help design and build core components of our next-generation knowledge retrieval system built for the AI era – search and retrieval infrastructure that powers high-quality, scalable, and enterprise-grade agentic systems. You’ll build the framework that allows our customers to connect knowledge–synthesized from structured and unstructured data–to modern LLM-powered applications, leveraging the world’s best-in-class vector DB supporting semantic search and hybrid retrieval. This role is ideal for someone who loves backend system architecture, distributed systems, and applied AI infrastructure. It is a high impact role with significant ownership across architecture, performance, and system reliability. Responsibilities: Design and build scalable platform components leveraging advanced retrieval via query planning, semantic and hybrid search, metadata-aware search, and LLM generation Design and build optimized indexing pipelines for structured and unstructured data Build backend services for semantic and hybrid retrieval, knowledge graph construction, and retrieval orchestration Improve retrieval quality through evaluation and observability frameworks Design APIs for internal and external user and agentic consumers Optimize latency, throughput and cost across large-scale inference and retrieval workloads Drive technical direction for reliability and security What You’ll Bring to the Table: To thrive in this role, you don't need to check every single box, but you should be deep

Replit is the agentic software creation platform that enables anyone to build applications using natural language. With millions of users worldwide, Replit is democratizing software development by removing traditional barriers to application creation. Role Summary Replit is the world's most widely used AI coding platform, and as we scale, we're rebuilding how compensation works internally from the ground up. This role owns that. You'll go beyond traditional comp management to architect the systems, data infrastructure, and AI-enabled workflows that make fast, consistent, and high-quality compensation decisions possible at scale. You will serve as the architect of our compensation engine: translating compensation philosophy into scalable systems, and leveraging data, automation, and AI to improve speed, accuracy, and transparency. This role sits at the intersection of compensation, product, and systems design. You will partner closely with People Business Partners, Recruiting, Finance, People Operations, and the Data team to embed compensation directly into company workflows—eliminating manual processes and reducing reliance on comp as a service layer. You will shape how we attract, reward, and retain top talent, while building infrastructure that scales with the business. What you'll own Compensation Strategy Evolve our compensation philosophy across cash and equity; design and maintain salary bands, leveling frameworks, and equity structures Ensure market competitiveness while partnering with Finance on cost and workforce planning AI-Native Workflows Design and implement AI-enabled workflows for offers, merit, promotions, and market adjustments Build human-in-the-loop validation frameworks to audit AI-generated recommendations for bias, accuracy, and logic Decision Support & Analytics Operate compensation planning cycles and generate first-pass recommendations for comp decisions Build dashboards and analytical frameworks covering market competitiveness, interna

About the role Midjourney is an independent research lab exploring new mediums of thought and expanding the imaginative powers of the human species. We are a small self-funded team focused on design, human infrastructure, and AI. We're looking for a talented visual designer to shape how Midjourney shows up in the world. We are looking for someone with a fresh, opinionated, and high-quality design foundation who can create work that feels distinct, not what’s now but what’s next. You'll partner closely with the leadership on campaigns and visual storytelling across earned and owned channels. This is a freelance engagement with potential for a long-term partnership as the work (and team) grows. What you'll do Design campaign visuals: ads, social, launches — from concept through finished assets Bring editorial design sensibility to our owned channels: email/welcome series, blog, campaign imagery Develop visual systems that are expressive rather than corporate Partner with marketing on what earned and owned should look and feel like Collaborate async with a small, fast-moving team You might be a fit if You're a senior IC — roughly 5–8 years in — with a portfolio of expressive, culturally fluent graphic design: editorial, campaigns, identities across print and digital Typography and composition are your first language You can direct as well as execute: you've shaped campaigns, not just produced assets for them You're plugged into visual culture across art, fashion, publishing, music, and the internet You work well remote and independently Nice to have Editorial/publication experience (print or digital magazines) Motion or illustration You already make things with generative tools Logistics Freelance/contract, part-time to start, with room to grow Fully remote, anywhere. No travel required (though you're always welcome in SF) To apply Send your portfolio. We care about taste, range, and point of view.

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. Senior Director, Generative AI About the Role Roblox Build is our generative creation product, the platform where creators design, build, and publish 3D experiences. We are looking for a Senior Director of Generative AI to lead the Applied AI organization inside Build, responsible for turning state-of-the-art foundation models into high-quality, reliable creation systems at Roblox scale. This leader will own the full applied AI stack: model strategy and routing, model adaptation and fine-tuning, code generation (CodeGen), 3D layout generation (LayoutGen), and the evaluation science and infrastructure that tells us what actually works. You Will Own model strategy and routing for Build. Design and build an intelligent model layer that selects the right model for each creation task based on quality, capability, latency, cost, and safety, leveraging both frontier models and Roblox-adapted open-source models. Lead model adaptation across the Applied AI org, including fine-tuning, distillation, synthetic data generation, human feedback pipelines, and preference optimization for Roblox-specific creation tasks such as Luau code generation and 3D scene understanding. Drive CodeGen capabilities

We are a global team of innovators and pioneers dedicated to shaping the future of observability. At New Relic, we build an intelligent platform that empowers companies to thrive in an AI-first world by giving them unparalleled insight into their complex systems. As we continue to expand our global footprint, we're looking for passionate people to join our mission. If you're ready to help the world's best companies optimize their digital applications, we invite you to explore a career with us! Your opportunity If you seek to bring new, disruptive ideas to the enterprise software market, it’s now time for your next big challenge! We are looking for a Public Sector Account Executive to join our extraordinary Sales team and help us expand across the Federal market. Right now, Public Sector organizations across every size and vertical are focused on improving uptime & performance to ensure high mission success, gaining greater scale & efficiency through projects like cloud adoption/migration, and accelerating time to market through speed and agility by embracing DevOps practices. With the massive market opportunity in front of us, there is not a more exciting time to join our team. What you’ll do You will have a track record of successfully managing and retaining existing Federal accounts through consultative engagements with your solutions team as well as expanding consumption of SaaS and developing a high quality pipeline of business to establish new logo acquisitions. You will navigate complex U.S. Federal organizations and sell to multiple decision-makers. Develop and manage Territory and Account Plans to expand existing accounts and win new logos to meet sales targets. Provide accurate forecasts in Salesforce and during sales meetings utilizing the MEDDPIC framework. Work with your New Relic sales team to identify sales plays, deliver product demonstrations, and participate in industry events to drive pipeline growth Engage senior government exe

Team description At Datadog, AI agents are becoming first-class consumers of observability, security, and software delivery data — from third-party coding agents like Claude Code, Cursor, and Copilot, to our own Bits SRE, Bits Assistant, and Bits Dev Agent. The Agentic Interfaces team owns the platform that connects these agents to Datadog: the MCP Server, the tools and retrieval surfaces agents call into, and — critically — the evaluation systems that tell us whether an agent's experience on Datadog data is actually getting better over time. This role is about that last piece. We're hiring a Staff Applied Scientist to define what "good" means for an Agentic interface at Datadog and to build the measurement systems that make it true. "Good" isn't one number — it spans answer quality, tool-selection accuracy, retrieval relevance, latency, token cost, and end-to-end agent success on real customer workflows. You'll design the evals, build the datasets, define the metrics, and partner with the AI engineers on the team to land the platform that lets every product group at Datadog ship integrations that are demonstrably better release over release. The space is full of open research questions. How do you evaluate an agent end-to-end when the trajectory is non-deterministic? How do you score tool selection when the tool catalog has hundreds of entries and grows weekly? How do you build a measurement system that catches regressions across first-party and third-party agents at once, without each team writing their own harness? If those are the problems you want to spend your time on, come build this with us. Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply. What You’ll Do: Own the evaluation strategy for Datadog's AI agent integrations. Define the metrics — offline and online, quali

Datadog is seeking a Director of Product Management to lead our AI Observability portfolio and shape how organizations build, monitor, and scale AI systems in production. This role leads LLM Observability and helps define the next wave of innovation across GPU Monitoring, Distributed AI Monitoring, and emerging research-oriented tooling such as Model Lab. You will set the vision and strategy for this rapidly growing area, expanding established products while incubating new capabilities that deliver deep visibility into AI infrastructure, model performance, and distributed AI environments. As AI becomes core to modern applications, this team plays a critical role in ensuring customers can deploy and scale AI with confidence. We’re looking for a builder-minded product leader with strong technical depth and hands-on curiosity - someone who has built or worked closely with AI-powered products and understands the realities of production AI. You will lead a team of product managers and partner closely with engineering and design to advance Datadog’s leadership in AI observability. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Own the vision and strategy for AI-driven products, ensuring alignment with overall company goals and customer needs. This will include managing our embed program to enhance the capabilities of existing products as well as developing dedicated and independent AI products. Lead and mentor a team of product managers, helping them grow and advance their careers while ensuring the delivery of high-quality, AI-powered features. Collaborate with cross-functional teams including engineering, data science, marketing, and sales to deliver AI product solutions that meet customer needs and business objectives. Identify new opportunities for

The Agent Research and Tooling team, part of MongoDB's AI Builder Experience organization, owns the platform layer around agents: how teams author, distribute, evaluate, monitor, and improve agent skills and agent behavior. We are hiring a software engineer to build and maintain the tooling, evaluation systems, and quality gates behind MongoDB's agent skills. This is a software engineering role at the intersection of developer tooling, applied AI, and software quality. You will take loosely defined agent and tooling problems, break them into workable plans, and ship durable internal systems: command-line tools, reusable libraries, evaluation harnesses, and CI workflows. This role is open to remote work in the US or can be based out of any of our US offices. What you'll do Build and maintain agent skills and the infrastructure to validate, evaluate, publish, and maintain them Design evaluation datasets and workflows that compare agent behavior against a baseline and produce actionable quality signals Build agent metrics and observability: skill selection and routing, success and failure outcomes, tool calls, latency, and token usage Design safety and quality gates for agent-authored content: rule packs, static analysis, confidence thresholds, structured verdicts, and bounded suppression Create CLIs, libraries, and MCP integrations that other repositories adopt and that run in local development and CI Integrate tooling into GitHub Actions and other CI workflows, including secrets, annotations, exit codes, and artifacts Build code-generation quality checks, such as anti-pattern catalogs and linting for AI-generated MongoDB code Investigate real failures such as nondeterministic results, false positives, and unsafe generated guidance, and turn them into reusable improvements Collaborate with engineers, security partners, and product teams; communicate trade-offs, risks, and ownership across teams Examples of the problems you'll solve How can tests verify an agent tool's

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Difference You Will Make: Airbnb is entering a new era—reimagining how fraud, safety, and quality are measured, protected, and elevated across the digital landscape. Reporting to the Director of Advanced Analytics, Fraud & Safety, you will lead a dispersed team of ~8 advanced analysts tasked with turning safety measurement into governed, self-serve decision systems for Policy, Ops, Legal, Product, and Engineering. You will be a pivotal leader safeguarding Airbnb’s global community. You’ll steer a multidisciplinary team that designs, delivers, and scales state-of-the-art analytics for: Safety (physical & digital) Connected-account & circumvention detection Privacy protection & risk management This role isn’t just about reporting what happened; it’s about building the systems that help Airbnb see around corners. You will democratize data access, build always-on scenario simulators for fraud and safety, and turn incident impacts into seamless signals for continuous improvement. Your insights and systems will empower every stakeholder—from legal to operations, policy to product—to make bold, data-driven, and context-aware decisions in real time. A Typical Day: Own end-to-end analytical workflows for platform safety controls: data ingestion, feature engineering, modeling, experimentation, and visualization. A core mandate is to co-own and drive the enterprise-wide “Safety Single Source of Truth” (SSoT) strategy —a unified, structured data asset and taxonomy that underpins decision-making across Product, Operations, Policy, and Legal. Ensure metrics are future-proof, privacy-compliant, and g