Human Evaluator Jobs

At Asana, we’re building agentic work management software to help every organization in the world become more effective in working together and realizing their goals. Our Customer Experience team is committed to helping customers in their post-sales journey to deploy, adopt, and use Asana as both a technology product and a holistic way of working. We strive to help our customers, across geographies, industries, and functions, get off on the right foot, experience the most value out of the tool over time, and ultimately renew & grow their subscription. We are looking for a senior leader for the Head of Digital & Scaled Customer Success. In this role you will lead a team that designs and leads automated, data-driven programs to retain, engage, and grow large groups of smaller-tier customers without relying on one-on-one human management. You will build tech-touch strategies, manage digital engagement tools, and optimize operations to drive low-cost customer lifetime value. This role can either be fully remote depending on which US state you live in, or based in our San Francisco, Chicago, or New York City office with an office-centric hybrid schedule. If based in-office: The standard in-office days are Monday, Tuesday, and Thursday. Most Asanas have the option to work from home on Wednesdays. Working from home on Fridays depends on the type of work you do and the teams with which you partner. If you're interviewing for this role, your recruiter will share more about the in-office requirements. What you’ll achieve Define and own scale & digital strategy: Own the scale and digital CS strategy, defining the digital customer journey, determining engagement motions for each stage, and establishing how customers transition as their needs evolve. Design digital success programs: Launch self-serve onboarding, lifecycle communications, and in-product nudges that drive activation and habitual software usage with minimal to no human coverage. Build AI-powered e

We're building AI Teammates: agents that work like actual users in Asana and integrated apps. They triage bugs, respond to requests, draft project briefs, conduct research, and handle complex knowledge work across your team's workflows. Unlike chatbots, Teammates are shared team resources that build memory and context across all executions. They get smarter as you and your colleagues work with them. Currently in beta with Fortune 500 customers, AI Teammates represents Asana's shift from tracking work to getting work done. We're looking for an Engineering Manager to lead the Agent Orchestration team — the team building the connections to other systems that allow Asana AI to serve the highest-value workloads. This means building the integration capabilities, agent skills, and vertical use cases that make AI Teammates extraordinarily useful across enterprise tools and workflows. You'll manage a senior team of six engineers (ICs up to L6) working at the intersection of systems integration and emerging AI capabilities to architect the foundation that lets AI agents operate seamlessly across customer environments while meeting enterprise requirements for reliability and compliance. This is a rare opportunity to be at the forefront of Agentic AI. You'll work directly with model partners, lead the core team shaping how enterprises collaborate with AI agents across their entire tool ecosystem, and drive the technical direction for one of the most impactful applied AI challenges in the industry. You'll also flex into org-level engineering leadership across the broader Asana AI group, contributing beyond your direct team. About Asana AI Asana AI is the company's number one priority. We're building the future of human/AI collaboration — going beyond chatbots to integrate AI into everyday workflows for some of the biggest companies on the planet. Asana's AI Teammates deliver a secure, multi-player, enterprise-grade agentic experience. They're transforming Asana from a place wher

We’re looking for a visionary Product Manager to lead the Agents Experience team in San Francisco. In this role, you will define how humans and AI agents work together inside Asana and make collaborating with agents feel natural, trustworthy, and indispensable. You will join our Product Management team, which drives Asana's product strategy and works cross-functionally across Engineering, Design, Experience Research, Data Science, Sales, Support, and Marketing to deliver impactful solutions that help teams see the larger purpose behind their work. This role is based in our San Francisco office with an office-centric hybrid schedule. The standard in-office days are Monday, Tuesday, and Thursday. Most Asanas have the option to work from home on Wednesdays. Working from home on Fridays depends on the type of work you do and the teams with which you partner. If you're interviewing for this role, your recruiter will share more about the in-office requirements. What you’ll achieve Own the product vision and prioritized roadmap for the core agent experience that will define the modern Human + Agent workplace. Drive agent adoption by owning how teams discover, activate, and build lasting habits around AI agents, turning successful first experiences into durable, team-wide usage. Partner with design and user research to refine the core interactions for how users create, direct, review, and give feedback to agents in the flow of work. Lead discovery, pilots, and betas with enterprise customers to understand how organizations adopt agents, translating those insights into product strategy. Shape the experiences that let humans confidently delegate work to agents, including transparency, control, and feedback loops that build trust at every step. Define engagement metrics, instrument tracking, and iterate continuously on the product experience. About you 6+ years of product management experience, ideally focused on AI products, collaboration software, or enterprise workflows. Pr

Figma is growing our team of passionate creatives and builders on a mission to make design accessible to all. Figma’s platform helps teams bring ideas to life—whether you're brainstorming, creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline workflows, move faster, and work together in real time from anywhere in the world. If you're excited to shape the future of design and collaboration, join us! Figma is growing our team of passionate creatives and builders on a mission to make design accessible to all. Figma's platform helps teams bring ideas to life — whether you're brainstorming, creating a prototype, translating designs into code, or iterating with AI. Figma Weave is building the next chapter of AI-native craft and creativity. Our platform bridges AI capability and human creative judgment, giving professional creatives and enterprise teams the ability to build, direct, and scale creative workflows without losing precision or control. We're hiring a Product Marketing Manager to lead Figma Weave's enterprise motion. On a small team where everyone's scope flexes, you'll also work across product marketing more broadly — defining how the product shows up for enterprise buyers, arming sales with what they need to close, and building the systems that turn enterprise accounts into long-term customers. Enterprise is the primary focus, not the only one: you'll move into PLG, growth, and launch work as the team's priorities shift. This is a strategic and hands-on role. You'll think in pipeline and narrative at once — translating product capability into value that lands with enterprise buyers, while staying close enough to execution to write the deck yourself. What you'll do: Build enterprise GTM strategy for feature, model, and product launches Own enterprise positioning and messaging, translating product value into terms that land with enterprise buyers Lead the sales enablement motion Own en

We're transforming the grocery industry At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible earnings opportunities to Instacart Personal Shoppers. Instacart has become a lifeline for millions of people, and we’re building the team to help push our shopping cart forward. If you’re ready to do the best work of your life, come join our table. Instacart is a Flex First team There’s no one-size fits all approach to how we do our best work. Our employees have the flexibility to choose where they do their best work—whether it’s from home, an office, or your favorite coffee shop—while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work. Overview Instacart is the North American leader in online grocery, and we’re building the operating system for the grocery industry so people can access the food they love and more time to enjoy it together. We’re looking for an Engineering Manager to lead our Catalog Enrichment team. This team builds the AI-native platform and pipelines that create, enrich, and maintain product attributes across a catalog of tens of millions of products from more than 100,000 retailer locations. Catalog data is the foundation of our marketplace: when attributes are complete and accurate, search returns the right results, recommendations feel personal, and advertisers can target with confidence. In this role, you’ll lead a team of engineers building systems that blend large language models, classical inference, workflow orchestration, and human review into configurable pipeli

Ready to do the most impactful work of your career? At Coinbase , we are uncompromising on our mission to increase economic freedom. The bar is high, the environment is intense, and we like it that way. This isn't a place for complacency, it’s a place to be pushed past your perceived limits. If you're ready to build the future of finance alongside people who refuse to settle for "good enough," you belong here. Coinbase is a remote-first, but not remote-only company. Expect to get together quarterly for intense in-person working sessions called “surges.” learn more about working at Coinbase . The CX Intelligence team is part of Coinbase’s Enterprise Applications and Architecture org and builds the customer-facing and internal CX experiences that connect the Help Center, chatbots (CBCB), and agent workflows. The team owns the multi-agent platform that powers Coinbase chat, Help Center, and agent tooling, partnering closely with Conversation Design, CX, and engineering teams to deliver secure, compliant, and scalable AI-powered support. Our work helps customers get answers faster while enabling agents to resolve cases more effectively. We are hiring an IC4 Machine Learning Engineer to help evolve our conversational ecosystem by building a seamless hybrid vendor-internal chatbot experience. You will contribute to the design and implementation of a unified orchestration layer that coordinates interactions between vendor AI, internal multi-agent systems, and human participants. This role is ideal for someone who enjoys solving complex ML systems problems, building reliable handoff logic across LLM frameworks, and shipping AI-enabled products that are measurable and scalable. What you'll do: Build and improve the orchestration layer that manages state transitions, context sharing, and intent routing across vendor and internal LLM frameworks in a distributed conversational environment. Develop production-grade Python services that bridge advanced AI and ML capab

Ready to do the most impactful work of your career? At Coinbase , we are uncompromising on our mission to increase economic freedom. The bar is high, the environment is intense, and we like it that way. This isn't a place for complacency, it’s a place to be pushed past your perceived limits. If you're ready to build the future of finance alongside people who refuse to settle for "good enough," you belong here. Coinbase is a remote-first, but not remote-only company. Expect to get together quarterly for intense in-person working sessions called “surges.” learn more about working at Coinbase . We are seeking a senior WFM leader who combines deep expertise in workforce forecasting, capacity planning, and compliance operations with the communication and leadership skills to operate at the executive level. The ideal candidate is a strategic operator who can translate complex workforce dynamics into clear narratives for senior leadership, build trusted cross-functional partnerships across Ops, Finance, Legal, and Compliance, and plan capacity in environments where AI agents are an active part of the workforce equation. This role is central to our shift from a technically-driven WFM function to a strategic, AI-informed capability that earns a seat at every planning conversation, not just the operational ones. What you’ll be doing (ie. job duties): Lead AI-informed capacity planning, incorporating hybrid human-AI staffing models, scenario planning, and automation-driven productivity assumptions into workforce strategy across Compliance lines of business and new product launches. Serve as the senior WFM voice with executive leadership, distilling complex workforce dynamics, forecast risk, and capacity tradeoffs into clear, decision-ready narratives for CX, Finance, and Compliance leadership without hand-holding. Build trusted partnerships across Ops, Finance, Product, Legal, and Compliance, driving alignment on workforce priorities, regulatory planni

Ready to do the most impactful work of your career? At Coinbase , we are uncompromising on our mission to increase economic freedom. The bar is high, the environment is intense, and we like it that way. This isn't a place for complacency, it’s a place to be pushed past your perceived limits. If you're ready to build the future of finance alongside people who refuse to settle for "good enough," you belong here. Coinbase is a remote-first, but not remote-only company. Expect to get together quarterly for intense in-person working sessions called “surges.” learn more about working at Coinbase . We are seeking Capacity Planning Lead to join Coinbase's Consumer (CX) Workforce Management team. This role is central to translating volume trends, staffing assumptions, and business inputs into actionable short- and medium-range capacity plans that help our consumer support operation meet customer demand efficiently and cost-effectively. The ideal candidate brings deep WFM domain expertise, strong analytical fundamentals, and the ability to operate with ownership and precision in a fast-moving, AI-informed planning environment. You'll work at the intersection of forecasting, operations, and cross-functional stakeholder collaboration to ensure CX is always staffed to deliver a high-quality customer experience. What you’ll do: Own forecasts and short-range capacity plans across multiple consumer support queues and markets, translating volume, AHT, and shrinkage trends into staffing requirements and coverage plans Use hybrid human–AI tooling to build and maintain capacity models that reflect the growing complexity of our support channels and workforce structure Create multi-scenario staffing plans that model trade-offs between Customer Experience/Service Levels, Employee Experience, Operational Flexibility, and Cost Effectiveness Partner with vendor management and BPO partners to ensure staffing targets and contractual SLAs are met at the interval level C

Ready to do the most impactful work of your career? At Coinbase , we are uncompromising on our mission to increase economic freedom. The bar is high, the environment is intense, and we like it that way. This isn't a place for complacency, it’s a place to be pushed past your perceived limits. If you're ready to build the future of finance alongside people who refuse to settle for "good enough," you belong here. Coinbase is a remote-first, but not remote-only company. Expect to get together quarterly for intense in-person working sessions called “surges.” learn more about working at Coinbase . The Enterprise Applications & Architecture (EAA) team at Coinbase builds and operates the internal platforms and business systems that power Coinbase at scale. Within EAA, the CX Tooling product team owns the tools, workflows, and AI-powered systems that enable Coinbase's CX specialists to resolve customer issues quickly, accurately, and with empathy. As a Senior Product Manager, you'll own product strategy and execution for CX and AI tooling that sits at the intersection of internal operations and the external customer experience, building an AI-forward platform that leverages automation, intelligent routing, and AI-assisted resolution to raise the bar on speed, quality, and customer satisfaction. Location: Greater Charlotte, NC area (relocation assistance available) What you'll do: Own the product roadmap for a portfolio of CX and AI tooling, delivering end-to-end across discovery, requirements, launch, measurement, and iteration for the systems Coinbase's support specialists rely on to serve millions of retail customers. Drive identification and prioritization of the highest-impact problems in the CX space by partnering with frontline specialists, diagnosing operational pain points, surfacing automation opportunities, and translating them into clear product solutions. Build AI-integrated features that augment human specialists capabilities, including intellige

Ready to do the most impactful work of your career? At Coinbase , we are uncompromising on our mission to increase economic freedom. The bar is high, the environment is intense, and we like it that way. This isn't a place for complacency, it’s a place to be pushed past your perceived limits. If you're ready to build the future of finance alongside people who refuse to settle for "good enough," you belong here. Coinbase is a remote-first, but not remote-only company. Expect to get together quarterly for intense in-person working sessions called “surges.” learn more about working at Coinbase . The IT Tooling team sits within IT Support & Services (ITSS) and builds the automations that power ITSS's own operations. Our in-house bot, Ask IT, deflects the majority of company-wide IT requests before they reach a human. Beyond that, we automate ITSS's core day-to-day workflows — ticket triage, access reviews, onboarding and offboarding — which employees experience as self-service. You'll own technical domains within the IT Tooling platform and partner with regional IT teams across APAC, EMEA, and AMER through platforms including n8n, Jira, Okta, Airflow, and Temporal. What You'll Do Own the technical architecture of IT Tooling automations, driving design decisions on system structure, integration patterns, and tooling across n8n, Airflow, Temporal, and Jira Establish architecture standards and code review practices that raise the team's overall engineering bar Lead as technical DRI on the most complex, highest-impact automation projects, from discovery and design through production delivery Partner with Security, Corporate Engineering, and IAM to resolve technical blockers and represent the team in cross-functional architecture discussions Build shared frameworks and reusable components that reduce single points of failure across the platform Produce architecture documentation and decision records that enable the team to scale with minimal dependency

Ready to do the most impactful work of your career? At Coinbase , we are uncompromising on our mission to increase economic freedom. The bar is high, the environment is intense, and we like it that way. This isn't a place for complacency, it’s a place to be pushed past your perceived limits. If you're ready to build the future of finance alongside people who refuse to settle for "good enough," you belong here. Coinbase is a remote-first, but not remote-only company. Expect to get together quarterly for intense in-person working sessions called “surges.” learn more about working at Coinbase . As a Machine Learning Engineer on the CX Intelligence team within Enterprise Applications and Architecture, you'll build the AI-powered conversational systems that connect Coinbase's Help Center, chatbots, and agent workflows. The team owns the multi-agent platform powering Coinbase Chat and agent tooling, partnering with Conversation Design, CX, and Engineering to deliver secure, scalable automated support. You'll lead the design and implementation of a unified orchestration layer that coordinates interactions between vendor AI, internal multi-agent systems, and human participants, directly improving how millions of customers get help. What you'll do: Architect and deploy the orchestration layer that manages state transitions, context sharing, and intent routing across vendor and internal LLM frameworks in a distributed conversational environment. Build production-grade Python services that bridge advanced ML/AI research with reliable, measurable customer-facing products. Lead end-to-end project execution for complex ML initiatives, managing priorities, technical trade-offs, and cross-functional dependencies from design through delivery. Establish best practices for system design, coding standards, and AI/ML development workflows across the team. Mentor engineers on architectural integrity and modern AI/ML patterns, raising the technical bar for the broader team. Co

Ready to do the most impactful work of your career? At Coinbase , we are uncompromising on our mission to increase economic freedom. The bar is high, the environment is intense, and we like it that way. This isn't a place for complacency, it’s a place to be pushed past your perceived limits. If you're ready to build the future of finance alongside people who refuse to settle for "good enough," you belong here. Coinbase is a remote-first, but not remote-only company. Expect to get together quarterly for intense in-person working sessions called “surges.” learn more about working at Coinbase . Staff Software Engineer, Customer Administration The Customer Administration Engineering (CAE) team is a core pillar of Coinbase's Enterprise Applications and Architecture (EAA) org, responsible for building and operating the secure, foundational platforms that power customer data operations across Coinbase. Our flagship product, Control Center, is Coinbase's secure system of action for internal specialists across CX, Compliance, Legal, Global Investigations, Trust and Risk, and dozens of other teams. It serves approximately 7,000 internal users via its UI and powers a growing ecosystem of internal tools and AI automation via its backend APIs and MCP. We are at an exciting inflection point: evolving Control Center from a human-specialist UI into a modular, AI-agent-ready operations platform. As a Staff Software Engineer, you will be a technical anchor for the CAE team, driving architectural decisions, mentoring engineers, and leading the delivery of high-impact, cross-cutting platform capabilities. What You'll Do Architect and deliver foundational platform capabilities including MCP tool registries, AI orchestration layers, risk-based access automation, and the away-team contribution model that enables product groups across Coinbase to build on the platform safely and at speed Drive the evolution of Control Center into an AI-agent-ready, headless operations pl

Ready to do the most impactful work of your career? At Coinbase , we are uncompromising on our mission to increase economic freedom. The bar is high, the environment is intense, and we like it that way. This isn't a place for complacency, it’s a place to be pushed past your perceived limits. If you're ready to build the future of finance alongside people who refuse to settle for "good enough," you belong here. Coinbase is a remote-first, but not remote-only company. Expect to get together quarterly for intense in-person working sessions called “surges.” learn more about working at Coinbase . The CX Intelligence team is part of Coinbase’s Enterprise Applications and Architecture org and builds the customer-facing and internal CX experiences that connect the Help Center, chatbots (CBCB), and agent workflows. The team owns the multi-agent platform which powers coinbase chat, Help Center and agent tooling surfaces, partnering closely with Conversation Design, CX, and other Engg teams to deliver secure, compliant, and scalable AI-powered support. Our work provides the trusted and accurate automated and agent-assisted experiences—helping customers get answers faster while enabling human agents to resolve cases more effectively. We are hiring an IC5 Machine Learning Engineer to drive the evolution of our conversational ecosystem by building a seamless hybrid vendor-internal chatbot experience. You will lead the design and implementation of a sophisticated unified orchestration layer that coordinates interactions between vendor AI, internal multi-agent systems, and human participants. This role is pivotal in managing complex state transitions, context sharing, and intent routing across a distributed environment. You’ll thrive here if you enjoy high ownership, architecting complex hand-off logic between disparate LLM frameworks, and building reliable AI-enabled products that are fast, measurable, and scalable. What you'll do: Architect and deploy the orchestratio

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Lyft's Customer Care Operations organization manages over 1.7 million monthly customer interactions and serves as the company's primary direct touchpoint with riders, drivers, and businesses — spanning frontline support across multiple customer segments, a global BPO workforce, and the central functions that enable them to operate at scale. The Senior Manager of Support Excellence owns the enablement infrastructure that determines whether Lyft's support operation can scale efficiently, react nimbly, and maintain high standards: Knowledge Management, Quality, Learning & Performance, and Tooling Enablement. This is not a role for someone who wants to maintain and optimize — it's a role for someone who wants to reimagine. The right person brings a bold, integrated vision for how these functions work together with Operations, Product, and Technology to improve customer outcomes and accelerate Lyft's evolution into an AI-native, human-enhanced support organization. They will set the direction, hold the bar, and move at the pace the environment demands — with the industry expertise to know what "great" looks like and the conviction to pursue it. Reporting to the Director of Business Planning & Central Operations, this role leads a team of 4-6 direct reports and 40-50 indirects, each owning a distinct function on the team team. Responsibilities: Vision & Strategy Define and own an ambitious, integrated vision for how Knowledge Management, Quality, Learning & Performance, and Tooling Enablement work together — not as separate functions, but as a unified enablement system that improves customer outcomes and advances Lyft's AI-native support evolution. Expand active AI fluency to every function in the portfolio — from how knowledge is structured for AI retrieval, to how quality signals feed mod

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Lyft's Customer Care Operations organization manages over 1.7 million monthly customer interactions and serves as the company's primary direct touchpoint with riders, drivers, and businesses — spanning frontline support across multiple customer segments, a global BPO workforce, and the central functions that enable them to operate at scale. The Senior Manager of Support Excellence owns the enablement infrastructure that determines whether Lyft's support operation can scale efficiently, react nimbly, and maintain high standards: Knowledge Management, Quality, Learning & Performance, and Tooling Enablement. This is not a role for someone who wants to maintain and optimize — it's a role for someone who wants to reimagine. The right person brings a bold, integrated vision for how these functions work together with Operations, Product, and Technology to improve customer outcomes and accelerate Lyft's evolution into an AI-native, human-enhanced support organization. They will set the direction, hold the bar, and move at the pace the environment demands — with the industry expertise to know what "great" looks like and the conviction to pursue it. Reporting to the Director of Business Planning & Central Operations, this role leads a team of 4-6 direct reports and 40-50 indirects, each owning a distinct function on the team team. Responsibilities: Vision & Strategy Define and own an ambitious, integrated vision for how Knowledge Management, Quality, Learning & Performance, and Tooling Enablement work together — not as separate functions, but as a unified enablement system that improves customer outcomes and advances Lyft's AI-native support evolution. Expand active AI fluency to every function in the portfolio — from how knowledge is structured for AI retrieval, to how quality signals feed mod