Human Evaluator Jobs

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. Team Creator Services Machine Intelligence Team : The Machine Intelligence team is building an NPC system that can (1) play any Roblox game and (2) perform real-time inference efficiently enough to support deployment to all Roblox players. ML Platform Team : The Foundation AI Group is on a mission to establish Roblox as the standard for 3D foundational models (3DFMs), democratizing creation by making it simple for anyone to generate high-quality, immersive 3D experiences using AI. The AI Platform team is a foundational part of this vision, supporting hundreds of ML use cases and billions of inferences daily across Discovery, Safety, Engine, and more. We are seeking exceptional PhD new graduates to drive innovation across three critical areas: AI Platform, Distributed Inference Systems. What You Will Do As a Senior Machine Learning Engineer, you will be a key contributor to building the cutting-edge systems that power AI at Roblox. Creator Services Machine Intelligence Team Develop Scale Data Pipelines: Design, build and maintain robust data pipelines to collect complex 3D game states and real-time player actions across the platform. Train Novel Architectures: Solve the feature e

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. Recommendation Systems are a key growth lever at Roblox, driving retention, engagement, and monetization for hundreds of millions of users. This role offers the unique opportunity to redefine how users search and discover everything from the most interesting immersive experiences and digital avatars in our Marketplace to personalized advertising. You will solve a diverse range of high-scale ranking, retrieval, and personalization problems across our platform. We combine cutting-edge research —including deep learning, generative AI, and reinforcement learning techniques— with large-scale engineering to bridge experimentation and production; you'll design algorithms that operate at massive scale and shape the next generation of recommender systems for user-generated content. Teams Hiring for This Role Search and Discovery: powers major recommendation surfaces—conducting cutting-edge research in generative modeling, multimodal and MLLM technologies, designing advanced agentic AI algorithms to solve business requirements while achieving technical breakthroughs. Safety, Alt Defense: architects a massive-scale detection engine that identifies recidivist bad actors across billions of account

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. With Roblox’s daily active users growing at a record pace, we are seeking a senior data infrastructure engineer to join our new Data Insights team. Our team owns the data tooling that empowers Roblox builders to independently make informed and timely data-driven decisions. As an engineer on the team, you’ll work on the platforms behind tools like Superset, Hex, and Python notebooks, which provide critical insights into the health of our business to users at every level of the company. We tackle diverse challenges in data engineering, infrastructure, and analytics, to deliver the insights our customers need. You will collaborate closely with engineers across our data ecosystem to shape the future of product analytics at Roblox. This role offers the chance to be a founding team member and help define both the technical direction and the long-term shape of the product area from the ground up. This role is a great fit for you if you are proficient in designing and scale robust data infrastructure and applications and have a zeal for developing inspiring, easily maintainable, and reusable code. Join our team and make a significant impact at Roblox. You Will: Architect and deliver a high-pe

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. As an Early Career Software Engineer at Roblox, your story begins with supportive mentorship and immediate, global impact. You’ll work alongside seasoned engineers and curious experts, designing, coding, and deploying real features that reach millions of people globally. By the end of your first year, you’ll have directly influenced the future of our platform and the experience of our global community with millions of daily active users. You Will: Join a community of curious, supportive engineers, actively engaging in architectural discussions and system design. Investigate and experiment with cutting-edge technologies, like machine learning frameworks and large language models (LLMs), to solve complex technical challenges and improve our engineering systems. Design, code, and test innovative features, navigating the full development lifecycle from initial design to production deployment. Partner closely with cross-functional teams, including Design, Product, Data, QA, and DevOps, to deliver cohesive products and features. Support the continuous evolution of our distributed systems, operating at our massive scale of 2 trillion analytics events a day. Engage in our team mat

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. Team Creator Services Machine Intelligence Team : The Machine Intelligence team is building an NPC system that can (1) play any Roblox game and (2) perform real-time inference efficiently enough to support deployment to all Roblox players. ML Platform Team : The Foundation AI Group is on a mission to establish Roblox as the standard for 3D foundational models (3DFMs), democratizing creation by making it simple for anyone to generate high-quality, immersive 3D experiences using AI. The AI Platform team is a foundational part of this vision, supporting hundreds of ML use cases and billions of inferences daily across Discovery, Safety, Engine, and more. We are seeking exceptional PhD new graduates to drive innovation across three critical areas: AI Platform, Distributed Inference Systems. What You Will Do As a Senior Machine Learning Engineer, you will be a key contributor to building the cutting-edge systems that power AI at Roblox. Creator Services Machine Intelligence Team Develop Scale Data Pipelines: Design, build and maintain robust data pipelines to collect complex 3D game states and real-time player actions across the platform. Train Novel Architectures: Solve the feature e

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. As a Senior Software Engineer on the Engine DataModel team, you will own and innovate on the foundational components that form the backbone of the Roblox platform. In the Roblox Engine, the DataModel is a tree-like structure that is analogous to a scenegraph in other 3D engines. This role will report to the engineering manager and will be based out of our HQ in San Mateo, CA in a hybrid model 3 days a week (Tuesdays to Thursdays). Our team owns: The core structures and systems are used to build the DataModel and interact with it. The C++ reflection bindings that form the Engine’s Luau API surface and let creators interact with the DataModel. We’ve built custom codegen tooling to generate the C++ for these reflection bindings and other related structures. DataModel serialization … and much more! You will: Develop engine code that performs well for all user-created games on the Roblox platform. Build the core systems and data structures used in the Roblox engine, working with other teams to find universal solutions. Take ownership of projects throughout their full lifecycles. Execute code that performs well on all the devices Roblox supports—from desktop clients to mobile phone clients to con

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. The Engineering Acceleration Foundations team delivers a world-class development experience to our 2000+ Roblox teammates who write, build, and ship the most incredible virtual experience platform in the world. As a Senior Software Engineer within our Engineering Acceleration team, you will be deep in the middle of transforming development at Roblox from its solid roots to a fully scaled, globally mature, AI-native platform for empowering engineers. If you are passionate about engineering productivity and you’ve ever wanted to have company-wide impact where you can design, code, and make decisions that fundamentally change how things are done - this is your opportunity! You Will: Support, scale, secure and redefine Roblox’s development cycle including source control, code search, artifact creation and distribution, and local and remote development infrastructure for the next 10 years of growth. Help create software that improves the lives of your coworkers with new local development tools, internal web apps and microservices, reusable CI workflows, productivity metrics toolchains, and integrations across many 1st and 3rd party tools. Collaborate on efforts improving the productivity and use

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. The Engineering Acceleration Foundations team delivers a world-class development experience to our 2000+ Roblox teammates who write, build, and ship the most incredible virtual experience platform in the world. As a Senior Software Engineer within our Engineering Acceleration team, you will be deep in the middle of transforming development at Roblox from its solid roots to a fully scaled, globally mature, AI-native platform for empowering engineers. If you are passionate about engineering productivity and you’ve ever wanted to have company-wide impact where you can design, code, and make decisions that fundamentally change how things are done - this is your opportunity! You Will: Support, scale, secure and redefine Roblox’s development cycle including source control, code search, artifact creation and distribution, and local and remote development infrastructure for the next 10 years of growth. Help create software that improves the lives of your coworkers with new local development tools, internal web apps and microservices, reusable CI workflows, productivity metrics toolchains, and integrations across many 1st and 3rd party tools. Collaborate on efforts improving the productivity and use

Talent Acquisition is dedicated to ensuring that teams at Asana have the people they need to achieve their goals. As a product-driven organization, we hire the people who build Asana, the people who support our users, and the people who tell our story in the market. All human progress comes down to teamwork—and we work with the entire company to enable teamwork by building our own team. We work as a team to get to know the whole person, to communicate our values, and to ensure that candidates are well-informed and delighted throughout the process. Recruiting is a company-wide effort and responsibility and we encourage all Asanas to adopt the motto “Always Be Recruiting.” As the Head of Technical Recruiting, you will lead a team of seasoned talent acquisition professionals to support R&D hiring at Asana. You will be responsible for driving operational excellence within the Talent Acquisition team to enable the timely delivery of business objectives through high quality hiring. This role will also closely partner with R&D Leadership, People Team leadership, Finance, and the rest of talent acquisition leadership in defining and developing world-class assessment, reporting, and talent engagement strategies. This role is based in our San Francisco office with an office-centric hybrid schedule. The standard in-office days are Monday, Tuesday, and Thursday. Most Asanas have the option to work from home on Wednesdays. Working from home on Fridays depends on the type of work you do and the teams with which you partner. If you're interviewing for this role, your recruiter will share more about the in-office requirements. What you’ll achieve Build a global hiring strategy to help us scale our R&D teams. Partner closely with executive leadership and People Team leaders to understand business priorities & objectives; help build a high-impact, max-velocity global hiring strategy that addresses key gaps between the talent in place today and the talent require

We're looking for a Product Designer who is excited by our mission of designing the future of teamwork. With millions of teams using Asana across the globe, our work has only just begun. Join us on a journey of driving clarity for teams, individuals and executives. As designers we are streamlining how teams get work done in a more efficient, effective and delightful way. You’ll make it as simple as possible for teams big and small to realize the value of Asana. The Coordinate team owns the workflows that sit at the heart of how organizations run: capturing work wherever it happens, and seeing it through to completion. We're building the experiences that users depend on today, while evolving them for a world where humans and agents execute together. When we get this right, Asana becomes the OS for human-agent teams: the place where critical work doesn't just get tracked, but actually gets done. About the Design team We design the future of teamwork. Asana has a bold, ambitious mission: help humanity thrive by enabling the world’s teams to work together effortlessly. Our design team is at the heart of that mission. Asana Design is an inclusive and collaborative community. We’re a diverse group of designers from different backgrounds (product, brand and content design, design operations, producers, motion design, film, copywriting). We are a team that loves combining research, data insights, and peer feedback into a human-centered design process to produce designs that are core to the power of our applications. We partner with people across Asana to create our product, shape our brand, and drive greater impact through design. We use design to solve challenges and create experiences that customers love. We also take the time to get weird and have fun along the way. We believe every designer should have the opportunity to grow and learn by utilizing their strengths and nurturing their interests. This role is based in our Warsaw office with an office-centric hybrid

Talent Acquisition is dedicated to ensuring that teams at Asana have the people they need to achieve their goals. As a product-driven organization, we hire the people who build Asana, the people who support our users, and the people who tell our story in the market. All human progress comes down to teamwork—and we work with the entire company to enable teamwork by building our own team. We work as a team to get to know the whole person, to communicate our values, and to ensure that candidates are well-informed and delighted throughout the process. Recruiting is a company-wide effort and responsibility and we encourage all Asanas to adopt the motto “Always Be Recruiting.” As the Head of Talent Acquisition Operations & Strategy, you will lead a team of program managers and talent acquisition professionals to maximize efficiency, enablement, and excellent planning for recruiting at Asana. In partnership with cross-functional leaders globally, you will oversee headcount management, recruiting enablement, objective assessment, talent marketing, candidate experience, and recruiting insights. You will be responsible for driving operational excellence within the Talent Acquisition team to enable the timely delivery of business objectives through high quality hiring. This role is based in our Vancouver office with an office-centric hybrid schedule. The standard in-office days are Monday, Tuesday, and Thursday. Most Asanas have the option to work from home on Wednesdays. Working from home on Fridays depends on the type of work you do and the teams with which you partner. If you're interviewing for this role, your recruiter will share more about the in-office requirements. What you’ll achieve Partner closely with executive leadership and People Team leaders to understand business priorities & objectives; help build a high impact, max velocity hiring strategy that addresses key gaps between the talent in place today and the talent required to drive business

As the Vice President of Asana Services Management & Incubation GTM, you’ll own Product Management, GTM strategy, and the incubation Sales Engineering / Forward Deployed team for Asana Service Management, Asana’s most promising 0→1 product. Asana Service Management unifies ticketing and project execution for IT, HR, facilities, and other service teams to resolve key issues without human touch. This is a rare role with a direct reporting line across both Product Management and Sales Engineering / Forward-Deployed Engineering, combined with full P&L responsibility. In this high-leverage VP-level role, you will act as an entrepreneurial leader. You will sit at the intersection of sales, technical execution, and product development—owning the GTM strategy, engaging directly with mid-market customers to close business, and translating front-line market insights into a concrete product roadmap and product execution. This is a "player-coach" role designed for someone who thrives in ambiguity and knows how to scale a technical GTM motion within a fast-growing SaaS environment. This role is based in our San Francisco office with an office-centric hybrid schedule. The standard in-office days are Monday, Tuesday, and Thursday. Most Asanas have the option to work from home on Wednesdays. Working from home on Fridays depends on the type of work you do and the teams with which you partner. If you're interviewing for this role, your recruiter will share more about the in-office requirements. What you’ll achieve Drive Incubation GTM Strategy: Architect and execute the global commercial and go-to-market strategy for Asana for Service Management, taking it from early-stage concepts to repeatable, revenue-generating engines. Engage with Customers & Assist in Closing Deals: Serve as a key executive sponsor and technical seller on strategic deals, regularly interfacing with enterprise customers to understand their complex workflows and build trust. Own Product Roadmap

Talent Acquisition is dedicated to ensuring that teams at Asana have the people they need to achieve their goals. As a product-driven organization, we hire the people who build Asana, the people who support our users, and the people who tell our story in the market. All human progress comes down to teamwork—and we work with the entire company to enable teamwork by building our own team. We work as a team to get to know the whole person, to communicate our values, and to ensure that candidates are well-informed and delighted throughout the process. Recruiting is a company-wide effort and responsibility and we encourage all Asanas to adopt the motto “Always Be Recruiting.” As the Head of Talent Acquisition Operations & Strategy, you will lead a team of program managers and talent acquisition professionals to maximize efficiency, enablement, and excellent planning for recruiting at Asana. In partnership with cross-functional leaders globally, you will oversee headcount management, recruiting enablement, objective assessment, talent marketing, candidate experience, and recruiting insights. You will be responsible for driving operational excellence within the Talent Acquisition team to enable the timely delivery of business objectives through high quality hiring. This role is based in our Chicago office with an office-centric hybrid schedule. The standard in-office days are Monday, Tuesday, and Thursday. Most Asanas have the option to work from home on Wednesdays. Working from home on Fridays depends on the type of work you do and the teams with which you partner. If you're interviewing for this role, your recruiter will share more about the in-office requirements. What you’ll achieve Partner closely with executive leadership and People Team leaders to understand business priorities & objectives; help build a high impact, max velocity hiring strategy that addresses key gaps between the talent in place today and the talent required to drive business su

Datadog is looking for a Senior Product Manager to help lead the evolution of our fleet and lifecycle management capability, the product surface that gives customers visibility into, and control over, the observability software running across their infrastructure. This capability manages the deployment lifecycle for core observability agents and OpenTelemetry collectors running on customer hosts and containers. The Senior PM will expand the scope of fleet capability to additional Datadog software components, making it the single place customers go to see everything running in their environment, at any version, in any deployment model, and to manage it remotely and safely at scale, for both human operators and, increasingly, AI agents acting on their behalf. This is a high-visibility, cross-functional role. You'll partner with multiple engineering teams and be responsible for defining and delivering a coherent, unified fleet experience across UI, API, and MCP for customers. At Datadog, we place value in our office culture - the relationships and collaboration it builds, and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You'll Do Own and evolve the product vision and roadmap for a unified fleet and lifecycle management capability spanning multiple product lines and deployment models. Define what "managed" means for each new software component as it's brought into fleet, balancing consistency of experience with the realities of each component's operational model. Drive a phased expansion plan, sequencing new components into fleet based on customer value, technical complexity, and dependency readiness. Partner closely with engineering leads across several teams to align on shared architecture principles to support disparate software components. Represent the voice of the customer for a capability that must work equally well for human operators using a UI and for AI

As a Senior Platform Product Manager focused on AI SDLC Trusted Throughput, you will define and drive the product strategy for enabling safe, reliable software delivery at AI-native scale across Datadog’s Internal Developer Platform. As AI accelerates development velocity and system complexity, you will help evolve SDLC systems from human-supervised workflows to platforms with built-in safety, observability, and correctness guarantees. You will partner closely with engineering, security, and developer platform teams to improve deployment reliability, operational visibility, and governance while enabling both engineers and AI agents to move quickly with confidence. This role offers the opportunity to shape foundational developer infrastructure and influence how AI-powered software delivery operates across Datadog. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Own the product strategy, roadmap, and execution for AI-native SDLC throughput and reliability initiatives across Datadog’s Internal Developer Platform Define and drive platform outcomes aligned to DORA metrics, balancing deployment velocity with reliability, change failure reduction, and operational safety Partner with engineering, infrastructure, security, and developer experience teams to build automated validation, auditability, and risk-scoring capabilities into deployment workflows Deliver actionable SDLC observability and diagnostic capabilities that connect executive-level metrics to operational signals across the software delivery lifecycle Drive systems that monitor and validate AI-generated or AI-attributed changes to ensure correctness, compliance, and trustworthy automation Serve as a cross-functional product leader across SDLC Foundations, Security Engineering, and compl