Jobs in United States

Human Evaluator in United States

1,790 active opportunities · Updated October 2026

Explore current human evaluator jobs across United States. Filter by work mode, employment type, experience, department, date posted and distance.

R
📍 San Mateo, CA, United States· Full-time
✓ High-confidence listingCompany trend -100%

From $243.3K/yr

Quick readStrong listing-quality and freshness signals

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. Who We Are: Roblox is reimagining the way people come together to connect, create, and express themselves. To support our massive scale, we are powered by thousands of microservices. The Application Networking team connects and secures these services, building ingress gateways, managing the service mesh, and enabling seamless communication across Roblox’s hybrid on-prem and cloud infrastructure. We are executing on Cloud Bursting, a strategic initiative to enable Roblox’s core services to transparently burst from on-prem data centers to the cloud, allowing us to handle historical peak concurrent players and survive regional failures. You will join our Service Mesh team to build the networking fabric that makes this possible. You Will: Design and build the service mesh infrastructure that enables communication across Roblox’s hybrid Kubernetes and Nomad environments, supporting billions of daily requests. Drive the integration of service mesh with Kubernetes, ensuring reliable sidecar injection, mTLS, traffic policies, and observability for production workloads. Build the networking foundation for Cloud Bursting, enabling Roblox’s top services to transparently burst from on-prem data

AWSKubernetesGitMicroservices
R
📍 San Mateo, CA, United States· Full-time
✓ High-confidence listingCompany trend -100%

From $280.5K/yr

Quick readStrong listing-quality and freshness signals

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. About the Role Inference Platform is Roblox's multi-tier orchestration system for microservices, powering AI Inference across Roblox. Through a simple developer API, we deliver a "deploy and forget" runtime, hiding the complexity of scheduling, scaling, and reliably running services across our on-prem and multi-cloud footprint at global scale. As Principal Product Manager, Jobs Platform, you'll take the helm at a defining moment - leading the charge as we scale the platform to become the default runtime for critical Roblox services worldwide. You Will Own Inference Platform end-to-end - set the multi-year vision for how Roblox engineers deploy, run, and scale AI and other services across our Core and Edge Datacenters, and cloud. Power Roblox's AI future - build the platform that brings frontier models and next-gen AI workloads to life, with the primitives, scheduling guarantees, and resource classes AI teams need to move fast. Evolve the platform's techni

ReactAWSAzureGCP
R
📍 San Mateo, CA, United States· Full-time
✓ High-confidence listingCompany trend -100%

From $260.3K/yr

Quick readStrong listing-quality and freshness signals

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. Why Safety? At Roblox, we strive to connect a billion people with optimism and civility, and the Safety organization’s mission is to become the leader in civil immersive online communities. We systematically and proactively work to detect, remove, and prevent problematic content and behavior. We seek to influence and shape the product roadmap and prioritization, build safety products, and measure our impact on the community of

AWSGitMachine LearningAI
R
📍 San Mateo, CA, United States· Full-time
✓ High-confidence listingCompany trend -100%

From $295.3K/yr

Quick readStrong listing-quality and freshness signals

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. The Engineering Acceleration team delivers a world-class development experience to our 2000+ Roblox teammates who write, build, and ship the most incredible virtual experience platform in the world. As a Principal Software Engineer, you will set the technical direction for transforming development at Roblox from its solid roots to a fully scaled, globally mature, AI-powered development, code review and CI environment. If you are passionate about engineering productivity and you've ever wanted to define — not just build — the systems that fundamentally change how an entire engineering organization operates, this is your opportunity. You Will: Own, scale, and define the long-term technical vision for Roblox's source code search, storage, review, and CI infrastructure for the next 10 years of growth. Architect software that improves the lives of your coworkers — spanning local development tools, internal web apps and microservices, reusable CI workflows, productivity metrics toolchains, and integrations across many 1st and 3rd party tools. Lead and drive major company-wide efforts improving the productivity and user experience of our Source and CI tools, setting direction across teams a

PythonJavaAWSDocker
N
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -88.6%

$145K – $175K/yr

Quick readStrong listing-quality and freshness signals

Who We Are Notion is the collaborative AI workspace where teams and agents think together . We're building one place where your knowledge, projects, meetings, and AI tools live side by side, so work is faster, clearer, and less fragmented. Millions of individuals, small teams, and large companies run their work on Notion. Notinos (our employees) are customer zero in bringing this future of work to life. We care about craft, building things that last, and the belief that great work is still fundamentally human. Our goal isn’t to ship the next feature. Each and every team of Notinos is working to set the standard for how humans work together in the AI era. From building a business’s system of record to making and managing AI agents to automating away the busy work, we care deeply about giving our customers more time for their life’s work. About the Role: Notion is reimagining how customers adopt, expand, and realize value from software in an AI-native world. As an Outcomes Architect, you’ll be the build-beside partner who helps customers turn AI ambition into working systems inside Notion. You’ll own workflow adoption, value delivery, and renewal outcomes for a book of named accounts, with a focus on customers that are flat, at-risk, or need a stronger path to measurable impact. You’ll partner closely with Solutions Consultants on account strategy, expansion qualification, and planning, while directly shaping outcomes that strengthen customer partnerships and contribute to predictable revenue. If you’re someone who loves helping customers build workflows that solve real business problems—and you want to work at the intersection of AI, productivity, customer value, and revenue impact—this is the role. This role can be based in either San Francisco or New York City. We work from our offices on Mondays, Tuesdays and Thursdays (our Anchor Days) because we do our best thinking and building together in person. We’re looking for someone who’s excited to work alongside the te

RestAIGoRust
N
📍 New York, New York, United States· Full-time
✓ Quality checkedCompany trend -88.6%

Who We Are Notion is the collaborative AI workspace where teams and agents think together . We're building one place where your knowledge, projects, meetings, and AI tools live side by side, so work is faster, clearer, and less fragmented. Millions of individuals, small teams, and large companies run their work on Notion. Notinos (our employees) are customer zero in bringing this future of work to life. We care about craft, building things that last, and the belief that great work is still fundamentally human. Our goal isn’t to ship the next feature. Each and every team of Notinos is working to set the standard for how humans work together in the AI era. From building a business’s system of record to making and managing AI agents to automating away the busy work, we care deeply about giving our customers more time for their life’s work. About the Role: Our Executive Operations team work closely with Notion’s leadership, serving as trusted advisors, collaborators, and problem-solvers. We focus on amplifying the impact of our executives by anticipating needs, streamlining operations, and building systems that keep leaders focused on the highest leverage work. We’re deeply connected to Notion’s mission and values, and we take pride in creating an environment of collaboration, clarity, and authenticity. Our team thrives on strong relationships, operational excellence, and a shared commitment to building tools that empower people to think and work together more effectively. This role calls for someone who is proactive, adaptable, and deeply organized. Someone who can balance complex scheduling, drive cross-functional coordination, and bring clarity to fast moving priorities. This person will support 2 leaders in our Engineering and Product orgs. Our ideal candidate thrives in dynamic environments, operates independently, and consistently finds ways to improve workflows and communication. You’ll be a key partner in making sure our leaders and the company as a whole can mo

RestAIGoRust
N
📍 San Francisco, California, United States· Full-time
✓ Quality checkedCompany trend -88.6%

Who We Are Notion is the collaborative AI workspace where teams and agents think together . We're building one place where your knowledge, projects, meetings, and AI tools live side by side, so work is faster, clearer, and less fragmented. Millions of individuals, small teams, and large companies run their work on Notion. Notinos (our employees) are customer zero in bringing this future of work to life. We care about craft, building things that last, and the belief that great work is still fundamentally human. Our goal isn’t to ship the next feature. Each and every team of Notinos is working to set the standard for how humans work together in the AI era. From building a business’s system of record to making and managing AI agents to automating away the busy work, we care deeply about giving our customers more time for their life’s work. This internship will take place from January 25 - April 16 and you will need to be able to work out of our SF office during this time. What You'll Achieve: Conduct data analyses to gain insights about Notion and use these insights to uncover opportunities for improvements in our product and business. Communicate these insights with actionable recommendations to cross-functional teams (insights are useful, impact is even better!). Work with cross-functional partners across the product and business to learn about their functions and use data to advance their respective areas. Create metrics and build dashboards to monitor the growth and health of Notion. Communicate insights and recommendations effectively to leadership and have an impact on strategic decision-making. Qualifications: Pursuing a bachelor's or master's in a quantitative field such as Economics, Statistics, Applied Math, Engineering, Computer Science, or Natural Sciences. Must graduate before December 2027. This internship will take place from January 25 - April 16 and you will need to be able to work out of our SF office during this time. Previous research or internship

PythonSQLRestAI
O
Relocation support. Relocation assistance is stated. This does not establish visa sponsorship.
📍 San Francisco, California, United States· Full-time
✓ Quality checkedCompany trend -84.1%

About the Team OpenAI’s People team is committed to hiring, engaging, and supporting world-class talent to help safely build and deploy universally beneficial Artificial General Intelligence (AGI). The People Operations team is responsible for the systems, data, and operational rigor that underpin every stage of the employee lifecycle. Our work sits at the intersection of employee experience, regulatory compliance, and business velocity — ensuring that as OpenAI scales rapidly and globally, our foundations remain accurate, auditable, and human-centered. This is a high-trust, high-impact function. We partner closely with Finance, Legal, IT, Security, and the broader People team to support growth in a dynamic environment with significant internal and external scrutiny. Operational excellence here is not about process for process’s sake — it is about building durable infrastructure that enables fairness, transparency, and responsible scale. About the Role As Director of People Operations, you will own the core operational infrastructure that enables OpenAI to scale responsibly. This role serves as the operational backbone of the People function, with accountability for data integrity, operational controls, and audit readiness across the systems that support a complex, global workforce, including the operational foundations of recruiting and hiring at scale. You will lead a team responsible for the end-to-end workforce lifecycle, from candidate and hiring operations through onboarding and offboarding, ensuring our people systems, processes, and data are accurate, resilient, and built to scale.In close partnership with Employment Legal and the People Compliance team, you will translate policy and regulatory requirements into scalable, well-controlled operational processes. This role operates with high visibility and close partnership with senior leaders across Finance, Legal, IT, and People, including ownership of SOX-relevant controls and workforce data relied upon by e

AWSRestAIGo
B
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -100%

$160K – $200K/yr

Quick readStrong listing-quality and freshness signals

About Us: Blockworks is an information platform that sits at the center of the crypto industry. We transform raw, complex data and facts into actionable research, trusted alpha-driven insights, and world-class events. The result is transparency and confidence. Blockworks connects investors and businesses in onchain capital markets. We give businesses a platform to earn trust and provide investors with the information they need to underwrite the asset class. Who You Are: Software engineering is your passion, and you have special talents focused on data architecture, design, and API development. You are a player-coach and a natural leader who understands the technical and human elements that go into great software design. You have a results-oriented attitude and a passion for delivering flawless releases and developing digital product pipelines (CI/CD pipelines). You have a proven track record facilitating engineering teams to increase productivity and quality. You're excited at the possibility of helping design and develop our data pipelines as well as leading our data-related projects and strategies for Blockwork's suite of projects. You love moving quickly in a fast-paced start-up, but you also bring intentionality, sustainability and scalability to your approach as an engineer. What You’ll Do: As our Senior Data Engineer , you will be directly responsible for leading the creation and execution of our data models and strategies that feed our products. You'll work collaboratively with other members of the engineering team to design, develop, implement, and evolve our data pipeline and approaches. Every day will look a little different, but in general, you will do things like: Own Data Sourcing Pipelines: You'll be responsible for helping to architect our data warehousing, ingestion and sourcing strategy, working with multiple SDKs to aggregate data from various sources into Blockwork's own data warehouse. Design and Implement ETL Solutions: You'll be responsible for

TypeScriptPythonSQLPostgreSQL
B
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -100%
Quick readStrong listing-quality and freshness signals

About Us: Blockworks is an information platform that sits at the center of the crypto industry. We transform raw, complex data and facts into actionable research, trusted alpha-driven insights, and world-class events. The result is transparency and confidence. Blockworks connects investors and businesses in onchain capital markets. We give businesses a platform to earn trust and provide investors with the information they need to underwrite the asset class. Who You Are: You have a keen focus on backend and API development and Software engineering is your passion. You are a player-coach and a natural leader who understands the technical and human elements that go into great software design. You have a results-oriented attitude and a passion for delivering flawless releases and developing digital product pipelines (CI/CD pipelines). You have a proven track record facilitating engineering teams to increase productivity and quality. You're excited at the possibility of being on the ground floor of the design and development of backend strategies. You bring a passion for designing and maintaining scalable API services that handle large amounts of data elegantly. You love moving quickly in a fast-paced start-up, but you also bring intentionality, sustainability and scalability to your approach as an engineer. What You’ll Do: As a Senior Backend Engineer at Blockworks, you’ll design, build, and maintain the systems that power our products end-to-end. From high-performance APIs to database architecture, you’ll own the backend layer that makes everything else possible. You won’t just be handed requirements, you’ll help define them, scope projects, and make the architectural decisions that shape our technical foundation. Your work will directly impact our research platform ( blockworksresearch.com ) and our media site ( blockworks.co ; 1M+ monthly active users). Every day will look a little different, but in general, you will do things like: Architect, build, and ship backend

TypeScriptNode.jsSQLPostgreSQL
R
📍 San Mateo, CA, United States· Full-time
✓ High-confidence listingCompany trend -100%

From $196.8K/yr

Quick readStrong listing-quality and freshness signals

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. The Game Engine team at Roblox works on the systems that power the experiences at the heart of the metaverse. Our code is the technical foundation in our client, editor, and our simulation servers. The Game Engine team is broadly split into departments — Audio-Video-Communication, Avatar, Core AI, Digital Matter, Productivity, and Systems. This position is for the Systems Runtime pod. The Runtime pod builds and maintains the foundational C++ components that power the entire Roblox engine and Studio stack. We own the runtime layer — the performance, efficiency, and usability of the core primitives that every other engineering team relies on. Think of Runtime as the “standard library” and execution engine for Roblox's C++ world. Our ownership centers on three pillars: Concurrency System — our task scheduler and fiber runtime power how work is parallelized across CPU cores, letting teams scale features across platforms while keeping code understandable and debuggable. Memory System — we own the engine's memory allocator stack, tracking pipelines, and observability tooling to make memory behavior predictable and prevent leaks and fragmentation. Profiling and Observability — we build and evolve

AWSGitRestAI
R
📍 San Mateo, CA, United States· Full-time
✓ High-confidence listingCompany trend -100%

From $287.8K/yr

Quick readStrong listing-quality and freshness signals

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. As a Senior Software Engineer on the Privacy Infrastructure team, you’ll design and build large-scale systems that operate across Roblox’s platform and data ecosystem. You’ll tackle complex distributed systems challenges, develop reliable and scalable infrastructure, and work across engineering teams to deliver foundational capabilities that serve millions of users. This is an opportunity to take on high-impact technical problems at Roblox scale while helping shape the next generation of our infrastructure. You Will Design, build, and scale reliable infrastructure and platform solutions that protect user data and support the needs of a global platform. Develop foundational capabilities for emerging technologies, including agentic AI workflows, with a focus on safe and responsible data access. Partner with engineering teams across Roblox to integrate scalable data protection capabilities into their systems and development workflows Drive technical strategy and architecture for complex, cross-cutting challenges spanning data, infrastructure, privacy, and security. You Have 7+ years of proven experience as a software engineer. Expertise in Python or Golang; Strong understanding of system

PythonAWSGitRest
R
📍 Goodyear, Arizona, United States· Full-time
✓ High-confidence listingCompany trend -100%

From $126.8K/yr

Quick readStrong listing-quality and freshness signals

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. As a Data Center Engineer , you'll help us scale our Core/Edge Data Centers and hardware infrastructure at a time of incredible growth for our business. At Roblox, you'll have boundless opportunities to shape the future of the Imagination Platform™ and demonstrate your passion for delivering thoughtful solutions in front of a global audience. If you know what it takes to build and operate hardware infrastructure that can sustain millions of concurrent players year-round and you take play as seriously as we do, you'll fit right into our highly experienced and ever-expanding engineering team. You will report to the Technical Lead Data Center Engineer. You will: Develop and maintain the Core/Edge Data Center and hardware infrastructure to meet the large scale and real-time requirements of our Imagination Platform™ to ensure our community has an awesome experience anywhere in the world. This includes all aspects of the server, network infrastructure, power, and environmental life cycles. Own efforts to track and mitigate systemic issues preventing hosts from returning to service. Identify and solve critical problems and prevent them from re-occurring via root cause analysis and giving rec

AWSGitAIGo
R
📍 San Mateo, CA, United States· Full-time
✓ High-confidence listingCompany trend -100%

From $195.8K/yr

Quick readStrong listing-quality and freshness signals

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. As a Senior Software Engineer on the Core UI team, you'll take the Roblox App experience to the next level - making it intuitive, reliable, and a joy to use. Our team sits at the intersection of platform engineering and product innovations. You'll work on systems and surfaces used by every Roblox user and creator in every game session. If you care deeply about how software feels - not just how it works - this is the role for you. You Will: Design, build, and own end-to-end development of user-facing features and systems across mobile, desktop, VR, and consoles. Develop robust, extensible systems powering Roblox's core surfaces (Home, Avatar, Search, and more) used by hundreds of millions of users and creators. Create scalable solutions for building high-quality, intuitive, and reliable user interfaces that elevate the overall product experience. Partner with engineering, product, and design teams to deliver cohesive, delightful user experience. You Have: 4+ years of software development experience building large-scale, user-facing applications. Strong expertise in modern frontend technologies, including frameworks like React or similar, component-based architecture, and state management pat

ReactAWSGitAI
R
📍 San Mateo, CA, United States· Full-time
✓ High-confidence listingCompany trend -100%

From $196.8K/yr

Quick readStrong listing-quality and freshness signals

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. What You’ll Do: As a Senior Backend Engineer on the Avatar Marketplace team, you will be building an international marketplace for millions of virtual items that users acquire to customize their avatars and identities on the Roblox platform. You will design, implement, and operate the frameworks and services you and the team build that help control the supply and demand of the Roblox economy. The team is responsible for building systems that will help content creators become more successful sellers. With over 90 million daily active users (and growing), we are looking for an experienced engineer who is passionate about designing and building scalable systems for both sides of the marketplace. The Marketplace Foundation team's focus is to provide reliable and scalable solutions for critical systems supporting both Avatar Marketplace creators and users. We aim to invent new and evolve existing core concepts to support new and future use cases in a holistic manner, such as Bundles, Limiteds, and Price Optimization. We help the creators to improve their earning while scaling Roblox's economy. The team is also responsible for ensuring 10x scalability headroom on critical Marketplace system

PythonJavaMongoDBAWS
🔔

Get new human evaluator jobs in United States by email

Daily job updates · Unsubscribe anytime