Jobs in United States

Human Evaluator in New York

98 active opportunities · Updated October 2026

Explore current human evaluator jobs in New York. Filter by work mode, employment type, experience, department, date posted and distance.

TW
📍 New York, NY, United States
✓ High-confidence listing

$130K – $150K/yr

Quick readStrong listing-quality and freshness signals

About The Weather Company: The Weather Company is the world’s leading weather provider, helping people and businesses make more informed decisions and take action in the face of weather. Together with advanced technology and AI, The Weather Company’s high-volume weather data, insights, advertising, and media solutions across the open web help people, businesses, and brands around the world prepare for and harness the power of weather in a scalable, privacy-forward way. The world’s most accurate forecaster globally, the company reaches hundreds of enterprise clients and more than 360 million monthly active users via its digital properties from The Weather Channel (weather.com) and Weather Underground (wunderground.com). AI is part of how we work: Human judgment, expertise, and creativity remain essential and are amplified by AI. We expect everyone in this role to use AI thoughtfully and proactively to accelerate their performance, improve the quality of their work, and explore new possibilities. We are looking for people who are curious, adaptable, and excited to help shape an AI-enabled culture that delivers better outcomes for our customers and our company. Job brief: The Weather Company reaches hundreds of millions of people through the world's most-used weather apps. We're hiring our first dedicated Growth PM to own how new and existing users discover value — starting with onboarding and activation, then expanding into the habit and retention loops that turn casual weather-checkers into daily users. The impact you'll make: Drive Core Business Metrics: Measurably improve Day 0 (D0) registration and subscription conversion rates across our primary growth funnels. Expand Engagement Touchpoints: Increase notification opt-in rates and drive surface-level engagement through higher widget adoption. Accelerate Experiment Velocity: Scale our experimentation framework to ship more tests per quarter and shorten decision-making cycles. Unify the Cross-Platform Experien

P
Relocation support. Relocation assistance is stated. This does not establish visa sponsorship.
📍 New York, Remote, United States· Remote
✓ High-confidence listingCompany trend +237.5%

$108.6K – $250.7K/yr

Quick readStrong listing-quality and freshness signals

Job Description Pfizer US/PR Commercial Sales Founded in 1849, Pfizer Inc. began as a small chemistry enterprise built on the belief that scientific ingenuity can improve—and protect—human life. Today, as one of the world’s leading biopharmaceutical companies, Pfizer’s purpose is Breakthroughs that change patients’ lives : discovering, developing, and delivering medicines and vaccines that address unmet need, earn trust through quality and integrity, and reach patients through strong partnerships across the healthcare system. In a complex and rapidly evolving pharmaceutical landscape, our work is measured by one outcome - helping patients live longer, healthier lives . Rare Disease Sales Organization Mission & Impact Pfizer’s Rare Disease – Rare Cardiac Sales organization exists to help improve the lives of people living with serious rare cardiac conditions by connecting scientific innovation to the clinicians and systems that deliver care. We lead with integrity and patient need— advancing disease and product education grounded in robust clinical evidence , promoting Pfizer Rare Cardia

AIRecruitment
Z
📍 New York, United States· Full-time· Remote
✓ High-confidence listing

From $177.5K/yr

Quick readStrong listing-quality and freshness signals

Zscaler (NASDAQ: ZS) accelerates digital transformation so customers can be more agile, efficient, resilient, and secure. The Zscaler Zero Trust Exchange™️ platform protects thousands of customers from cyberattacks and data loss by securely connecting users, devices, and applications in any location. Distributed across 160+ public exchanges globally and thousands of private exchanges at the edge, the SASE-based Zero Trust Exchange is the world’s largest in-line cloud security platform. We believe the future of work is Human + AI and are building an AI-native enterprise where human potential is amplified by machine intelligence to solve the world’s hardest security challenges. Driven by deep customer obsession, we are committed to the mission, outcome, and to each other. We bring these commitments to life through three core behaviors: ownership and collaboration, trust through outcomes and impact, and a challenge culture with ongoing feedback. Ready to make an impact at the company pioneering security transformation in the AI era? Join us at Zscaler. Role We are looking for an experienced Senior Partner Business Manager to join our Partner & Alliances team. This is a remote role preferably located in the Dallas, Texas or New York, NY and is reporting to the Director, Partner & Alliances. You’ll drive a secure, cloud-enabled digital future by building and executing structured business plans for partner alliances to further cement Zscaler’s position as the world leader in cloud security. You will act as a strategic catalyst, leveraging executive relationships and internal collaboration to deliver on regional revenue goals. What you’ll do (Role Expectations) Build, own, and execute a structured business plan for partner alliances across your select Emerging Global GSI partner list, jointly defining a strategic focus for each account Accelerate pipeline with a set of alliances to ensure we deliver on the Zscaler rev

AWSGitAgileAI
Z
📍 New York, United States· Full-time· Remote
✓ High-confidence listing

From $192K/yr

Quick readStrong listing-quality and freshness signals

Zscaler (NASDAQ: ZS) accelerates digital transformation so customers can be more agile, efficient, resilient, and secure. The Zscaler Zero Trust Exchange™️ platform protects thousands of customers from cyberattacks and data loss by securely connecting users, devices, and applications in any location. Distributed across 160+ public exchanges globally and thousands of private exchanges at the edge, the SASE-based Zero Trust Exchange is the world’s largest in-line cloud security platform. We believe the future of work is Human + AI and are building an AI-native enterprise where human potential is amplified by machine intelligence to solve the world’s hardest security challenges. Driven by deep customer obsession, we are committed to the mission, outcome, and to each other. We bring these commitments to life through three core behaviors: ownership and collaboration, trust through outcomes and impact, and a challenge culture with ongoing feedback. Ready to make an impact at the company pioneering security transformation in the AI era? Join us at Zscaler. Role We are looking for a Global Alliance Director - Accenture to join our Global GSI Advisory Team. This is a role based in the Americas, reporting to the Senior Director, Alliance Partners. You will lead the end-to-end Global Partnership with Accenture, building key relationships and developing joint offerings that drive transformational, incremental net new opportunities for Zscaler. You will serve as the primary architect for our global Accenture business plan, ensuring mutual revenue growth and strategic alignment across our Security, Network, and Cloud practices. What you’ll do (Role Expectations) Create and execute a global Business Plan to expand the Accenture partnership and brand footprint globally Lead the end-to-end Global Partnership by developing joint offerings that can be leveraged by the field sales organization to drive net new opportunities Drive Zscaler revenue growth while ensuring Accenture meets th

AWSGitAgileAI
Z
📍 New York, United States· Full-time· Remote
✓ High-confidence listing

From $120.8K/yr

Quick readStrong listing-quality and freshness signals

Zscaler (NASDAQ: ZS) accelerates digital transformation so customers can be more agile, efficient, resilient, and secure. The Zscaler Zero Trust Exchange™️ platform protects thousands of customers from cyberattacks and data loss by securely connecting users, devices, and applications in any location. Distributed across 160+ public exchanges globally and thousands of private exchanges at the edge, the SASE-based Zero Trust Exchange is the world’s largest in-line cloud security platform. We believe the future of work is Human + AI and are building an AI-native enterprise where human potential is amplified by machine intelligence to solve the world’s hardest security challenges. Driven by deep customer obsession, we are committed to the mission, outcome, and to each other. We bring these commitments to life through three core behaviors: ownership and collaboration, trust through outcomes and impact, and a challenge culture with ongoing feedback. Ready to make an impact at the company pioneering security transformation in the AI era? Join us at Zscaler. About the Role We are looking for an Account Executive to join our Sales and Go-to-Market team. This role is based in New York, reporting to the Regional Director. You will be part of a global group of professionals passionate about delighting our customers, nurturing trusted partnerships, and sharing expertise to drive a secure, cloud-enabled digital future. By demonstrating the power and agility of cloud transformation, you will help cement our position as the world leader in cloud security. What you’ll do (Role Expectations) Build relationships with important internal and customer stakeholders, including c-suite decision-makers Create a long-term account strategy aligned with customer goals Collaborate with internal teams to meet customer needs and contribute to comprehensive account planning Act as a trusted advisor by understanding client businesses and aligning technical solutions with their strategic goals W

AWSGitAgileAI
N
📍 New York, New York, United States· Full-time· Remote
✓ High-confidence listingCompany trend -88.6%

$118K – $147K/yr

Quick readStrong listing-quality and freshness signals

Who We Are Notion is the collaborative AI workspace where teams and agents think together . We're building one place where your knowledge, projects, meetings, and AI tools live side by side, so work is faster, clearer, and less fragmented. Millions of individuals, small teams, and large companies run their work on Notion. Notinos (our employees) are customer zero in bringing this future of work to life. We care about craft, building things that last, and the belief that great work is still fundamentally human. Our goal isn’t to ship the next feature. Each and every team of Notinos is working to set the standard for how humans work together in the AI era. From building a business’s system of record to making and managing AI agents to automating away the busy work, we care deeply about giving our customers more time for their life’s work. About the Role: As Notion’s product surface expands, we need a builder-teacher who can turn new capabilities into technically accurate education that helps customers confidently build with Notion. In this role, you’ll explore Notion’s newest capabilities, teach by showing, and ship as the product evolves. You’ll be the technical face of Notion Academy: leading workshops, recording walkthroughs, and building implementation guides. This role is based in New York City. We work from our offices on Mondays, Tuesdays and Thursdays (our Anchor Days) because we do our best thinking and building together in person. We’re looking for someone who’s excited to work alongside the team during those days. What You'll Achieve: By day 90: Expand Notion’s technical education library. Author technically rigorous Academy content, implementation guides, and Help Center resources that make our most complex capabilities easier to understand and adopt. By day 90: Become a trusted voice for Notion Academy. Teach customers through video, live webinars, and workshops, demonstrating real workflows and solving problems in real time. By day 90: Build with Notion’

RestAIGoRust
O
📍 New York, New York, United States· Full-time· Remote
✓ High-confidence listingCompany trend -83.9%
Quick readStrong listing-quality and freshness signals

About the Team OpenAI didn’t begin as a traditional company. It began as an idea: that artificial intelligence could be developed in a way that benefits everyone. As a creative team, our role is to help make sure the work behind that idea is understood as it leaves the lab and meets the world. This company works at the frontier of intelligence. Like any frontier, it’s unfinished, constantly shifting, and still being explored. Our job is to stay close to that uncertainty and help shape how this story gets told in a way that feels grounded and human. We do this through campaigns, launches, films, brand systems, and work that doesn’t fit neatly into any of those categories yet. This team is for people who want to help shape something from the beginning. About the Role We’re looking for an experienced Creative Director, Copy to join our growing in-house creative team focused on OpenAI’s business audiences. In this role, you’ll help define how we communicate the value of OpenAI to organizations - from growing businesses and startups to global enterprises and developers building with our technology. You’ll concept and write across integrated campaigns, product launches, customer stories, events, and other brand moments. You’ll translate complex products, technical capabilities, and business outcomes into clear, compelling ideas that resonate with decision-makers, builders, and teams adopting AI. This is a deeply hands-on role for someone who is equally comfortable developing a big campaign platform, shaping a messaging framework, writing a film script, or refining a headline. You’ll work closely with design, production, product marketing, and communications from the earliest stages of an idea through execution. To us, creativity is a team sport. Ideas get better when you talk them through and build on each other’s thinking. We value curiosity over certainty, kindness over ego, and the ability to balance creative ambition with clarity and decisiveness. This role is based i

AWSGitRestAI
N
📍 New York, New York, United States· Full-time· Remote
✓ High-confidence listingCompany trend -88.6%

$200K – $250K/yr

Quick readStrong listing-quality and freshness signals

Who We Are Notion is the collaborative AI workspace where teams and agents think together . We're building one place where your knowledge, projects, meetings, and AI tools live side by side, so work is faster, clearer, and less fragmented. Millions of individuals, small teams, and large companies run their work on Notion. Notinos (our employees) are customer zero in bringing this future of work to life. We care about craft, building things that last, and the belief that great work is still fundamentally human. Our goal isn’t to ship the next feature. Each and every team of Notinos is working to set the standard for how humans work together in the AI era. From building a business’s system of record to making and managing AI agents to automating away the busy work, we care deeply about giving our customers more time for their life’s work. About the Role This role is based in New York City. We work from our offices on Mondays, Tuesdays and Thursdays (our Anchor Days) because we do our best thinking and building together in person. We’re looking for someone who’s excited to work alongside the team during those days. This role sits on Notion’s Creative Studio, a small team of designers, illustrators, and filmmakers. Our work tells the story of our offering in a way that reflects the products themselves: smart, refined, and with a dash of wit on the side. As a Brand Designer, you’ll work on high-impact brand initiatives and campaigns: setting direction from early strategy through final execution, partnering closely with stakeholders and executives, and raising the bar for craft and systems. You’ll be asked to define approaches, resolve ambiguity, and influence both project outcomes and how the team works. What You'll Achieve Concept, art direct and design high-visibility moments from brand campaigns, product launches, and events, developing approaches that can scale across a broad range of surfaces, moments, and channels. Contribute to our brand systems and develop standa

RestAIGoExcel
N
📍 New York, New York, United States· Full-time· Remote
✓ Quality checkedCompany trend -88.6%

Who We Are Notion is the collaborative AI workspace where teams and agents think together . We're building one place where your knowledge, projects, meetings, and AI tools live side by side, so work is faster, clearer, and less fragmented. Millions of individuals, small teams, and large companies run their work on Notion. Notinos (our employees) are customer zero in bringing this future of work to life. We care about craft, building things that last, and the belief that great work is still fundamentally human. Our goal isn’t to ship the next feature. Each and every team of Notinos is working to set the standard for how humans work together in the AI era. From building a business’s system of record to making and managing AI agents to automating away the busy work, we care deeply about giving our customers more time for their life’s work. About the Role: As a Forward Deployed Architect on Notion’s Services team, you will help customers turn AI ambition into operational reality and unlock the full potential of our platform. You will partner directly with customers to design, build, and launch AI-native workflows that drive adoption, usage, and measurable business outcomes. This role sits at the center of Notion’s workflow-led GTM motion. You will partner directly with customers to understand their business goals, operating processes, technical environment, governance needs, and adoption barriers, then translate that context into scalable Notion architectures that drive measurable value. You will be hands-on across discovery, solution design, workspace architecture, workflow build, AI implementation, launch planning, adoption and handoff. You will work deeply with customers to define what Notion should own, where it should integrate with existing systems, and how Notion can become a durable operating layer for their teams. The best candidates combine strong consultative discovery, systems thinking, technical fluency, AI-native workflow design, implementation judgment an

N
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -88.6%

$145K – $175K/yr

Quick readStrong listing-quality and freshness signals

Who We Are Notion is the collaborative AI workspace where teams and agents think together . We're building one place where your knowledge, projects, meetings, and AI tools live side by side, so work is faster, clearer, and less fragmented. Millions of individuals, small teams, and large companies run their work on Notion. Notinos (our employees) are customer zero in bringing this future of work to life. We care about craft, building things that last, and the belief that great work is still fundamentally human. Our goal isn’t to ship the next feature. Each and every team of Notinos is working to set the standard for how humans work together in the AI era. From building a business’s system of record to making and managing AI agents to automating away the busy work, we care deeply about giving our customers more time for their life’s work. About the Role: Notion is reimagining how customers adopt, expand, and realize value from software in an AI-native world. As an Outcomes Architect, you’ll be the build-beside partner who helps customers turn AI ambition into working systems inside Notion. You’ll own workflow adoption, value delivery, and renewal outcomes for a book of named accounts, with a focus on customers that are flat, at-risk, or need a stronger path to measurable impact. You’ll partner closely with Solutions Consultants on account strategy, expansion qualification, and planning, while directly shaping outcomes that strengthen customer partnerships and contribute to predictable revenue. If you’re someone who loves helping customers build workflows that solve real business problems—and you want to work at the intersection of AI, productivity, customer value, and revenue impact—this is the role. This role can be based in either San Francisco or New York City. We work from our offices on Mondays, Tuesdays and Thursdays (our Anchor Days) because we do our best thinking and building together in person. We’re looking for someone who’s excited to work alongside the te

RestAIGoRust
N
📍 New York, New York, United States· Full-time
✓ Quality checkedCompany trend -88.6%

Who We Are Notion is the collaborative AI workspace where teams and agents think together . We're building one place where your knowledge, projects, meetings, and AI tools live side by side, so work is faster, clearer, and less fragmented. Millions of individuals, small teams, and large companies run their work on Notion. Notinos (our employees) are customer zero in bringing this future of work to life. We care about craft, building things that last, and the belief that great work is still fundamentally human. Our goal isn’t to ship the next feature. Each and every team of Notinos is working to set the standard for how humans work together in the AI era. From building a business’s system of record to making and managing AI agents to automating away the busy work, we care deeply about giving our customers more time for their life’s work. About the Role: Our Executive Operations team work closely with Notion’s leadership, serving as trusted advisors, collaborators, and problem-solvers. We focus on amplifying the impact of our executives by anticipating needs, streamlining operations, and building systems that keep leaders focused on the highest leverage work. We’re deeply connected to Notion’s mission and values, and we take pride in creating an environment of collaboration, clarity, and authenticity. Our team thrives on strong relationships, operational excellence, and a shared commitment to building tools that empower people to think and work together more effectively. This role calls for someone who is proactive, adaptable, and deeply organized. Someone who can balance complex scheduling, drive cross-functional coordination, and bring clarity to fast moving priorities. This person will support 2 leaders in our Engineering and Product orgs. Our ideal candidate thrives in dynamic environments, operates independently, and consistently finds ways to improve workflows and communication. You’ll be a key partner in making sure our leaders and the company as a whole can mo

RestAIGoRust
B
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -100%

$160K – $200K/yr

Quick readStrong listing-quality and freshness signals

About Us: Blockworks is an information platform that sits at the center of the crypto industry. We transform raw, complex data and facts into actionable research, trusted alpha-driven insights, and world-class events. The result is transparency and confidence. Blockworks connects investors and businesses in onchain capital markets. We give businesses a platform to earn trust and provide investors with the information they need to underwrite the asset class. Who You Are: Software engineering is your passion, and you have special talents focused on data architecture, design, and API development. You are a player-coach and a natural leader who understands the technical and human elements that go into great software design. You have a results-oriented attitude and a passion for delivering flawless releases and developing digital product pipelines (CI/CD pipelines). You have a proven track record facilitating engineering teams to increase productivity and quality. You're excited at the possibility of helping design and develop our data pipelines as well as leading our data-related projects and strategies for Blockwork's suite of projects. You love moving quickly in a fast-paced start-up, but you also bring intentionality, sustainability and scalability to your approach as an engineer. What You’ll Do: As our Senior Data Engineer , you will be directly responsible for leading the creation and execution of our data models and strategies that feed our products. You'll work collaboratively with other members of the engineering team to design, develop, implement, and evolve our data pipeline and approaches. Every day will look a little different, but in general, you will do things like: Own Data Sourcing Pipelines: You'll be responsible for helping to architect our data warehousing, ingestion and sourcing strategy, working with multiple SDKs to aggregate data from various sources into Blockwork's own data warehouse. Design and Implement ETL Solutions: You'll be responsible for

TypeScriptPythonSQLPostgreSQL
P
📍 New York, New York, United States· Full-time
✓ Quality checkedCompany trend -85.7%

About Pinecone Pinecone is the knowledge infrastructure for AI at scale. Its leading vector database and knowledge engine, Pinecone Nexus, power accurate, performant AI applications for more than 9,000 customers and 800,000 developers worldwide. Pinecone's mission is to make AI knowledgeable. Pinecone is based in New York and raised $138M in funding from Andreessen Horowitz, ICONIQ, Menlo Ventures, and Wing Venture Capital. About the Team and Role: The Experience team is at the center of one of the most exciting transitions in software development history — the shift from human-driven to agent-driven product experiences. We own Pinecone's API, clients, authentication, revenue, and observability systems, and right now that means redesigning all of it for a world where AI agents are first-class users alongside humans. This is a wide-scope role. You'll own things end-to-end — from backend architecture to API design to SDK and web surfaces. You’ll be working closely with product, design, and other engineering teams to identify user needs and build the right thing, at the right abstraction level, at the right time. Along the way, you will be building high-leverage platform capabilities that accelerate Pinecone’s product development and user growth systems. We're looking for an engineer who sees this moment for what it is: a rare opportunity to shape how developers and agents interact with a category-defining product. You're not waiting to see how the industry figures out MCP, agentic workflows, and AI-native interfaces — you're already experimenting, already forming opinions, already building. You know that speed and leverage matter more than labor, and you've internalized AI-assisted development not as a productivity trick but as a fundamentally different way of working. Responsibilities: Pioneer our agent experience. Shape how AI agents interact with Pinecone — designing interfaces, protocols (MCP), and tooling that make Pinecone the easiest and most capable platform f

JavaReactAWSAzure
D
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -87.2%

From $192K/yr

Quick readStrong listing-quality and freshness signals

As a Senior Platform Product Manager focused on AI SDLC Trusted Throughput, you will define and drive the product strategy for enabling safe, reliable software delivery at AI-native scale across Datadog’s Internal Developer Platform. As AI accelerates development velocity and system complexity, you will help evolve SDLC systems from human-supervised workflows to platforms with built-in safety, observability, and correctness guarantees. You will partner closely with engineering, security, and developer platform teams to improve deployment reliability, operational visibility, and governance while enabling both engineers and AI agents to move quickly with confidence. This role offers the opportunity to shape foundational developer infrastructure and influence how AI-powered software delivery operates across Datadog. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Own the product strategy, roadmap, and execution for AI-native SDLC throughput and reliability initiatives across Datadog’s Internal Developer Platform Define and drive platform outcomes aligned to DORA metrics, balancing deployment velocity with reliability, change failure reduction, and operational safety Partner with engineering, infrastructure, security, and developer experience teams to build automated validation, auditability, and risk-scoring capabilities into deployment workflows Deliver actionable SDLC observability and diagnostic capabilities that connect executive-level metrics to operational signals across the software delivery lifecycle Drive systems that monitor and validate AI-generated or AI-attributed changes to ensure correctness, compliance, and trustworthy automation Serve as a cross-functional product leader across SDLC Foundations, Security Engineering, and compl

AIGoRustSpring
N
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -88.6%

$230K – $260K/yr

Quick readStrong listing-quality and freshness signals

Who We Are Notion is the collaborative AI workspace where teams and agents think together . We're building one place where your knowledge, projects, meetings, and AI tools live side by side, so work is faster, clearer, and less fragmented. Millions of individuals, small teams, and large companies run their work on Notion. Notinos (our employees) are customer zero in bringing this future of work to life. We care about craft, building things that last, and the belief that great work is still fundamentally human. Our goal isn’t to ship the next feature. Each and every team of Notinos is working to set the standard for how humans work together in the AI era. From building a business’s system of record to making and managing AI agents to automating away the busy work, we care deeply about giving our customers more time for their life’s work. About the Role: The CX Strategy & Ops Lead is responsible for designing & executing the customer support strategy to ensure that the company provides an exceptional customer experience at scale. As a strategic partner to CX Leadership, they will partner with cross-functional teams to identify and prioritize customer needs, pain points, and opportunities for improvement, and develop and implement strategies, programs, processes and technology to deliver high-value, personalized support for a diverse array of users. The CX Strategy & Ops Lead will define and track key performance metrics to measure the effectiveness of customer support initiatives; They'll stay up to date on industry trends and best practices in customer support to ensure Notion is at the leading edge. They will identify areas to leverage AI to increase CX efficiency and effectiveness and maximize the impact of our support offering across both digital and human experiences. They will need to have strong project management skills, excellent communication and interpersonal skills, and be able to work collaboratively with cross-functional teams to bring strate

GitRestAIGo
🔔

Get new human evaluator jobs in New York, United States by email

Daily job updates · Unsubscribe anytime