Jobs in United States

Human Evaluator in New York

98 active opportunities · Updated October 2026

Explore current human evaluator jobs in New York. Filter by work mode, employment type, experience, department, date posted and distance.

R
📍 New York, NY, United States· Full-time
✓ High-confidence listingCompany trend -99.2%

From $10K/yr

Quick readStrong listing-quality and freshness signals

About Ramp Ramp is building the smart infrastructure for finance teams, embedded in the transaction flow of every dollar a business spends. We automate how over $200B in annualized spend flows in and out of 70,000+ companies: authorizing payments, flagging risk, categorizing spend, and closing books. The problems are high-stakes, data-dense, and unforgiving. We hire people with high agency and high urgency. We look for slope over intercept. We care less about where you trained and more about what you’ve built. At Ramp, everyone is a builder who owns problems end to end and makes consequential decisions that shape the outcome. The median Ramp customer saves 5% and grows revenue 16% in their first year – far in excess of businesses operating without Ramp. We believe every ambitious company deserves the same. If you want to build systems that directly shape how companies move and manage billions, Ramp is the place to do it. About the Role As the Product Manager for Tax, you will own the vision, strategy, and roadmap for Ramp’s next generation of AI-powered tax products. You will build solutions to automate tax calculation, validation, and filing for our existing suite of products (card, bill pay, banking, etc), for both domestic and international use cases. You’ll also be accountable for **expanding** Stack - our agentic accounting product - into the tax automation domain, to automate the work of CPAs. You’ll partner closely with engineering, design, data, and cross-functional stakeholders (Finance, Legal, Security, CX, Sales) to build intelligent experiences that help customers save money, reduce risk, and eliminate manual work. This role blends AI-native product development (LLM-powered workflows, evaluation systems, human-in-the-loop design) and deep domain expertise in domestic/international tax and CPA’s workflows. You will define and execute a strategy that will unlock new markets for Ramp and help us save our customers even more time and money. Please note that

GitRestAIGo
H
📍 New York, NY, United States
✓ Quality checkedCompany trend +310%

Become a part of our caring community You have shipped AI products before. You understand the difference between a demo and a production system. You have strong opinions about evaluation frameworks because you have experienced the consequences of operating without them. You are at your best when you own architecture decisions while continuing to build and deliver critical code yourself. We build the platform that transforms millions of clinical documents into trusted, actionable data. Our systems use large language models (LLMs) to read medical records, extract structured facts, answer complex questions with citations back to source documents, and route complex cases to human experts. The output of these systems supports healthcare decisions that impact real members. As a Lead AI Applied Engineer, you will provide technical leadership for AI-enabled products and platforms, define architectural direction, establish engineering standards, and personally design and build the most critical components of our systems. You will lead through both technical expertise and execution, helping the team deliver reliable, scalable, and auditable AI solutions in a highly regulated healthcare environment. Why Join Us Lead the architecture of production AI systems where LLMs are foundational to the product experience. Make key technical decisions regarding model selection, system boundaries, platform architecture, and build-versus-buy strategies. Own the highest-risk and highest-impact technical challenges involving reliability, explainability, and correctness. Influence engineering culture and establish standards that shape how the team builds and ships AI products. Work on systems operating at meaningful scale, processing millions of documents and supporting healthcare decisions across a large member population. Partner

JavaScriptTypeScriptPythonReact
Z
📍 New York, New York, United States· Full-time· Remote
✓ High-confidence listing

From $120K/yr

Quick readStrong listing-quality and freshness signals

Zscaler (NASDAQ: ZS) accelerates digital transformation so customers can be more agile, efficient, resilient, and secure. The Zscaler Zero Trust Exchange™️ platform protects thousands of customers from cyberattacks and data loss by securely connecting users, devices, and applications in any location. Distributed across 160+ public exchanges globally and thousands of private exchanges at the edge, the SASE-based Zero Trust Exchange is the world’s largest in-line cloud security platform. We believe the future of work is Human + AI and are building an AI-native enterprise where human potential is amplified by machine intelligence to solve the world’s hardest security challenges. Driven by deep customer obsession, we are committed to the mission, outcome, and to each other. We bring these commitments to life through three core behaviors: ownership and collaboration, trust through outcomes and impact, and a challenge culture with ongoing feedback. Ready to make an impact at the company pioneering security transformation in the AI era? Join us at Zscaler. We are looking for a Commercial Sales Engineer to join our East team. This is a remote role, reporting to the Manager of Sales Engineering. The Zscaler Sales and Go-to-Market team is a global group of professionals who are passionate about delighting our customers, nurturing trusted partnerships, and sharing their expertise to drive a secure, cloud-enabled digital future and further cement our position as the world leader in cloud security. Sales, Customer Success, Sales Enablement, Solution Architects, Business Development, Transformation, and Technology Partnerships all work together to demonstrate the power and agility of Zscaler cloud transformation to the world. What you’ll do (Role Expectations) Create and deliver technical product presentations to prospective customers Gather customer technical requirements to ensure proposed solutions will meet customer goals and needs Lead product evaluations and custom pr

AWSGitAgileAI
H
📍 New York, NY, United States
✓ Quality checkedCompany trend +310%

Become a part of our caring community Most AI engineering jobs are a thin wrapper around a model API. This role is different. We build the platform that transforms millions of clinical documents into trusted, actionable data. Our systems use large language models (LLMs) to read medical records, extract structured facts, answer complex questions with citations back to the source document, and route ambiguous cases to human experts for review. Our users make decisions that impact real healthcare outcomes, so “good enough” is not good enough. Building AI systems that are accurate, reliable, auditable, and scalable is at the core of this role. As a Senior AI Applied Engineer, you will design, build, deploy, and operate production AI systems used at scale within one of the largest health insurers in the United States. You will own solutions end-to-end, from user experience and APIs to model orchestration, evaluation frameworks, infrastructure, and production operations. Why Join Us Build production AI systems where LLMs are in the critical path, not just demos or proofs of concept. Work on extraction, retrieval, agentic workflows, and human-review systems that process real healthcare data at scale. Own projects end-to-end across frontend, backend, AI orchestration, infrastructure, deployment, and operations. Solve challenging problems around accuracy, explainability, traceability, and reliability in regulated environments. Ship quickly in a small, high-impact team that embraces AI-assisted development and rigorous quality standards. Build systems that continuously improve through expert feedback, evaluations, and human-in-the-loop workflows. Key Responsibilities Design, develop, and deploy full-stack AI-powered application

JavaScriptTypeScriptPythonReact
H
📍 New York, NY, United States
✓ Quality checkedCompany trend +310%

Become a part of our caring community Every large organization is making critical decisions today about how it will leverage AI over the next decade. Few have leaders who can both define that vision and demonstrate its viability through hands-on engineering. This role requires both. We build the platform that transforms millions of clinical documents into trusted, actionable data. Our systems use large language models (LLMs) to read medical records, extract structured facts, answer complex questions with citations to source documents, and route difficult cases to human experts. These capabilities support decisions that impact real healthcare outcomes for members. As a Principal AI Applied Engineer, you will define the technical strategy, architectural standards, and long-term vision for AI-enabled products across the organization. You will influence enterprise-wide decisions regarding AI platforms, model strategies, engineering standards, and technology investments while remaining deeply hands-on in prototyping, experimentation, architecture, and software development. This is the highest-level individual contributor role within the AI Applied Engineering organization. Success requires exceptional technical depth, organizational influence, strategic thinking, and the ability to translate emerging AI capabilities into scalable, reliable, and responsible production systems. Why Join Us Shape the long-term AI architecture and engineering direction for a large enterprise healthcare organization. Influence how AI-enabled products are designed, built, evaluated, deployed, and governed across multiple teams. Drive strategic decisions involving models, vendors, platforms, infrastructure, and shared capabilities. Prototype and validate emerging technologies before the organization invests at scale.</

JavaScriptTypeScriptPythonReact
N
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -88.6%

$196K – $230K/yr

Quick readStrong listing-quality and freshness signals

Who We Are Notion is the collaborative AI workspace where teams and agents think together . We're building one place where your knowledge, projects, meetings, and AI tools live side by side, so work is faster, clearer, and less fragmented. Millions of individuals, small teams, and large companies run their work on Notion. Notinos (our employees) are customer zero in bringing this future of work to life. We care about craft, building things that last, and the belief that great work is still fundamentally human. Our goal isn’t to ship the next feature. Each and every team of Notinos is working to set the standard for how humans work together in the AI era. From building a business’s system of record to making and managing AI agents to automating away the busy work, we care deeply about giving our customers more time for their life’s work. About the Role: We’re seeking an experienced User Researcher to shape growth-related product decisions by delivering insights that fuel AI experiences. This role blends traditional growth research, such as adoption, monetization, and pricing and packaging, with fast-evolving AI features like Notion Agent and Chat that permeate experiences like onboarding and Workspace creation. It requires a unique mix of user research expertise, strategic foresight, and technical fluency in AI and AI product development. This role can be based in either San Francisco or New York City. We work from our offices on Mondays, Tuesdays and Thursdays (our Anchor Days) because we do our best thinking and building together in person. We’re looking for someone who’s excited to work alongside the team during those days. What You'll Achieve: Design and execute studies that evaluate how people experience Notion with AI in the loop, including how users discover, trust, and get value from AI, and identify barriers to adoption and willingness to pay. Run mixed-methods research (qual + quant), including interviews, concept testing, prototype/usability testing, diary

RestAIGoRust
N
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -88.6%

$98K – $140K/yr

Quick readStrong listing-quality and freshness signals

Who We Are Notion is the collaborative AI workspace where teams and agents think together . We're building one place where your knowledge, projects, meetings, and AI tools live side by side, so work is faster, clearer, and less fragmented. Millions of individuals, small teams, and large companies run their work on Notion. Notinos (our employees) are customer zero in bringing this future of work to life. We care about craft, building things that last, and the belief that great work is still fundamentally human. Our goal isn’t to ship the next feature. Each and every team of Notinos is working to set the standard for how humans work together in the AI era. From building a business’s system of record to making and managing AI agents to automating away the busy work, we care deeply about giving our customers more time for their life’s work. About the Role You'll own the quality bar for Notion AI products. You’ll work with product and engineering teams to build systems to define what “good” looks like, measure our progress, and drive changes to deliver reliable and high-quality AI experiences. Your work directly shapes how Notion's AI products behave for millions of users. This isn't a traditional software engineering role. It’s an art & science role . You won't spend your days writing code. Instead, you'll focus on understanding and shaping how our AI products behave through context engineering, designing evaluation systems, and analyzing data. This team sits in our AI engineering team, working directly with engineering, product, design, and data. This role is a unique blend of ops, strategy, and product thinking. Day to day, you'll live in production data, ship prompt fixes, run evals and, in effect, shape our quality strategy. As part of that you'll shape Notion's model strategy and work directly with frontier AI labs (OpenAI, Anthropic, Google) to evaluate and launch new models. We're looking for problem-seeking generalists interested in 0 → 1 : curious people wi

SQLRestAIGo
H
📍 New York, NY, United States
✓ Quality checkedCompany trend +310%

Become a part of our caring community Help shape practical, responsible AI solutions that improve healthcare experiences and outcomes. Humana’s Enterprise AI organization develops safe, scalable AI solutions across our Insurance and CenterWell businesses. We bring together product managers, data scientists, engineers, policy experts, and business leaders to apply emerging technology to meaningful healthcare challenges. As Associate Director of Applied AI, you will lead teams that design, build, and deploy enterprise AI solutions, with a focus on generative AI and intelligent agents. You will connect technical strategy to business needs, guide responsible delivery in a regulated environment, and help teams turn promising ideas into measurable outcomes for members, patients, and associates. Key Responsibilities Lead and mentor teams developing production-ready AI solutions that improve healthcare delivery, member experiences, and business operations. Help define and execute the roadmap for applied AI initiatives in alignment with enterprise priorities and business needs. Guide the evaluation and adoption of machine learning, generative AI, large language models, multimodal models, and intelligent agent technologies. Oversee scalable APIs, frameworks, data pipelines, retrieval-augmented generation solutions, and agent orchestration capabilities. Partner with product, data science, engineering, architecture, security, and business teams to translate requirements into reliable solutions. Establish standards for AI evaluation, obse

PythonDockerKubernetesMachine Learning
G
📍 New York, New York, United States· Full-time
✓ High-confidence listing

$720K – $816K/yr

Quick readStrong listing-quality and freshness signals

Overview: Guidepoint’s Human Resources (HR) team drives Guidepoint’s culture and company values of intellectual curiosity, tenacity, integrity, resourcefulness, responsibility, and service. We are currently looking for an HR Operations Specialist to support our dynamic HR team. The HR Operations Specialist will own the onboarding process for new employees and will provide general HR support. The ideal candidate has a high level of attention to detail and is a collaborative team player able to work in a fast-paced environment. This role is hybrid and requires on-site office attendance three times a week. This is an excellent opportunity for someone who already has experience in HR and is eager to get involved in all aspects within HR. This is a hybrid position based in our New York office. What You’ll Do: Assist with the onboarding process for new hires including but not limited to: Running first day new hire orientation for in person and remote hires Creating and maintaining employee profiles in ADP Workforce Now and other websites Conducting background checks and I-9 verification in compliance with E-Verify Processing new hire documentation Scheduling new hire training Facilitate employee led corporate athletic league and Corporate Social Responsibility programs Monitor and respond to employee enquiries submitted through the HR Inbox Assist in the drafting of internal documentation including promotion documents, payroll status change forms, and employment verifications Maintain the HR Intranet page and new hire/promotions announcements Run and update monthly headcount reports Update global organization chart monthly Ad hoc projects as requested What You Have: Bachelor’s degree from an accredited university with a minimum 3.0 GPA is required is preferred Minimum of 1 years of relevant experience in human resources administration Strong project management skills with an ability to multitask and manage competing priorities Excellent inter

AIExcelProject ManagementHR
F
📍 New York, United States of America, United States
✓ Quality checkedCompany trend -100%

At Franklin Templeton, we believe success is built through powerful partnerships. As a forward thinking asset manager, we build dynamic relationships with clients, understand their goals, and navigate complex markets together. We leverage cutting edge strategies and deep insights to unlock opportunities for long term wealth creation. Our talented, global teams bring expertise that is both broad and unique. From our welcoming, inclusive, and supportive culture to our globally diverse business, we offer opportunities not only to help you reach your potential, but also to contribute to our clients’ success. Senior Administrative Assistant We are looking for a Senior Administrative Assistant to join the Franklin Templeton Crypto team. The role will be based in New York City. In this role, you will provide support to leaders in multiple functions across the team as well as partner with other members to support the broader Franklin Crypto organization. What are the ongoing responsibilities of a Senior Administrative Assistant? Provide administrative support to executives; responsibilities include calendar maintenance, meeting coordination, staff relocations, phone coverage, ordering office supplies, email correspondence, incoming/outgoing mail, filing, and scanning. Manage day-to-day communication between executives and company staff or outside business clients and contacts. Coordinate complex domestic and international travel plans. Assist with creation of travel binder, including agenda details and subsequent expense report submission process. Ensure that department invoices and expense reports are processed timely and accurately. Take and maintain meeting

ExcelHuman Resources
KH
📍 New York, NY, United States
✓ High-confidence listing

From $90K/yr

Quick readStrong listing-quality and freshness signals

About the Role We are looking for an organized, thoughtful, and proactive Executive Assistant (EA) to our founders, who will also serve as the Office Manager for our New York City office. In this unique role, you’ll have the opportunity to establish trust and build rapport with our founders to organize their most precious asset: their time. You will improve our founders’ effectiveness through your thoughtful and organizational touches by managing calendars, coordinating activities while avoiding scheduling conflicts, anticipating their needs, and predicting thoughtful ways to improve their ability to be even more effective in their day-to-day. Similarly you will scale your thoughtful nature to owning the Office Management responsibilities to create an unparalleled in-office vibe for our employees. You’ll actively promote and facilitate in-person collaboration by partnering to create events, activities, and safe spaces for meaningful interactions among our NYC employees. Whether through thoughtfully designed workspaces, or cultivating experiences for engaging team events, you will promote face-to-face connections that foster creativity, teamwork, and a strong sense of community. Your efforts will build a dynamic office environment where execs and employees feel motivated to mingle, collaborate, share ideas, and contribute to a thriving workplace culture. This role is perfect for someone who is thoughtful, organized and proactive, and thrives on building connections, planning engaging experiences, and making the office a place people genuinely love coming to. What you will do Calendar Management: Manage and maintain complex and ever-changing calendars for the CEO and CPO, including scheduling internal and external meetings, managing conflicts, and prioritizing commitments based on strategic importance. Meeting Logistics: Coordinate all aspects of meetings, including securing venues and arranging necessary technology. Travel Coordination: Arrange comp

AIProject ManagementLogisticsRecruitment
S
📍 New York, New York, United States· Full-time
✓ High-confidence listing

$245K – $285K/yr

Quick readStrong listing-quality and freshness signals

VP, Product Insurance underwriting runs on human judgment, manual workflows, and knowledge locked in someone's head. It breaks when that person leaves and doesn't scale when the book doubles. Sixfold is building AI agents that understand risk the way a 20-year veteran underwriter does. Not summaries or flags, but systems that make real decisions on billions in premium for some of the world's largest carriers. AI is the product, the workflow, and the moat. If you think in systems, move fluidly from research to pixels, and are energized by designing AI-native experiences where the best practices haven't been written yet — this role was made for you. Who We Are 🏔 Product: Sixfold is the AI brain for underwriting. Our platform handles submissions at scale, assessing risk against appetite, surfacing cited insights, and deploying AI agents to handle research, referrals, and triage so underwriters can focus on building profitable portfolios. 💪 Team: A focused team of insurance operators, AI researchers, and engineers who love hard problems. We've pushed the boundaries of what AI can do with unstructured data — from teaching AI to understand that a bakery in Florida faces different risks than one in Montana, to knowing when a manufacturing company's pivot from toys to medical devices fundamentally changes their risk profile. We ship fast and stay close to customers. 📈 Traction: Processing billions in premium for some of the world's largest carriers. We know AI. We know underwriting. We're building what comes next. About the Role You'll inherit a strong product and a capable team, but that's the starting point, not the job. The job is figuring out what underwriting becomes once AI stops assisting and starts deciding, and getting there faster than the market expects. You prototype to find out, not to perform speed. You're drawn to this problem because the underwriter of the future is one of the more interesting design problems in software right now. In this role, you will:

RestAIGoSalesforce
D
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -87.2%

From $131K/yr

Quick readStrong listing-quality and freshness signals

At Datadog, People Operations is more than just human resources—it’s a data-driven team dedicated to constantly improving the way we hire, develop, and support our most valuable asset: our people. Our People Operations team are strategic problem solvers who work closely with leadership and employees to ensure that Datadog keeps scaling smoothly and remains a great place to work. Datadog is seeking a HRIS Manager who will be responsible for managing and supporting projects within People Technology. This hands-on technical role demands excellent knowledge of HR business processes and methodologies along with a strong analytical and reporting background. A successful candidate will have a solid understanding of Workday and the ability to focus on one or more of the functional areas in People Operations. This will include the ability to assess systems and business processes, coordinate with peers, project managers, and management on impacts to other Datadog systems or business processes. You will play a critical role in the continued deployment of new functionality, developing solutions and enabling the continued growth of Datadog. At Datadog, we place value in our office culture - the relationships and collaboration it builds, and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Own the end-to-end product lifecycle for your pod's systems and processes—from gathering requirements and designing solutions through testing, delivery, and adoption. Serve as the Workday subject matter expert for your domain, advising stakeholders on configuration best practices, optimization opportunities, and governance. Assess when Workday is the right tool and when a specialized third-party platform better serves the business. You'll partner with stakeholders on those decisions and own the requirements that follow. Understand integration concepts

W
📍 New York, New York, United States· Full-time· Remote
✓ High-confidence listingCompany trend -7.5%
Quick readStrong listing-quality and freshness signals

🚀 About WRITER WRITER is where the world's leading enterprises orchestrate AI-powered work. Our vision is to expand human capacity through superintelligence. And we're proving it's possible – through powerful, trustworthy AI that unites IT and business teams together to unlock enterprise-wide transformation. With WRITER's end-to-end platform, hundreds of companies like Mars, Marriott, Uber, and Vanguard are building and deploying AI agents that are grounded in their company's data and fueled by WRITER's enterprise-grade LLMs. Valued at $1.9B and backed by industry-leading investors including Premji Invest, Radical Ventures, and ICONIQ Growth, WRITER is rapidly cementing its position as the leader in enterprise generative AI. Founded in 2020 with office hubs in San Francisco, New York City, Seattle, Austin, Chicago, and London, our team thinks big and moves fast, and we're looking for smart, hardworking builders and scalers to join us on our journey to create a better future of work with AI. 📐 About the role We are looking for a visionary and execution-oriented AI transformation lead to serve as a high-impact partner for our most strategic Fortune 100 accounts. In this role, you’ll be the architect of change, moving beyond simple software implementation to help the world's largest organizations fundamentally rethink how they work. You’ll sit at the intersection of business strategy and cutting-edge technology, translating the power of the WRITER platform into measurable P&L impact and helping executives navigate the shift to an AI-first operating model. This is a rare opportunity to build the playbook for enterprise AI transformation. You won’t just be managing accounts; you’ll be driving the next industrial revolution by helping C-suite leaders move from AI experimentation to full-scale value realization. Your work will directly influence WRITER's product roadmap and help define how the world’s biggest brands use superintelligence to expand human capacity. Thi

W
📍 New York, New York, United States· Full-time· Remote
✓ High-confidence listingCompany trend -7.5%
Quick readStrong listing-quality and freshness signals

🚀 About WRITER WRITER is where the world's leading enterprises orchestrate AI-powered work. Our vision is to expand human capacity through superintelligence. And we're proving it's possible – through powerful, trustworthy AI that unites IT and business teams together to unlock enterprise-wide transformation. With WRITER's end-to-end platform, hundreds of companies like Mars, Marriott, Uber, and Vanguard are building and deploying AI agents that are grounded in their company's data and fueled by WRITER's enterprise-grade LLMs. Valued at $1.9B and backed by industry-leading investors including Premji Invest, Radical Ventures, and ICONIQ Growth, WRITER is rapidly cementing its position as the leader in enterprise generative AI. Founded in 2020 with office hubs in San Francisco, New York City, Seattle, Austin, Chicago, and London, our team thinks big and moves fast, and we're looking for smart, hardworking builders and scalers to join us on our journey to create a better future of work with AI. 📐 About the role We are looking for a visionary and execution-oriented AI transformation lead to serve as a high-impact partner for our most strategic Fortune 100 accounts. In this role, you’ll be the architect of change, moving beyond simple software implementation to help the world's largest organizations fundamentally rethink how they work. You’ll sit at the intersection of business strategy and cutting-edge technology, translating the power of the WRITER platform into measurable P&L impact and helping executives navigate the shift to an AI-first operating model. This is a rare opportunity to build the playbook for enterprise AI transformation. You won’t just be managing accounts; you’ll be driving the next industrial revolution by helping C-suite leaders move from AI experimentation to full-scale value realization. Your work will directly influence WRITER's product roadmap and help define how the world’s biggest brands use superintelligence to expand human capacity. Thi

🔔

Get new human evaluator jobs in New York, United States by email

Daily job updates · Unsubscribe anytime