Ai Agent Evaluator Jobs

Senior Staff Engineer, Applied AI (Customer Agent) About the Team: Our E

Senior Lead Engineer, Applied AI (Customer Agent) About the Team: Our En

Sr. Lead Engineer, Applied AI (Customer Agent) at Klaviyo in Boston, Massachusetts, United States. $216K – $324K/yr.

Freelance | 8–20 hrs/week | Remote (EU/UK) Are you an experienced real estate professional who instinctively spots gaps in real estate reasoning and understands the complex realities of property advisory work? Do you have 8 to 20 hours per week available alongside your main job…

The Agent Observability team builds cutting-edge tools to monitor, explain, and improve AI systems in production, particularly those leveraging Large Language Models (LLMs) and generative AI. We provide robust, scalable observability for AI workloads, including drift detection…

MKTQ125R59 Databricks is hiring a Director of Agent & AI Search to define how our brand shows up across every surface where buyers discover, evaluate, and choose data and AI platforms—from AI-powered answer engines like ChatGPT, Gemini, and Claude to Google AI Overviews and…

About the Role Our team is looking for a Senior Software Engineer, Appli

Senior Software Engineer, Applied AI (Customer Agent) at Klaviyo in Boston, Massachusetts, United States. $148K – $222K/yr.

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing…

About Gusto At Gusto, we're on a mission to grow the small business economy. We handle the hard stuff — payroll, health insurance, 401(k)s, and HR — so owners can focus on their craft and their customers. With teams in Denver, San Francisco, and New York, we support more than…

The Role: We are looking for a highly skilled AI Tool / Agent Testing Engineer to evaluate, validate, and ensure the reliability of AI agents, AI automation tools, and agentic workflows used across our analytics platform. This role blends test engineering, GenAI understanding,…

This role requires supporting the end-to-end validation pipeline for AI tools: maintaining test datasets, running benchmarks, and measuring agent accuracy across routing decisions, classification labels, and structured output fields. Responsibilities Run and maintain the…

The AI Engineer will design, implement, and deploy production-ready AI solutions that enable intelligent automation and strengthen business capabilities. The role focuses on building modular, scalable agentic applications using open-source and proprietary large language models,…

About the Developer Experience team The Developer Experience (DevX) team owns how developers learn and build on Together AI. We run the documentation site, API reference, quickstarts, cookbooks, and the tooling that keeps all of it accurate as the platform ships new models and…

About the Team The Guardian team builds practical safety and oversight systems for increasingly capable AI agents. Our goal is to make it possible for agents to take on longer-running, higher-autonomy work while preserving meaningful safeguards, respecting user intent, and…