Ai Agent Evaluator Jobs

Reports to: CEO Owns: data proposals, sample development, quality, and pilot delivery Location: Remote / Latam / US The role You will own Anyone AI’s data initiatives and proposals to AI labs, from the data proposal or responding to requests, through pilot delivery. You own how…

As the leading data and evaluation partner for frontier AI companies, Scale is dedicated to advancing the progress of generative AI, with a focus around frontier evaluations, the science of data around posttraining, agentic applications, trustworthy agents oversight framework…

Research Scientist, LLM Evaluations & Benchmarking Anyone AI Labs Reports to: CEO · Remote / LatAm / US The role Evaluation is one of the hardest open problems in AI: we still don't have reliable ways to measure what frontier models can and can't do, and the field mostly runs on…

About Bolna Bolna is a YC-backed voice AI orchestration platform built for the Indian market—powering multilingual, vernacular voice agents across Hindi, Hinglish, Tamil, and 10+ languages at sub-500ms latency across collections, recruitment, sales, and e-commerce use cases. We…

Scale's LLM post-training platform team builds our internal distributed framework for large language model training. The platform powers MLEs, researchers, data scientists, and operators for fast and automatic training and evaluation of LLMs. It also serves as the underlying…

Scale’s ML platform (RLXF) team builds our internal distributed framework for large language model training and inference. The platform has been powering MLEs, researchers, data scientists and operators for fast and automatic training and evaluation of LLM's, as well as…

Shield AI is hiring a Field Solutions Engineerbased in Madrid, Spain to support technical sales, customer engagements, demonstrations, and capture activities focused on advanced simulation, synthetic environments, image generation systems, and AI-enabled mission systems. This…

Job Description: Shield AI is hiring a Hivemind Field Solutions Engineer based in Melbourne, Australia to support technical sales, customer engagements, demonstrations, and capture activities focused on advanced simulation, synthetic environments, image generation systems, and…

The goal of a Staff Machine Learning Engineer at Scale is to lead the design and deployment of agentic AI systems that operate in real-world, mission-critical government environments. On the Public Sector team, you’ll work at the intersection of agentic ML, systems engineering,…

Job Description: Help shape the future of physical AI in defense by building reasoning models for unmanned autonomous systems across aerial, maritime, land, and space domains. We’re looking for a deeply technical engineer who can turn emerging research into reliable autonomous…

Job Description: Shield AI is seeking a Senior Engineer to help design and develop the middleware framework upon which Shield AI autonomy is developed. As part of the Hivemind Foundations team, you’ll focus on building the high-performant, reliable, and robust foundational layer…

Analytics Engineer Prolific Prolific is not just another player in the AI space—we are the architects of the human data infrastructure that's reshaping the landscape of AI development. In a world where foundational AI technologies are increasingly commoditized, it's the quality…

Perplexity is seeking energetic researchers and engineers to join our Secure Intelligence Institute (SII), Perplexity's flagship research center for advancing security, privacy, and trust in frontier intelligence. SII’s goals are to advance frontier AI security research,…

By applying to this role, you will be considered for engineering roles across all teams at Perplexity. We are hiring builders to join our highly leveraged engineering team for creating new products that innovate and accelerate human productivity In 2026, we launched Computer,…

Your Impact at LILA Lila Sciences builds AI systems that accelerate discovery across the physical and life sciences. Within Physical Sciences AI, we work with experimental teams to build autonomous discovery agents that decide which experiments Lila's AI Science Factories should…