Ai Agent Evaluator Jobs

About Scale At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. With our…

About the Program The Human Frontier Collective (HFC) brings researchers and scientists together to tackle consequential problems in AI. In partnership with Scale Labs, we are building a small cohort of researchers to work on the empirical foundations of AI safety. That work…

As a research intern, you will work on problems at the frontier of agentic AI, where challenges in alignment,

Research Intern, Frontier Agents (Winter 2027) at Together AI in San Francisco. $58 – $70/hr.

About the AI Security Institute The AI Security Institute is the world's largest and best-funded team dedicated to understanding advanced AI risks and translating that knowledge into action. We’re in the heart of the UK government with direct lines to No. 10 (the Prime…

Job Description: Lead the future of physical AI in defense by building the reasoning models for unmanned autonomous systems, across aerial, maritime, land, and space domains. We are looking for a leader with not only the deep technical expertise or the abilities to build a…

The goal of a Senior Machine Learning Engineer at Scale is to own how we apply generative AI, agentic AI, computer vision, and reinforcement learning to mission-critical problems in production. Our senior machine learning engineers are handed problems that don't yet have an…

About Scale AI At Scale, our mission is to develop reliable AI systems for the world's most important decisions. Our products provide the high-quality data and full-stack technologies that power the world's leading models, and help enterprises and governments build, deploy, and…

Job Description: Are you a passionate and innovative engineer looking to help develop state-of-the-art AI and robotics products? Are you eager to make a positive difference in the world? Do you want to work alongside mission-driven and values-focused teammates? Shield AI is just…

Staff Engineer, Autonomy Software Integration - San Mateo at Shield AI in San Mateo, California, United States. Full-time · Hybrid · $188.6K – $282.9K/yr.

Senior Engineer, Autonomy Software Integration at Shield AI in San Diego, California, United States. Full-time · On-site · $128K – $192.4K/yr.

We are seeking Autonomous Software Engineers for full-time roles starting in 2027! This is a paid, in-person, full-time position for students graduating during the 2026-2027 academic year. We are now reviewing applications for positions starting after graduation in 2027. What…

At Scale, our mission is to develop reliable AI systems for the world's most important decisions. For 10 years, Scale has provided the high-quality data and full-stack technologies that power the world's leading models, and has helped enterprises and governments build, deploy,…

Staff Engineer, Autonomy Software Integration at Shield AI in San Diego, California, United States. Full-time · Hybrid · $157K – $235.8K/yr.

The Agent Research and Tooling team, part of MongoDB's AI Builder Experience organization, owns the platform layer around agents: how teams author, distribute, evaluate, monitor, and improve agent skills and agent behavior. We are hiring a software engineer to build and maintain…