Ai Agent Evaluator Jobs

Help shape the future of AI by evaluating how well AI assistants understand users, use personal context, and deliver helpful conversations. Location: Remote Type: Independent contractor / Part-time Project duration: up to 3 months About the role At Anyone AI, we create…

At Vanta, our mission is to help businesses earn and prove trust. We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior…

About AppDirect Become a digital, global citizen and enable the new generation of digital entrepreneurs around the world. AppDirect offers a subscription commerce platform to sell any product, through any channel, on any device, as a service. We power millions of subscriptions…

The Senior Software Engineer Opportunity The team that built Jeeva AI is building

The Staff Software Engineer Opportunity The team that built Jeeva AI is building

The Principal Software Engineer Opportunity The team that built Jeeva AI is build

About Snorkel Snorkel AI is the frontier AI data lab, helping teams build the data and environments behind high-performing frontier and agentic AI. We combine technology with research-driven AI data development to create datasets, benchmarks, evals, and custom solutions for…

Help shape the future of AI by evaluating how conversational AI agents communicate and perform across different languages. Location: Remote / Global, subject to project location restrictions Type: Independent contractor / Project-based Commitment: To be confirmed Compensation:…

Your Impact at LILA We're building a talent-dense, high-agency AI safety team at Lila that will engage all core teams within the organization (science, model training, lab integration, etc.), to identify and mitigate risks from scientific superintelligence while retaining the…

About the Job: Feature management and experimentation have converged into a single market, and the buying dynamic at the top has shifted. Engineering teams are no longer the sole evaluator — data scientists and data-focused PMs now carry equal weight on the largest deals. The…

Research Engineer Intern - Environments, Data and Post-Training at Mercor in San Francisco, California, United States. Internship · On-site · $70/hr.

Research Engineer - Environments, Data and Post-Training at Mercor in San Francisco, California, United States. Full-time · On-site · $180K – $500K/yr.

OKX will be prioritising applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visa. Who We Are At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading…

About the team Preparedness is a critical Safety Research team at OpenAI, which is focused on mitigating AI threats to global security that could scale to an extreme level of severity. Our work involves: Measurement. Monitoring and predicting the evolving capabilities of…

Lead Engineer – Agentic AI About QualMinds At QualMinds, we design and develop world-class digital products and custom software solutions for Startups, Scale-ups, and Enterprises. Our engineering teams specialize in Frontend, Backend, Full Stack Development, QA Automation,…