Ai Agent Evaluator Jobs

About Us At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source…

Datadog is looking for a Senior UX Researcher to shape strategically important products across Core Pillars. The researcher’s initial focus will be Agent Console, an emerging product area helping teams understand and improve the performance, usage, cost, reliability, and…

Senior Platform Engineer AI Engineering | Forward Deployed Engineering Role Description Defense Unicorns is seeking a senior AI Agentic Engineer to embed with a government team and its technology partners building an emerging AI-powered engineering ecosystem. This role will…

AI is being run everywhere, by humans and agents. Harmonic Security governs all of it. The AI Governance and Control (AIGC) platform understands user / agent intent and data context in real time, giving security teams visibility and control across every tool and workflow so…

Le rôle Équiper des équipes de LLM et de coding agents prend un après-midi. Les faire travailler en AI-Native SDLC, c'est-à-dire concevoir et livrer du logiciel avec des agents dans la boucle plutôt qu'à côté, demande de faire évoluer tout l'environnement autour : architecture,…

Perplexity is seeking a self-starting, technically fluent Account Executive to join our small but mighty Enterprise team and own new business for the Perplexity API platform — the frontier AI developer tools (Search, Sonar, and Agent APIs) that power real-time, grounded answer…

Member of Technical Staff, Data & Evals at Harvey in San Francisco, California, United States. Full-time · Remote · $230K – $340K/yr.

Research Engineer / Scientist, Data & Evals at Harvey in San Francisco, California, United States. Full-time · Remote · $230K – $340K/yr.

Member of Technical Staff, Data & Evals at Harvey in New York, New York, United States. Full-time · Remote · $230K – $340K/yr.

Research Engineer / Scientist, Data & Evals at Harvey in New York, New York, United States. Full-time · Remote · $230K – $340K/yr.

Help People Take Control of Their Finances. Join Us at Anyfin At Anyfin, we believe financial power belongs in the hands of the people. Since 2017, we've helped customers across Sweden, Finland, Norway and Germany save millions by refinancing expensive consumer credit. And we're…

Toast creates technology to help restaurants and local businesses succeed in a digital world, helping business owners operate, increase sales, engage customers, and keep employees happy. A day in the life (Responsibilities) Toast is looking for a Senior Director, Customer Care…

Role Overview We are looking for a hands-on Software Architect to own the end-to-end architecture of a multi-tenant AI platform, including the integration bus, semantic layer, agent runtime, workflow engine, and data stores. The role requires expertise in distributed systems,…

Coder is looking for an Enterprise Account Manager to grow our diverse customer base. You’ll help bring Coder’s platform to some of the largest companies in the world, who are focused on executing AI-centric software development at scale. This role is about building trusted…

P-1607 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and…