$180K β $450K/yr
β Strong current hiring demand for this role
Applying for Member of Technical Staff, Pretraining Evaluations at Hark? Compare this live job with your resume first.
π― Tailor my resumeβ¦ Jobiba Career OS
Search, compare, prepare, apply and track from one career workflow.

Open for applications
About Hark Hark is an artificial intelligence company building advanced, personalized intelligence. One that is proactive, multimodal, and capable of interacting with the world through speech, text, vision, and persistent memory. We're pairing that intelligence with next-generation hardware to create a universal interface between humans and machines. While today's AI largely operates through chat boxes and decade-old devices, Hark is focused on what comes next: agentic systems that interact naturally with people and the real world. To get there, we're developing multimodal models and next-generation AI hardware together - designed from the ground up as a single, unified interface for a new era of intelligent systems.
Build and maintain an evaluation harness for held-out loss, performance across data domains, and capabilities in text, code, math, and reasoning. Design evaluations for early checkpoints and smaller models using log-likelihood scoring, few-shot prompts, and generated completions. Assess benchmark coverage and saturation, quantify uncertainty in results, and work with data researchers to detect training-data contamination. Version datasets, prompts, graders, and inference settings so results can be reproduced and compared across checkpoints and training runs. Analyze experiments and work with researchers to identify useful recipe changes, select checkpoints, and prioritize capability improvements. Develop new benchmarks for capabilities that existing evaluations do not adequately measure. Extend evaluation tools to image, video, speech, and audio tasks in collaboration with multimodal researchers.
Department Β· AI Foundation Models
Hiring company
At Hark, we are building the most advanced personal intelligence in the world.
$180K β $450K/yr
β Strong current hiring demand for this role
$180K β $450K/yr
β Strong current hiring demand for this role
$180K β $450K/yr
β Strong current hiring demand for this role
$180K β $450K/yr
β Strong current hiring demand for this role
$180K β $450K/yr
β Strong current hiring demand for this role
$255K β $447K/yr
305 live Member of Technical Staff jobs in the United States260 added in the last 30 days
See Member of Technical Staff jobsMember of Technical Staff payCareer pathJobs by degreeRoles in demandTailor your CV for this job
Jobiba never charges you to apply. Never pay to apply or share OTPs, card or bank details.
Jobiba never asks job seekers for money. Stay safe