$180K β $450K/yr
β Strong current hiring demand for this role
Applying for Member of Technical Staff, Distributed Training Performance at Hark? Compare this live job with your resume first.
π― Tailor my resumeβ¦ Jobiba Career OS
Search, compare, prepare, apply and track from one career workflow.

Open for applications
About Hark Hark is an artificial intelligence company building advanced, personalized intelligence. One that is proactive, multimodal, and capable of interacting with the world through speech, text, vision, and persistent memory. We're pairing that intelligence with next-generation hardware to create a universal interface between humans and machines. While today's AI largely operates through chat boxes and decade-old devices, Hark is focused on what comes next: agentic systems that interact naturally with people and the real world. To get there, we're developing multimodal models and next-generation AI hardware together - designed from the ground up as a single, unified interface for a new era of intelligent systems.
The Omni team at Hark is building the next generation of AI experiences beyond text, enabling models to understand and generate content across multiple modalities, including text, audio, and beyond. Our goal is to create seamless, real-time multimodal intelligence that powers intuitive and immersive user experiences. As part of the Omni team, you'll improve the performance of Hark's Megatron-based pretraining systems across thousands of GPUs. The role focuses on model FLOPs utilization (MFU), training throughput, and the performance of kernels, communication, and parallelism strategies. You'll work with researchers to support new architectures and with infrastructure engineers to resolve bottlenecks, maintain numerical stability, and keep large runs reliable.
Own MFU and step time for pretraining runs across dense and mixture-of-experts models, setting targets per model size and tracking them across runs. Write or integrate fused and custom kernels (CUDA, Triton, CUTLASS) for attention, normalization, and mixture-of-experts routing. Overlap communication with compute, reduce pipeline bubbles, and tune activation recomputation and memory use to raise throughput per GPU. Implement model and optimizer sharding, and optimize data, tensor, pipeline, sequence, context, and expert parallelism for dense and mixture-of-experts architectures. Profile GPU kernels, collective communication, data loading, and mixed-precision training to identify performance and numerical stability bottlenecks. Develop reusable training components that support new architectures and multimodal encoders for speech, vision, and text. Investigate performance regressions and training failures involving communication, numerical changes, hardware faults, or straggling nodes. Work with architecture researchers and compute infrastructure engineers to align model designs, training software, and cluster capabilities. Improve checkpointing, restart time, failure detection, and observability to reduce lost training work. Participate in on-call support during large runs.
Department Β· AI Foundation Models
Hiring company
At Hark, we are building the most advanced personal intelligence in the world.
$180K β $450K/yr
β Strong current hiring demand for this role
$180K β $450K/yr
β Strong current hiring demand for this role
$180K β $450K/yr
β Strong current hiring demand for this role
$180K β $450K/yr
β Strong current hiring demand for this role
$180K β $450K/yr
β Strong current hiring demand for this role
$255K β $447K/yr
309 live Member of Technical Staff jobs in the United States297 added in the last 30 days
See Member of Technical Staff jobsMember of Technical Staff payCareer pathJobs by degreeRoles in demandTailor your CV for this job
Jobiba never charges you to apply. Never pay to apply or share OTPs, card or bank details.
Jobiba never asks job seekers for money. Stay safe