←Jobiba.Me
TA
Active4w ago

Staff Machine Learning Engineer, Voice AI

Together AI·📍 San Francisco

Employment

Full-Time

Work mode

On-site

Experience

SENIOR LEVEL

Salary

$220K – $280K/yr

Role overview

Job description

About the Role Together AI is building the best inference infrastructure for voice applications. Our Voice AI platform powers production-grade, real-time voice agents and applications — serving speech-to-text and text-to-speech models with best-in-class latency and reliability. We're looking for a Staff ML Engineer to drive the model serving layer for voice workloads. You'll work hands-on with inference engines like TRT-LLM and SGLang to optimize how we serve models like Whisper, Parakeet, Orpheus, and Kokoro — pushing latency and throughput to the frontier. You'll profile GPU utilization, design batching strategies for streaming audio, and ensure new model architectures can go from research to production quickly. This is a foundational hire on a small, high-impact team. Voice inference has unique challenges — streaming audio, tokenization, real-time latency budgets — that require dedica

…

What they are looking for

Skills & requirements

Qualification

You'll work hands-on with inference engines like TRT-LLM and SGLang to optimize how we serve models like Whisper, Parakeet, Orpheus, and Kokoro — pushing latency and throughput to the frontier; You'll shape how Together serves voice models as the industry moves from pipeline architectures (ASR → LLM → TTS) toward end-to-end speech-to-speech; Deep, practical expertise in LLM serving engines (vLLM, SGLang, TensorRT-LLM, or equivalent) — you've modified engine internals, debugged edge cases under load, and contributed improvements back; you don't stop at the API surface; Bachelor's or Master's in Computer Science, Electrical Engineering, or related field — or equivalent depth demonstrated through your work

Department · Engineering

Together AI logo

Hiring company

Together AI

Own Together-Ai.com today. Secure checkout and guided transfer support. No hidden fees.

Related opportunities

Similar active roles

Relevant, currently active roles for this market.

All jobs →
T
San Francisco, California, United States· Full-time

$170K – $225K/yr

P
San Francisco, California, United States· Full-time· Remote

$249.1K – $367.9K/yr

S
San Francisco, California, United States· Full-time· Remote

$240K – $400K/yr

A
San Francisco, California, United States

$212K – $260K/yr

A
San Francisco, California· Full-time

From $212K/yr

P
San Francisco, Canada· Full-time· Remote

🔔 Get job alerts

New Staff Machine Learning Engineer, Voice AI jobs in San Francisco, straight to your inbox.

No spam · Unsubscribe anytime