←Jobiba.Me
TA
Active15h ago

Research Intern, Frontier Speculative Decoding (Winter 2027)

Together AI·📍 San Francisco

Employment

Full-Time

Work mode

On-site

Experience

ENTRY LEVEL

Salary

$58 – $70/hr

Role overview

Job description

About the Role The Speculative Decoding team at Together AI builds the draft models and algorithms that let large language models generate faster without changing their outputs. Our speculators run in production on frontier open models such as DeepSeek, Kimi and GLM. Our work sits at the intersection of model training, inference algorithms and serving systems, and we co-design all three to lower the cost and latency of generation. As a research intern, you will dive into open questions in speculative decoding: new drafter architectures and verification schemes, knowledge distillation and training recipes that align draft and target models, and drafters that adapt as traffic shifts. You will train and fine-tune draft models at scale on dedicated GPU clusters, and test your ideas against realistic serving workloads, including long-context and agentic traffic. Projects aim to answer importa

…

What they are looking for

Skills & requirements

Qualification

Implement optimized version for serving engines to show efficacy in real world workloads Communicate the plans, progress, and results of projects to the broader team Share findings through technical write-ups and blog posts, and help bring successful ideas into production Requirements Currently pursuing a Master's or Ph.D

Department · Research

Together AI logo

Hiring company

Together AI

Own Together-Ai.com today. Secure checkout and guided transfer support. No hidden fees.

Related opportunities

Similar active roles

Relevant, currently active roles for this market.

All jobs →
D
San Francisco, California, United States

$54 – $60/hr

C
San Francisco, CA, Canada· Hybrid

$60 – $60/hr

L
San Francisco, California, United States

$65 – $68/hr

N
San Francisco, California, United States· Full-time

From $55/hr

D
San Francisco, California, United States

$34 – $42/hr

L
San Francisco, California, United States

$58 – $62/hr

🔔 Get job alerts

New Research Intern, Frontier Speculative Decoding (Winter 2027) jobs in San Francisco, straight to your inbox.

No spam · Unsubscribe anytime