←Jobiba.Me
TA
Active4w ago

[Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering

Together AI·📍 San Francisco

Employment

Full-Time

Work mode

On-site

Experience

ENTRY LEVEL

Salary

$160K – $280K/yr

Role overview

Job description

About the Role We're looking for a software engineer to build the Kubernetes-native control plane that provisions and runs our GPU inference fleet. You'll design a manifest-driven API where the inference team declares what they need, whether that's a cluster, a model deployment, or a capacity change, and our controllers handle the reconciliation, provider/runtime selection, and lifecycle management underneath, so the inference team never has to know or care which specific serving stack, scheduler, or hardware pool is doing the work. You'll also build the systems that keep the fleet efficient, not just running, including defragmentation and rebalancing logic that consolidates scattered workloads back into contiguous capacity, and scheduling/bin-packing improvements that push GPU utilization up without hurting latency. The core value we're after is decoupling the people building on top of

…

What they are looking for

Skills & requirements

Department · Engineering

Together AI logo

Hiring company

Together AI

Own Together-Ai.com today. Secure checkout and guided transfer support. No hidden fees.

Related opportunities

Similar active roles

Relevant, currently active roles for this market.

All jobs →
V
San Francisco, Canada· Full-time

$150K – $240K/yr

F
San Francisco, California, United States· Full-time

$206.2K – $252K/yr

O
San Francisco, California, United States· Full-time
P
San Francisco, California, United States· Full-time· Remote

$190.8K – $262.8K/yr

O
San Francisco, California, United States· Full-time
O
San Francisco, California, United States· Full-time

🔔 Get job alerts

New [Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering jobs in San Francisco, straight to your inbox.

No spam · Unsubscribe anytime