←Jobiba.Me
TA
Active4w ago

Staff Software Engineer, Inference / Compute Infrastructure Engineering London or Amsterdam

Together AI·📍 London & Amsterdam

Employment

Full-Time

Work mode

On-site

Experience

SENIOR LEVEL

Salary

Not disclosed

Salary not disclosed

Check market pay for comparable Software Engineer roles before applying.

Salary →

Role overview

Job description

About the Role We're looking for a software engineer to build the Kubernetes-native control plane that provisions and runs our GPU inference fleet. You'll design a manifest-driven API where the inference team declares what they need, whether that's a cluster, a model deployment, or a capacity change, and our controllers handle the reconciliation, provider/runtime selection, and lifecycle management underneath, so the inference team never has to know or care which specific serving stack, scheduler, or hardware pool is doing the work. You'll also build the systems that keep the fleet efficient, not just running, including defragmentation and rebalancing logic that consolidates scattered workloads back into contiguous capacity, and scheduling/bin-packing improvements that push GPU utilization up without hurting latency. The core value we're after is decoupling the people building on top of

…

What they are looking for

Skills & requirements

Department · Engineering

Together AI logo

Hiring company

Together AI

Own Together-Ai.com today. Secure checkout and guided transfer support. No hidden fees.

Related opportunities

Similar active roles

Relevant, currently active roles for this market.

All jobs →
S
Menlo Park, California, United States· Full-time
G
Gdansk, Pomeranian Voivodeship, Poland
G
Bristol, United Kingdom
D
Lisbon, Lisbon, Portugal· Full-time
T
Australia· Full-time

$100K – $500K/yr

🔔 Get job alerts

New Staff Software Engineer, Inference / Compute Infrastructure Engineering London or Amsterdam jobs in London & Amsterdam, straight to your inbox.

No spam · Unsubscribe anytime