←Jobiba.Me
TA
Active2mo ago

Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering

Together AI·📍 India

Employment

Full-Time

Work mode

On-site

Experience

SENIOR LEVEL

Salary

Not disclosed

Salary not disclosed

Check market pay for comparable Software Engineer roles before applying.

Salary →

Role overview

Job description

About the Role REMOTE IN INDIA We're looking for a software engineer to build the Kubernetes-native control plane that provisions and runs our GPU inference fleet. You'll design a manifest-driven API where the inference team declares what they need, whether that's a cluster, a model deployment, or a capacity change, and our controllers handle the reconciliation, provider/runtime selection, and lifecycle management underneath, so the inference team never has to know or care which specific serving stack, scheduler, or hardware pool is doing the work. You'll also build the systems that keep the fleet efficient, not just running, including defragmentation and rebalancing logic that consolidates scattered workloads back into contiguous capacity, and scheduling/bin-packing improvements that push GPU utilization up without hurting latency. The core value we're after is decoupling the people bui

…

About this listing

  • Listed from Together AI's careers site via Greenhouse · last confirmed on the source 23 Oct 2026
  • Posted 19 Aug 2026

Jobiba does not charge job seekers. Never pay to apply or share OTPs, card or bank details.

Role market pulse

How Software Engineer demand looks in India

46/100 · steady

Live jobs

319

Posted 30d

108

30d movement

-22.3%

Remote share

5.6%

Salary listed

4.7%

Salary trend 1Y

Not enough history

What they are looking for

Skills & requirements

Department · Engineering

Hiring company

Together AI

Technology

Own Together-Ai.com today. Secure checkout and guided transfer support. No hidden fees.

Related opportunities

Similar active roles

Relevant, currently active roles for this market.

All jobs →

🔔 Get job alerts

New Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering jobs in India, straight to your inbox.

No spam · Unsubscribe anytime