Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering
Salary not disclosed
Check market pay for comparable Software Engineer roles before applying.
Role overview
Job description
About the Role REMOTE IN INDIA We're looking for a software engineer to build the Kubernetes-native control plane that provisions and runs our GPU inference fleet. You'll design a manifest-driven API where the inference team declares what they need, whether that's a cluster, a model deployment, or a capacity change, and our controllers handle the reconciliation, provider/runtime selection, and lifecycle management underneath, so the inference team never has to know or care which specific serving stack, scheduler, or hardware pool is doing the work. You'll also build the systems that keep the fleet efficient, not just running, including defragmentation and rebalancing logic that consolidates scattered workloads back into contiguous capacity, and scheduling/bin-packing improvements that push GPU utilization up without hurting latency. The core value we're after is decoupling the people bui
…About this listing
- Listed from Together AI's careers site via Greenhouse · last confirmed on the source 23 Oct 2026
- Posted 19 Aug 2026
Jobiba does not charge job seekers. Never pay to apply or share OTPs, card or bank details.
Role market pulse
How Software Engineer demand looks in India
Live jobs
319
Posted 30d
108
30d movement
-22.3%
Remote share
5.6%
Salary listed
4.7%
Salary trend 1Y
Not enough history
What they are looking for
Skills & requirements
Department · Engineering
Hiring company
Together AI
Own Together-Ai.com today. Secure checkout and guided transfer support. No hidden fees.
Related opportunities
Similar active roles
Relevant, currently active roles for this market.
🔔 Get job alerts
New Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering jobs in India, straight to your inbox.
No spam · Unsubscribe anytime