$220K – $405K/yr
(Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure
Role overview
Job description
About The Role We're looking for a software engineer, reliability-minded but still a builder, to own what happens in production to the Kubernetes-native control plane that provisions and runs our GPU inference fleet. The platform team builds the manifest-driven API and controllers that let the inference team declare what they need, a cluster, a model deployment, a capacity change, and get it reconciled underneath. Your job is to keep that promise true in the real world: triaging InfiniBand issues when prefill and decode nodes stall exchanging KV cache over RDMA, diagnosing hero-model and LoRA-serving faults that don't show up in generic health checks, and extending the automated self-healing system so each new failure mode becomes a permanent fix instead of a recurring page. The core value we're after is keeping the decoupling real even when things break, and keeping the fleet efficient
…About this listing
- Listed from Together AI's careers site via Greenhouse · last confirmed on the source 23 Oct 2026
- Posted 20 Oct 2026
Jobiba does not charge job seekers. Never pay to apply or share OTPs, card or bank details.
What they are looking for
Skills & requirements
Department · Engineering
Hiring company
Together AI
Own Together-Ai.com today. Secure checkout and guided transfer support. No hidden fees.
Related opportunities
Similar active roles
Relevant, currently active roles for this market.
$232K – $290K/yr
$288K – $360K/yr
$302.4K – $378K/yr
$250K – $350K/yr
🔔 Get job alerts
New (Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure jobs in San Francisco, straight to your inbox.
No spam · Unsubscribe anytime