$252K – $362K/yr
(Staff / Senior Staff) AI Inference Reliability Engineer, Compute Infra
Role overview
Job description
About The Role We're looking for a software engineer, reliability-minded but still a builder, to own what happens in production to the Kubernetes-native control plane that provisions and runs our GPU inference fleet. The platform team builds the manifest-driven API and controllers that let the inference team declare what they need, a cluster, a model deployment, a capacity change, and get it reconciled underneath. Your job is to keep that promise true in the real world: triaging InfiniBand issues when prefill and decode nodes stall exchanging KV cache over RDMA, diagnosing hero-model and LoRA-serving faults that don't show up in generic health checks, and extending the automated self-healing system so each new failure mode becomes a permanent fix instead of a recurring page. The core value we're after is keeping the decoupling real even when things break, and keeping the fleet efficient
…About this listing
- Source: Together AI's official careers site (via Greenhouse) · last confirmed on the source 28 Oct 2026
- Posted 20 Oct 2026
Jobiba does not charge job seekers. Never pay to apply or share OTPs, card or bank details.
What they are looking for
Skills & requirements
Department · Engineering
Hiring company
Together AI
Own Together-Ai.com today. Secure checkout and guided transfer support. No hidden fees.
Related opportunities
Similar active roles
Relevant, currently active roles for this market.
$405K – $485K/yr
$164.7K – $339.1K/yr
$177.7K – $266.5K/yr
🔔 Get job alerts
New AI Inference Reliability Engineer jobs in San Francisco, straight to your inbox.
No spam · Unsubscribe anytime