←Jobiba.Me
TA
Active2d ago

(Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure

Together AI·📍 San Francisco

Employment

Full-Time

Work mode

On-site

Experience

SENIOR LEVEL

Salary

$250K – $320K/yr

Role overview

Job description

About The Role We're looking for a software engineer, reliability-minded but still a builder, to own what happens in production to the Kubernetes-native control plane that provisions and runs our GPU inference fleet. The platform team builds the manifest-driven API and controllers that let the inference team declare what they need, a cluster, a model deployment, a capacity change, and get it reconciled underneath. Your job is to keep that promise true in the real world: triaging InfiniBand issues when prefill and decode nodes stall exchanging KV cache over RDMA, diagnosing hero-model and LoRA-serving faults that don't show up in generic health checks, and extending the automated self-healing system so each new failure mode becomes a permanent fix instead of a recurring page. The core value we're after is keeping the decoupling real even when things break, and keeping the fleet efficient

…

About this listing

  • Listed from Together AI's careers site via Greenhouse · last confirmed on the source 23 Oct 2026
  • Posted 20 Oct 2026

Jobiba does not charge job seekers. Never pay to apply or share OTPs, card or bank details.

What they are looking for

Skills & requirements

Department · Engineering

Hiring company

Together AI

Technology

Own Together-Ai.com today. Secure checkout and guided transfer support. No hidden fees.

Related opportunities

Similar active roles

Relevant, currently active roles for this market.

All jobs →
SA
San Francisco, California, United States· Full-time

$250K – $350K/yr

🔔 Get job alerts

New (Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure jobs in San Francisco, straight to your inbox.

No spam · Unsubscribe anytime