←Jobiba.Me
TA
Active4w ago

Senior Software Engineer - AI Compute, Together Cloud

Together AI·📍 San Francisco

Employment

Full-Time

Work mode

On-site

Experience

SENIOR LEVEL

Salary

$220K – $270K/yr

Role overview

Job description

About the Role Together AI is building the AI Native Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art GPU cloud infrastructure. The Together Cloud team builds the [Together GPU Clusters](https://www.together.ai/gpu-clusters) flagship IaaS product that provides high-performance, AI-ready GPU clusters through a self-serve cloud console, along with the virtualized infrastructure layer powering Together's inference, RL, and fine-tuning products. As a Senior Software Engineer focusing on AI Compute in the Together Cloud org, you will build and own major components of the next generation AI cloud platform – a highly available, global cloud infrastructure with cutting-edge virtualization of the latest ML hardware: GB300s/VRs, BlueField DPUs, InfiniBand and dual/quad-plane RoCEv2 fabrics. That virtualized computi

…

What they are looking for

Skills & requirements

Qualification

Proficiency with Kubernetes internals, such as implementing non-trivial Kubernetes operators, device/storage/network plugins, custom schedulers, or patches to Kubernetes itself Proficiency with VMs/hypervisors, such as QEMU/KVM, cloud-hypervisor, VFIO, virtio, PCIE passthrough, Kubevirt, SR-IOV Proficiency with DC networking tech + solutions, such as VLAN, VXLAN, VPN, VPC, OVS/OVN Experience with Cluster API or similar Experience working on high-performance compute, networking, and/or storage Experience virtualizing GPUs and/or InfiniBand Experience building IaaS or PaaS systems at scale Experience with DPUs/SmartNICs GPU programming, NCCL, CUDA knowledge About Together AI Together AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month. Compensation We offer comp

Department · Engineering

Together AI logo

Hiring company

Together AI

Own Together-Ai.com today. Secure checkout and guided transfer support. No hidden fees.

Related opportunities

Similar active roles

Relevant, currently active roles for this market.

All jobs →
HI
San Francisco, Canada· Full-time

$140K – $225K/yr

HI
San Francisco, Canada· Full-time

$140K – $225K/yr

HI
San Francisco, Canada· Full-time

$140K – $225K/yr

HI
San Francisco, Canada· Full-time

$140K – $225K/yr

HI
San Francisco, Canada· Full-time

$140K – $225K/yr

HI
San Francisco, Canada· Full-time

C$45 – C$51/hr

🔔 Get job alerts

New Senior Software Engineer - AI Compute, Together Cloud jobs in San Francisco, straight to your inbox.

No spam · Unsubscribe anytime