←Jobiba.Me
TA
Active4w ago

Machine Learning Engineer - Inference

Together AI·📍 San Francisco

Employment

Full-Time

Work mode

On-site

Experience

MID LEVEL

Salary

$200K – $300K/yr

Role overview

Job description

About the Role Together AI is seeking a Machine Learning Engineer to join our Inference Engine team, focusing on optimizing and enhancing the performance of our AI inference systems. This role involves working with state-of-the-art large language models models and ensuring they run efficiently and effectively at scale. If you are passionate about AI inference, PyTorch, and developing high-performance systems, we want to hear from you. This position offers the chance to collaborate closely with AI researchers and engineers to create cutting-edge AI solutions. Join us in shaping the future at Together AI! Responsibilities Design and build the production systems that power the Together AI inference engine, enabling reliability and performance at scale. Develop and optimize runtime inference services for large-scale AI applications. Collaborate with researchers, engineers, product managers,

…

What they are looking for

Skills & requirements

Qualification

Requirements 3+ years of experience writing high-performance, well-tested, production-quality code; Preferred: Knowledge of existing AI inference systems such as TGI, vLLM, TensorRT-LLM, Optimum Preferred: Knowledge of AI inference techniques such as speculative decoding

Department · Research

Together AI logo

Hiring company

Together AI

Own Together-Ai.com today. Secure checkout and guided transfer support. No hidden fees.

Related opportunities

Similar active roles

Relevant, currently active roles for this market.

All jobs →
M
San Francisco, California, United States· Full-time

$290K – $302K/yr

B
San Francisco, California, United States· Full-time· Remote

$190K – $300K/yr

B
San Francisco, California, United States· Full-time· Remote

$165K – $330K/yr

B
San Francisco, California, United States· Full-time· Remote

$165K – $330K/yr

B
San Francisco, California, United States· Full-time· Remote

$165K – $330K/yr

O
San Francisco, California, United States· Full-time

🔔 Get job alerts

New Machine Learning Engineer - Inference jobs in San Francisco, straight to your inbox.

No spam · Unsubscribe anytime