Applying for Senior Machine Learning Engineer at Rubrik Job Board? Compare this live job with your resume first.

🎯 Tailor my resume
←Jobiba.Me
RJ
Active7h ago

Senior Machine Learning Engineer

Rubrik Job Board·📍 Palo Alto, California, United States

Employment

Full-Time

Work mode

On-site

Experience

MID LEVEL

Salary

$188.5K – $282.7K/yr

Role overview

Job description

About the Team & Role: We're building SAGE , Rubrik's Semantic AI Governance Engine, which is the first system designed to monitor, govern, and remediate autonomous AI agents in real time. SAGE powers Rubrik Agent Cloud: enterprises define governance policies in natural language, and SAGE's custom small language models act as judges on every agent action. These models are fast enough to sit in the live request path and accurate enough that customers trust them with allow/block decisions on production traffic. At its core, SAGE is "LLM-as-judge" applied to AI governance, utilizing the same technique most teams use for offline evaluation but productionized for real-time enforcement at enterprise scale. Our first-generation SLM Policy Guard already outperforms the larger frontier models we've benchmarked against on accuracy while running approximately 5x faster on the same workload. We're h

…

Role market pulse

How Machine Learning Engineer demand looks in United States

72/100 · rising

Live jobs

140

Posted 30d

66

30d movement

+144.4%

Remote share

36.4%

Salary listed

85.7%

Salary trend 1Y

Not enough history

What they are looking for

Skills & requirements

Qualification

A Bachelor's degree (or higher) in Computer Science, Machine Learning, Computer Engineering, Statistics, or a closely related technical field is required. Designing production SLM training and serving systems requires a deep theoretical understanding of modern deep learning, optimization, and systems performance. Specialized Technical Knowledge: 2+ years of professional ML experience with demonstrable end-to-end production ownership; you have taken models from training to serving real customer traffic and stayed accountable for them through post-launch iteration. Proficiency in Python and PyTorch (or equivalent) for production-grade training and evaluation. Hands-on experience training, fine-tuning, or distilling language models or classifiers in a production setting, including SFT and at least one preference-optimization technique (DPO, RLAIF, or RLHF). Production experience with serving frameworks (vLLM, SGLang, TensorRT-LLM, or equivalent), including optimization involving continuous batching, KV-cache strategy, and inference-time quantization. Experience designing closed-loop ML systems, including the eval, telemetry, data-curation, and synthetic-data infrastructure that turns

Department · Engineering

RJ

Hiring company

Rubrik Job Board

Technology

At Rubrik, you’ll work with a world-class team that is revolutionizing cloud data management by creating the first platform to orchestrate data for hybrid cloud enterprises anytime, anywhere.

Related opportunities

Similar active roles

Relevant, currently active roles for this market.

All jobs →
RJ
Palo Alto, California, United States

$188.5K – $282.7K/yr

M
Palo Alto, CA, United States· Full-time

$101K – $273K/yr

RJ
Palo Alto, California, United States

$143.2K – $214.8K/yr

P
Palo Alto, California, United States· Full-time· Hybrid

$140K – $200K/yr

S
Palo Alto, California, United States

$125K – $145K/yr

AI
Palo Alto, California, United States

$160K – $230K/yr

🔔 Get job alerts

New Senior Machine Learning Engineer jobs in Palo Alto, California, United States, straight to your inbox.

No spam · Unsubscribe anytime