Applying for Staff Software Engineer - GenAI inference at Databricks? Compare this live job with your resume first.

🎯 Tailor my resume
←Jobiba.Me
D
Active7h ago

Staff Software Engineer - GenAI inference

Databricks·📍 San Francisco, California, United States

Employment

Full-Time

Work mode

On-site

Experience

SENIOR LEVEL

Salary

$190.9K – $232.8K/yr

Role overview

Job description

P-1285 About This Role As a staff software engineer for GenAI inference, you will lead the architecture, development, and optimization of the inference engine that powers Databricks Foundation Model API.. You’ll bridge research advances and production demands, ensuring high throughput, low latency, and robust scaling. Your work will encompass the full GenAI inference stack: kernels, runtimes, orchestration, memory, and integration with frameworks and orchestration systems. What You Will Do Own and drive the architecture, design, and implementation of the inference engine, and collaborate on model-serving stack optimized for large-scale LLMs inference Partner closely with researchers to bring new model architectures or features (sparsity, activation compression, mixture-of-experts) into the engine Lead the end-to-end optimization for latency, throughput, memory efficiency, and hardware ut

…

Role market pulse

How Software Engineer demand looks in United States

77/100 · rising

Live jobs

1,239

Posted 30d

537

30d movement

+60.8%

Remote share

27.5%

Salary listed

73.9%

Salary trend 1Y

Not enough history

What they are looking for

Skills & requirements

Qualification

government license for such positions, and Employer may decline to proceed with an applicant on this basis alone

Department · Engineering - Pipeline

Databricks logo

Hiring company

Databricks

Technology

Databricks offers a unified platform for data, analytics and AI. Build better AI with a data-centric approach. Simplify ETL, data warehousing, governance and AI on the Data + AI Platform.

Related opportunities

Similar active roles

Relevant, currently active roles for this market.

All jobs →
H
San Francisco, California, United States· Full-time· Remote
Above median pay

$231K – $314.4K/yr

● Strong current hiring demand for this role

H
San Francisco, California, United States· Full-time· Remote
Above median pay

$231K – $340K/yr

● Strong current hiring demand for this role

H
San Francisco, California, United States· Full-time· Remote
Above median pay

$231K – $340K/yr

● Strong current hiring demand for this role

O
San Francisco, California, United States
Typical range pay

$194K – $267K/yr

● Strong current hiring demand for this role

O
San Francisco, California, United States
Typical range pay

$194K – $267K/yr

● Strong current hiring demand for this role

O
San Francisco, California, United States
Below typical pay

$139.7K – $209.6K/yr

● Strong current hiring demand for this role

🔔 Get job alerts

New Staff Software Engineer - GenAI inference jobs in San Francisco, California, United States, straight to your inbox.

No spam · Unsubscribe anytime