Applying for Product Engineer at LiteLLM? Compare this live job with your resume first.

🎯 Tailor my resume
←Jobiba.Me
L
Active4mo ago

Product Engineer

LiteLLM·📍 San Francisco, California, United States

Employment

FULL TIME

Work mode

On-site

Experience

Not stated

Salary

$200K – $260K/yr

Pay vs market · Near median

This job's pay ($230,000 a year at the midpoint) is higher than about 50% of 12 salary-listed Product Engineer jobs in San Francisco in the last 12 months; their median is $222,500.

Salary data →

Role overview

Job description

Product Engineer LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product. We're looking for a Product Engineer who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day. About the Role This isn't a traditional product management role, and it isn't a traditional software engineering role. You'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product. If you enjoy owning a problem end-to-end—from idea to production—you'll thrive here. Responsibilities Build new product features from concept to production. Work directly with customers to understand pain points and validate solutions. Ship quickly while maintaining a high quality bar. Prototype new ideas and iterate based on user feedback. Own major product areas and continuously improve them over time. Design backend APIs and services using Python and FastAPI. Build intuitive developer experiences across our API, dashboard, and CLI. Collaborate directly with the founders on product direction and technical decisions. Help define and build LiteLLM's second major product. What We're Looking For Bachelor's or Master's degree in Computer Science or a related field. Strong software engineering fundamentals. Experience building production software, preferably with Python. Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs). Strong product intuition and curiosity about how customers use software. Excellent written and verbal communication. High ownership—you naturally identify problems and solve them without waiting to be asked. Comfortable operating in ambiguity and making decisions with incomplete information. Excited by shipping quickly and learning from real users. Bonus Points Experience at an early-stage startup. Experience building developer tools or infrastructure products. Open source contributions. You've built and launched your own product. Familiarity with AI infrastructure, LLMs, or developer platforms. Why Join LiteLLM? Work directly with the founders every day. Build products used by thousands of engineering teams around the world. Own meaningful product decisions—not just implementation. Move incredibly fast and see your work in production immediately. Help define the future of AI infrastructure and developer tooling. Competitive salary, equity, health, dental, and vision benefits. About LiteLLM LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production. If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.

More like this

About this listing

  • Source: LiteLLM's official careers site · still listed there on 9 Nov 2026
  • Posted 10 Jul 2026

Jobiba does not charge job seekers. Never pay to apply or share OTPs, card or bank details.

Role market pulse

How Product Engineer demand looks in United States

65/100 · rising

Live jobs

84

Posted 30d

74

30d movement

+2366.7%

Remote share

29.8%

Salary listed

84.5%

Salary trend 1Y

Not enough history

What they are looking for

Skills & requirements

Qualification

What We're Looking For Bachelor's or Master's degree in Computer Science or a related field; We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems

Department · Product

Hiring company

LiteLLM

Education

Put your full AI stack behind one key. Track and cap LLM spend, route to the right model, and self-host anywhere — even air-gapped. 140+ providers, 1,892 models, 60K+ GitHub stars.

Related opportunities

Similar active roles

Relevant, currently active roles for this market.

All jobs →

🔔 Get job alerts

New Product Engineer jobs in San Francisco, California, United States, straight to your inbox.

No spam · Unsubscribe anytime

Jobiba never asks job seekers for money. Stay safe