LS
Cambridge, MA USA, United States
$232K – $360K/yr
Artificial IntelligenceAIRecruitment
LS
Active1d ago
Associate Director/Director, Inference Engineering
Role overview
Job description
Your Impact at LILA Lila is hiring an Associate Director/Director, Inference Engineering to lead the team responsible for Lila's model serving platform: the inference APIs, serving frameworks, request routing, batching strategies, and deployment systems that bring models reliably to production. You will define how Lila serves models at scale, balancing latency, throughput, quality, and cost, and act as the technical authority connecting research and ML to production-grade serving capabilities. The work spans people leadership, service ownership, cross-functional partnership, and deep technical judgment in modern LLM serving. What You'll Be Building Own the inference service end to end: API contracts, latency SLAs, throughput guarantees, rate limits Drive serving architecture decisions: batching, KV cache, speculative decoding, quantization, multi-node deployment Establish SLOs for latenc
…About this listing
- Source: Lila Sciences's official careers site (via Greenhouse) · last confirmed on the source 27 Oct 2026
- Posted 26 Oct 2026
Jobiba does not charge job seekers. Never pay to apply or share OTPs, card or bank details.
What they are looking for
Skills & requirements
Qualification
The work spans people leadership, service ownership, cross-functional partnership, and deep technical judgment in modern LLM serving; If this sounds like an environment you'd love to work in, even if you don't meet every qualification listed above, we encourage you to apply
Department · Software
Hiring company
Lila Sciences
LILA has created the world's first Operating System for Science powered by Scientific Superintelligence™
Related opportunities
Similar active roles
Relevant, currently active roles for this market.
LS
Cambridge, MA USA, United States
$136.8K – $217.9K/yr
AILogisticsWarehouseRecruitment
LS
Cambridge, MA USA, United States
$108K – $186.7K/yr
AIRecruitment
C
16 days ago
Cambridge, United States
ExcelCustomer Service
C
7 days ago
Cambridge, Cambridge, United States
ExcelCustomer Service
CH
6 days ago
Cambridge, Massachusetts, United States
ExcelCustomer Service
🔔 Get job alerts
New Director Director jobs in Cambridge, Ma Usa, United States, straight to your inbox.
No spam · Unsubscribe anytime