$200K – $400K/yr
Open for applications
Member of Technical Staff, Inference
- Pay · Jobiba estimate
- $220,000–$300,000 / yearFor comparable Member of Technical Staff roles in United States. Estimated from 306 similar postings (high confidence) — not stated by the employer. Salary data
- Job type
- Full-time
- Work mode
- Remote
- Experience
- Senior level
In this ad
- Visa sponsorshipThe ad says the employer provides it
- Medical insuranceListed as a benefit
About the job
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
About the Role
- We're looking for an inference runtime engineer to push the boundaries of what's possible in LLM and diffusion model serving.
- Models grow larger.
- Architectures shift: mixture-of-experts, multimodal, agentic.
- Every breakthrough demands innovations on the inference engine itself.
- You'll work at the core of vLLM, optimizing how models execute across diverse hardware and architectures.
- Your work will directly impact how the world runs AI inference.
Skills and Qualifications
- Minimum qualifications: Bachelor's degree or equivalent experience in computer science, engineering, or similar.
- Deep understanding of transformer architectures and their variants.
- Strong programming skills in Python with experience in PyTorch internals.
- Experience with LLM inference systems (vLLM, TensorRT-LLM, SGLang, TGI).
- Ability to read and implement model architectures and inference techniques from research papers.
- Demonstrate the ability to contribute performant and maintainable code and debug in complex ML codebases.
- Preferred qualifications: Deep understanding of KV-cache memory management, prefix caching, and hybrid model serving.
- Familiarity with RL frameworks and algorithms for LLMs.
- Experience with multimodal inference (audio/image/video/text).
- Contributions to open-source ML or system infrastructure projects.
- Bonus points if you have: Implemented core features in vLLM or other inference engine projects.
- Contributed to vLLM integrations (verl, OpenRLHF, Unsloth, LlamaFactory, etc).
- Written widely-shared technical blogs or side projects on vLLM or LLM inference.
- Logistics Location: Fully remote, worldwide.
- We're timezone-flexible but expect regular overlap with Pacific Time for critical syncs.
- Compensation: We offer competitive compensations (salary + equity) compared to the local market conditions.
- Visa sponsorship: We sponsor visas on a case-by-case basis.
- Benefits: Inferact offers competitive benefits appropriate to your location, including health coverage where applicable.
Skills in this ad
Qualification · Bachelor's degree or equivalent experience in computer science, engineering, or similar. Deep understanding of transformer architectures and their variants. Strong programming skills in Python with experience in PyTorch internals. Experience with LLM inference systems (vLLM, TensorRT-LLM, SGLang, TGI). Ability to read and implement model architectures and inference techniques from research papers. Demonstrate the ability to contribute performant and maintainable code and debug in complex ML codebases. Preferred
Department · Research & Engineering
More like this
Inferact
Transportation & Logistics
Similar jobs
All jobs$170K – $265K/yr
● Strong current hiring demand for this role
$150K – $350K/yr
● Strong current hiring demand for this role
$150K – $390K/yr
● Strong current hiring demand for this role
$220K – $300K/yr
● Strong current hiring demand for this role
$220K – $485K/yr
● Top 10% pay versus similar roles
305 live Member of Technical Staff jobs in the United States260 added in the last 30 days
See Member of Technical Staff jobsMember of Technical Staff payCareer pathCheck my market payJobs that ask for a bachelor's degreeRoles in demandTailor your CV for this job
About this listing
- Source: Inferact's official careers site · still listed there on 16 Nov 2026
- Posted 4 Sept 2026
Jobiba never charges you to apply. Never pay to apply or share OTPs, card or bank details.