I
San Francisco, California, United States· Full-time
$200K – $400K/yr
PythonAIC++Logistics
I
Active4mo ago
Member of Technical Staff, TPU Performance Engineering
Role overview
Job description
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware, a position that took years to build. About the Role We're looking for a TPU performance engineer to make vLLM a first-class inference engine on Google TPUs. You'll build and optimize TPU backends, compiler integrations, runtime paths, and benchmarking infrastructure using JAX, XLA, Pallas, and related tooling so vLLM can deliver frontier inference performance on TPU hardware. You'll work at the boundary of inference systems, kernels, compilers, and hardware architecture, improving production-relevant model serving on TPU with clear correctness, latency, and throughput benchmarks. Your work will help make TPU support in vLLM usable, fast, benchmarked,
…About this listing
- Source: Inferact's official careers site (via Ashby) · last confirmed on the source 31 Oct 2026
- Posted 17 Jun 2026
Jobiba does not charge job seekers. Never pay to apply or share OTPs, card or bank details.
What they are looking for
Skills & requirements
machine learningailogistics
Qualification
Bachelor's degree or equivalent experience in computer science, engineering, systems, machine learning, or similar. Hands-on experience building or optimizing TPU workloads using JAX, XLA, Pallas, or related compiler and runtime tooling. Deep understanding of TPU execution, memory behavior, compilation, and performance constraints for ML workloads. Experience optimizing ML kernels or inference paths such as attention, GEMM, sampling, KV cache, fused kernels, or backend runtime paths. Strong performance profiling and benchmarking skills, with the ability to use measurements, compiler artifacts, correctness tests, and reproducible benchmarks to guide optimization work. Preferred
Department · Research & Engineering
Hiring company
Inferact
Transportation & Logistics
View the company profile, current openings and hiring details.
Related opportunities
Similar active roles
Relevant, currently active roles for this market.
I
San Francisco, California, United States· Full-time
$200K – $400K/yr
PythonKubernetesLinuxAI
D
San Francisco, CA, United States· Full-time
$185K/yr
TypeScriptPythonAI
P
San Francisco, California, United States· Full-time· Remote
$220K – $405K/yr
PythonAWSAzureGCP
P
San Francisco, California, United States· Full-time· Remote
$200K – $350K/yr
PythonSQLMachine Learning
P
San Francisco, California, United States· Full-time· Remote
$200K – $400K/yr
TypeScriptMachine LearningAIKotlin
🔔 Get job alerts
New Member of Technical Staff jobs in San Francisco, California, United States, straight to your inbox.
No spam · Unsubscribe anytime