I
San Francisco, California, United States· Full-time
$200K – $400K/yr
PythonKubernetesLinuxAI
I
Active4mo ago
Member of Technical Staff, AMD GPU Performance Engineering
Role overview
Job description
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware, a position that took years to build. About the Role We're looking for an AMD GPU performance engineer to make vLLM a first-class inference engine across the AMD accelerator ecosystem. You'll build and optimize AMD GPU backends, kernels, runtime paths, and benchmarking infrastructure using ROCm, HIP, Triton, CK, AITER, and related tooling so vLLM can deliver frontier inference performance on AMD GPUs. You'll work at the boundary of inference systems, kernels, compilers, and hardware architecture, improving performance-critical paths such as attention, GEMM, sampling, KV cache, and communication-heavy operations. Your work will help make AMD GPU suppor
…About this listing
- Source: Inferact's official careers site (via Ashby) · last confirmed on the source 31 Oct 2026
- Posted 26 Jun 2026
Jobiba does not charge job seekers. Never pay to apply or share OTPs, card or bank details.
What they are looking for
Skills & requirements
Qualification
Bachelor's degree or equivalent experience in computer science, engineering, systems, machine learning, or similar. Hands-on experience optimizing AMD GPU workloads using ROCm, HIP, Triton, CK, AITER, or similar AMD ecosystem tools. Deep understanding of AMD GPU execution, memory behavior, toolchains, kernel performance, and backend-specific performance constraints. Experience optimizing ML kernels or inference paths such as attention, GEMM, sampling, KV cache, fused kernels, or communication-heavy runtime paths. Strong performance profiling and benchmarking skills, with the ability to use measurements, hardware counters, correctness tests, and reproducible benchmarks to guide optimization work. Preferred
Department · Research & Engineering
Hiring company
Inferact
Transportation & Logistics
View the company profile, current openings and hiring details.
Related opportunities
Similar active roles
Relevant, currently active roles for this market.
I
San Francisco, California, United States· Full-time
$200K – $400K/yr
PythonAIC++Logistics
D
San Francisco, CA, United States· Full-time
$185K/yr
TypeScriptPythonAI
P
San Francisco, California, United States· Full-time· Remote
$220K – $405K/yr
PythonAWSAzureGCP
P
San Francisco, California, United States· Full-time· Remote
$200K – $350K/yr
PythonSQLMachine Learning
P
San Francisco, California, United States· Full-time· Remote
$200K – $400K/yr
TypeScriptMachine LearningAIKotlin
🔔 Get job alerts
New Member of Technical Staff jobs in San Francisco, California, United States, straight to your inbox.
No spam · Unsubscribe anytime