$254K – $350K/yr
Senior/Staff Software Engineer, ML Training Optimization
Role overview
Job description
- Lead the design, implementation, and operation of training performance optimizations (data/tensor/pipeline parallelism, mixed precision, gradient checkpointing, GPU kernels) to scale VLM, VLA, and Foundation model training.
- Own the technical strategy and multi-quarter roadmap for RL framework and RL performance optimization for driving foundation models.
- Drive profiling and root-cause analysis of throughput bottlenecks across the compute, compiler, framework, and cluster-networking stack.
- Partner with ML researchers, data engineers, and hardware engineers to define requirements and make architectural decisions for large-scale training infrastructure.
- Build custom kernels and benchmarks that track and validate performance gains across the stack.
- Mentor engineers and raise the team’s technical bar through design reviews and best practices.
- 7+ years of total experience, including 4+ years on large-scale model training platforms, with a record of leading projects end to end.
- Deep experience with distributed training frameworks (Megatron-LM, TorchTitan) and efficiently utilizing GPU/accelerator clusters at scale.
- Experience with RL frameworks (Verl/MILES) and algorithms (GRPO, PPO).
- Experience with collective communication libraries (e.g., NCCL) and optimizing communication/compute overlap in multi-node training.
- Strong command of profiling tools (NVIDIA Nsight, PyTorch Profiler, or XLA/JAX profiling) to find and resolve training bottlenecks.
- Proficiency in Python or C++.
- Experience with ML compilers, performance tooling, or hardware/software co-design (GPU/TPU/accelerator architectures).
- Ability to influence across teams and communicate technical tradeoffs to both researchers and engineers.
About this listing
- Listed from Zoox's careers site via Lever · last confirmed on the source 23 Oct 2026
- Posted 16 Oct 2026
Jobiba does not charge job seekers. Never pay to apply or share OTPs, card or bank details.
What they are looking for
Skills & requirements
Department · Software
Hiring company
Zoox
Zoox is a purpose-built autonomous vehicle designed for riders, not drivers. Learn more about the Zoox robotaxi and the future of ride-hailing.
Related opportunities
Similar active roles
Relevant, currently active roles for this market.
$254K – $350K/yr
$254K – $350K/yr
$254K – $350K/yr
$242K – $349K/yr
$242K – $348K/yr
🔔 Get job alerts
New Senior/Staff Software Engineer, ML Training Optimization jobs in Foster City, California, United States, straight to your inbox.
No spam · Unsubscribe anytime