Senior Machine Learning Engineer - Perception 3D Segmentation

We’re reinventing personal transportation—making the future safer, cleaner, and more enjoyable. We’ve created our vehicle specifically for dense, complicated urban environments. Zoox is the only driving vehicle on the market with bidirectional driving capabilities and four-wheel steering, allowing us to maneuver through compact spaces and change directions without the need to reverse. The future is for riders! Our growing software engineering leadership team is searching for a Senior Manager of Perception. Our perception stack is responsible for building Zoox’s world-class 3D environment model from multi-modal sensor data. We create novel AI architectures that combine the latest academic results with many in-house innovations in creative ways. Our algorithms are relentlessly optimized and tuned to run efficiently and effectively on a wide variety of real-life data as well as in simulation. You will be responsible for leading high-impact Perception teams with their technical roadmap and milestone goals. You will be closely collaborating with other AI and SW leaders, simulation, and our systems design and mission assurance teams to deliver an exceptional dynamic objects perception system encompassing modalities such as vision, lidar, radar and long-wave IR across pipelines such as segmentation, detection, classification, fusion and tracking. You will lead a diverse, experienced team with a rapidly growing scope and responsibility while also working on some of the most complex problems in artificial intelligence, perception, and sensor fusion. In this role, you will: Build and lead a group of managers and engineers, and be responsible for the team’s roadmap, productivity, execution and impact within the company. Set the vision for, grow, and lead a team of talented software engineers in the overall planning, execution, and success of complex technical projects, while providing the team with technical leadership. Collaborate with engineers and

We’re reinventing personal transportation—making the future safer, cleaner, and more enjoyable. We’ve created our vehicle specifically for dense, complicated urban environments. Zoox is the only driving vehicle on the market with bidirectional driving capabilities and four-wheel steering, allowing us to maneuver through compact spaces and change directions without the need to reverse. The future is for riders! Our growing software engineering leadership team is searching for a Director of Perception. Our perception stack is responsible for building Zoox’s world-class 3D environment model from multi-modal sensor data. We create novel AI architectures that combine the latest academic results with many in-house innovations in creative ways. Our algorithms are relentlessly optimized and tuned to run efficiently and effectively on a wide variety of real-life data as well as in simulation. You will be responsible for leading high-impact Perception teams with their technical roadmap and milestone goals. You will be closely collaborating with other AI and SW leaders, simulation, and our systems design and mission assurance teams to deliver an exceptional dynamic objects perception system encompassing modalities such as vision, lidar, radar and long-wave IR across pipelines such as segmentation, detection, classification, fusion and tracking. You will lead a diverse, experienced team with a rapidly growing scope and responsibility while also working on some of the most complex problems in artificial intelligence, perception, and sensor fusion. In this role, you will: Build and lead a group of managers and engineers, and be responsible for the team’s roadmap, productivity, execution and impact within the company. Set the vision for, grow, and lead a team of talented software engineers in the overall planning, execution, and success of complex technical projects, while providing the team with technical leadership. Collaborate with engineers and leade

The Zoox 3D Sensor Simulation team’s work is at the core of creating in-the-loop simulation and high fidelity synthetic data for training and testing autonomous vehicle AI. We are looking for a machine learning professional with experience applying ML to sensor data, such as LiDAR, radar, and cameras. This role lies at the intersection of machine learning and 3D simulation at Zoox, ranging from learned sensor models to neural 3D reconstruction. By improving the realism of simulated sensors (lidar, radar, and cameras), you’ll enable the Zoox robotics autonomy stack to learn, improve, and enhance the mobility of humans. In this role, you will: Design, train, and validate ML models that improve the realism of simulated lidar, radar, and camera data in autonomous vehicle (AV) simulation pipelines. Collaborate with Synthetic Data and HIL Sim teams to integrate 3DGS and NeRF-based 3D reconstruction with simulation of all sensor modalities. Build and curate training datasets from real and simulated sensor data, including GenAI-based data augmentation. Partner with Sim V&V and Perception engineers to define sensor realism metrics and close the sim-to-real gaps with the greatest impact on autonomy. Mentor engineers and interns, and establish best practices for training and deploying ML on Zoox sensor data. Qualifications: 2+ years of prior experience as a Technical Lead 5+ years of experience developing ML models in Python with PyTorch or TensorFlow <

The Zoox 3D Sensor Simulation team’s work is at the core of creating in-the-loop simulation and high fidelity synthetic data for training and testing autonomous vehicle AI. We are looking for a machine learning professional with experience applying ML to sensor data, such as LiDAR, radar, and cameras. This role lies at the intersection of machine learning and 3D simulation at Zoox, ranging from learned sensor models to neural 3D reconstruction. By improving the realism of simulated sensors (lidar, radar, and cameras), you’ll enable the Zoox robotics autonomy stack to learn, improve, and enhance the mobility of humans. In this role, you will: Design, train, and validate ML models that improve the realism of simulated lidar, radar, and camera data in autonomous vehicle (AV) simulation pipelines. Collaborate with Synthetic Data and HIL Sim teams to integrate 3DGS and NeRF-based 3D reconstruction with simulation of all sensor modalities. Build and curate training datasets from real and simulated sensor data, including GenAI-based data augmentation. Partner with Sim V&V and Perception engineers to define sensor realism metrics and close the sim-to-real gaps with the greatest impact on autonomy. <li style="font-size: 11pt; font-family: Ar

We’re reinventing personal transportation—making the future safer, cleaner, and more enjoyable. We’ve created our vehicle specifically for dense, complicated urban environments. Zoox is the only driving vehicle on the market with bidirectional driving capabilities and four-wheel steering, allowing us to maneuver through compact spaces and change directions without the need to reverse. The future is for riders! Our growing Perception team is searching for an Engineering Manager for the Perception Occupancy and Rare Events team. Our perception stack is responsible for building Zoox’s world-class 3D environment model from multi-modal sensor data. We create novel AI architectures that combine the latest academic results with many in-house innovations in creative ways. Our algorithms are relentlessly optimized and tuned to run efficiently and effectively on a wide variety of real-life data as well as in simulation. You will be responsible for leading high-impact Perception teams with their technical roadmap and milestone goals. You will be closely collaborating with other AI teams including Simulation, Sensor and Hardware, and Systems Design and Mission Assurance teams to deliver an exceptional objects occupancy perception system encompassing modalities such as vision, lidar, radar and long-wave IR. You will lead a diverse, experienced team with a rapidly growing scope and responsibility while also working on some of the most complex problems in artificial intelligence, perception, and sensor fusion. In this role, you will: Lead Technical Strategy: Build and lead a team of managers and engineers responsible for core occupancy modeling and rare event detection, driving the team’s roadmap, productivity, and execution. Drive Model Evolution: Own the development and deployment of critical perception models, overseeing the consolidation of multi-modal architectures and guiding technical design to enhance detection range, rob

As a Perception Engineer, you will be instrumental in designing and implementing cutting-edge detection models, utilizing fused sensor data. In particular, the role will be on advanced projects that are aimed at the next generation of driving software, including looking at joint detection and tracking models as well as ways to send rich embeddings to downstream models to relay semantic meaning and capture uncertainty. This role offers a unique opportunity to directly impact Zoox's expansion into new areas. By developing more generalizable and adaptable models, you will help us navigate diverse and challenging circumstances, accelerating our mission to deliver safe and reliable autonomous mobility. We are looking for a highly motivated individual passionate about pushing the boundaries of perception in the autonomous vehicle space. In this role, you will: Train ML models, perform various studies into incorporating SOTA approaches as well as ablations/modifications of existing models Document experimental outcomes and drive towards deploying these models into Zoox robots Visualize your data at the input and output to understand the issues Collaborate with teams such as ML optimization, data labeling, metrics and planner to ensure project is successful for Zoox releases Qualifications MS/PhD in Computer Science or related field Experience with PyTorch or related ML frameworks Experience deploying learned models into production Excellent collaboration and teamwork skills with proven track record of working on large-scale problems Bonus Qualifications Prior experience in the AV or related space with joint detection and tracking models Deep understanding of how to setup end-to-end training and evaluation processes About Zoox Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting a