Machine Learning Engineer - 3D Sensor Simulation

Zoox is hiring a Machine Learning Engineer for the 3D Sensor Simulation team to build ML models and pipelines that raise the realism of simulated lidar, radar, and camera data for autonomous vehicle training and testing.

Responsibilities

• Design, train, and validate ML models that enhance the realism of simulated lidar, radar, and camera inputs used in AV simulation pipelines.
• Work with Synthetic Data and HIL Sim teams to integrate 3DGS and NeRFs-based 3D reconstruction while simulating multiple sensor modalities.
• Create and curate training datasets from real and simulated sensor data, including GenAI-based data augmentation.
• Partner with Sim V&V and Perception engineers to define sensor realism metrics and target sim-to-real gaps with the biggest autonomy impact.
• Mentor engineers and interns, and establish best practices for training and deploying ML using Zoox sensor data.

Requirements

• 3+ years of experience developing ML models in Python with PyTorch or TensorFlow.
• Industry experience applying ML to sensor data (lidar, radar, and/or cameras).
• Strong understanding of customizing, tuning, and validating ML training pipelines.

Technologies

• Python
• PyTorch
• TensorFlow
• 3DGS
• NeRFs
• GenAI-based data augmentation
• Diffusion
• Flow matching
• VAEs

Benefits

• Paid time off (e.g., sick leave, vacation, bereavement)
• Unpaid time off
• Zoox Stock Appreciation Rights
• Amazon RSUs
• Health insurance
• Long-term care insurance
• Long-term and short-term disability insurance
• Life insurance
• A sign-on bonus may be offered as part of the compensation package

Bonus Qualifications

• Experience with generative techniques such as diffusion, flow matching, or VAEs.
• Experience with 3D reconstruction (3DGS, NeRFs) or differentiable rendering.
• Prior experience developing autonomy in AVs or other robotics and computer vision.

Compensation

• Base salary range: USD 189,000 - 283,000 per year.
• Compensation includes three major components: salary, Amazon Restricted Stock Units (RSUs), and Zoox Stock Appreciation Rights.
• A sign-on bonus may be offered as part of the compensation package.
• The listed range applies only to base salary.
• Compensation varies based on geographic location and level.
• Leveling and positioning within a level depend on factors including relevant years of experience, domain knowledge, and interview performance.
• The posted salary range is representative of the range of levels Zoox is considering for this position.

Accommodation

If you need an accommodation to participate in the application or interview process, contact [email protected] or your assigned recruiter.

Application Note

• You do not need to match every listed expectation to apply.
• Zoox may use AI tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information.
• Final hiring decisions are made by humans.
• For more information about data processing, contact Zoox.