Senior Machine Learning Engineer, Computer Vision/VLM
Senior Machine Learning Engineer, Computer Vision/VLM
Senior Machine Learning Engineer, Computer Vision/VLM
Waymo
Waymo is seeking a Senior Machine Learning Engineer specializing in Computer Vision and Vision-Language Models (VLM) to join their Semantics team. The role involves developing advanced models for autonomous driving technology, focusing on offboard perception autolabels and integrating AI frameworks to enhance the Waymo Driver's capabilities.
Qualification
- Master’s degree in Computer Science or a related technical field.
- 4+ years of hands-on experience training and shipping deep learning models.
- Strong background in computer vision and deep learning techniques.
- Experience with reinforcement learning and fine-tuning methodologies.
- Familiarity with large foundation models and their integration into AI systems.
Responsibility
- Develop and train state-of-the-art computer vision/multimodal models to extract rich semantic information required by the AI agent.
- Design and implement a scalable AI agent framework integrating large foundation models with perception model outputs and internal knowledge bases.
- Develop and apply Fine-tuning and Reinforcement Learning techniques to improve the system's captioning and reasoning abilities through automated feedback.
- Prototype novel prompting strategies for Vision-Language Models to elicit complex reasoning about driving scenarios.
- Collaborate with ML Infra, Perception, Behavior, and AI Foundation teams to define data requirements and integrate the captioning system into the ML development lifecycle.
- Own the full system lifecycle from model development and prototyping to production deployment and scaling for massive data generation.
