SEMINAR

Scaling Robot Learning

Speaker

Quan Vuong

Working
Google DeepMind
Timeline
Wed, Dec 27 2023 - 10:00 am (GMT + 7)
About Speaker

Quan Vuong is a researcher in the robotic manipulation team at Google DeepMind. He obtained his Ph.D. from the University of California San Diego with Dr. Henrik Christensen and Dr. Hao Su. He recently led the robotics-transformer-x project, which is a collaboration with 176 researchers across 34 different research labs to build large scale datasets and generalist foundation models for robotics. His works were recently featured on the New York Times, TechCrunch and various other news outlets.

Abstract

In this talk, I will discuss the historical development of the robotic manipulation team at Google and recent efforts to scale robot learning at Google DeepMind. I will begin by describing our model scaling effort, starting with robotics-transformer-1, a scalable architecture for learning low level robotic actions. I will then introduce robotics-transformer-2, our next generation model built on top of vision language models demonstrating the transfer of web knowledge directly to low-level control. Afterwards, I will present our data scaling efforts, robotics-transformer-x, which demonstrates a foundation model for low level robotic control that exhibits positive transfer across datasets from different robotic embodiments. robotics-transformer-x is a collaboration with 34 research labs across 22 different institutions across the world. To end the talk, I will discuss our efforts in going beyond high quality demonstrations, q-transformer for leveraging suboptimal data, and going beyond language as a conditioning modality, including using trajectory and sketches to convey the intended tasks.

Related seminars

Coming soon

Tim Baldwin

MBZUAI, The University of Melbourne

Safe, open, locally-aligned language models
Mon, Dec 16 2024 - 02:00 pm (GMT + 7)
Coming soon

Alessio Del Bue

Italian Institute of Technology (IIT)

From Spatial AI to Embodied AI: The Path to Autonomous Systems
Mon, Dec 16 2024 - 10:00 am (GMT + 7)

Dr. Xiaoming Liu

Michigan State University

Person Recognition at a Distance
Mon, Dec 9 2024 - 10:00 am (GMT + 7)

Dr Lan Du

Monash University

Uncertainty Estimation for Multi-view/Multimodal Data
Fri, Dec 6 2024 - 10:00 am (GMT + 7)