The Robot Bureau podcast

Teaching Robots With Real Workers' Hands | Maarten Witteveen - MANUS

0:00
25:13
Manda indietro di 15 secondi
Manda avanti di 15 secondi

Maarten Witteveen, co-founder and CTO of MANUS, took his company from VR to entertainment to robotics, where it now makes data gloves that record how human hands work. He was in Los Angeles in 2023 when the actor and writer strikes sent entertainment off a cliff, and MANUS had to reinvent how it does business. In his five-year plan, everybody can wear the gloves for their whole work, and MANUS becomes an end-to-end data collection provider. This conversation explains why MANUS wants robots to learn from skilled people doing their real jobs, and what Maarten thinks that will do to those jobs.


In this interview from The Robot Bureau, Rogier and Lei sit down with Maarten Witteveen, co-founder and CTO of MANUS, at the Humanoid Robots Summit Europe in Stuttgart in September.


Each MANUS glove carries an electromagnetic sensor on every fingertip that measures its position against a source on the glove, and from those five points the software calculates every joint angle and maps the motion onto a robot hand with different proportions. Fine-tuning a robot today usually means teleoperation, by his account, with an expensive robot in the loop, maintenance and a trained pilot, and Maarten would rather record a mechanic with ten years on the job doing the actual work. Video from the data farms of China and India helps with pre-training and carries no kinematics or sense of touch, so MANUS is hiring engineers to build tactile sensors that do not exist yet. Its buyers range from humanoid makers to AI labs such as Google DeepMind, and in his example a carmaker like BMW would train a general purpose humanoid on its own assembly line and keep that data in house.


"We need to re-envision what it means to have a job."


Maarten says MANUS ranks its product against competitors on data quality and comfort. He has tested the top five Chinese gloves he sees and says none hit MANUS's build quality or the comfort needed for eight-hour shifts, though some have added pressure sensing. He says MANUS did get EIC funding from Europe, and he wants European investors to be more gutsy, because in his view Hugging Face is one more company Europe could not keep.


Rogier and Lei cover: why the move from entertainment to robots felt like the same motion capture work on Linux, why MANUS will leave data farms to others, whether AgiBot could build its own gloves, who should own the data a worker's hands produce, and how being mistaken for Manus AI sent a million views to the MANUS website overnight.


Chapters:
00:00 From VR to entertainment to humanoids
02:27 Tactile data and how the glove works
05:19 Who buys the gloves
06:19 Data farms and costly robot pilots
08:35 From glove maker to data provider
12:44 Ahead of cheaper Chinese gloves
15:28 Robot Games gold and AgiBot's own hands
17:02 Workers selling their own hand data
19:35 Who owns the data and the jobs
21:49 Mistaken for Manus AI
23:20 Why Europe can't keep its companies


Watch the video version on YouTube: https://www.youtube.com/watch?v=FQjOhyZ27mY


Follow MANUS
Company website: https://www.manus-meta.com
YouTube: https://www.youtube.com/@ManusMeta


Follow The Robot Bureau
YouTube: https://www.youtube.com/@therobotbureau
Spotify: https://open.spotify.com/show/19Rva9230EwGErD2fg0tQb
Apple Podcasts: https://podcasts.apple.com/podcast/id6812673688
Substack: https://substack.com/@therobotbureau
LinkedIn: https://www.linkedin.com/company/the-robot-bureau
X: https://x.com/therobotbureau
Host Lei Li: https://www.linkedin.com/in/leilibeyondthenow/
Host Rogier Bikker: https://www.linkedin.com/in/rogierbikker/

Altri episodi di "The Robot Bureau"