TECH010: The Real Robotics Timeline w/ Ken Goldberg (Tech Podcast)

24 Dec 2025 · 58 min · 14 chapters

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

Ken Goldberg argues that robotics progress is real but timelines for “humanoid robots doing everything soon” are inflated. He contrasts breakthroughs in mobility (legged robots) and drones with the still-hard problem of dexterous manipulation (hands-on tasks requiring reliable sensing, control, and handling of deformable objects). He also introduces a “robot data gap” versus language-model training data, and explains why engineering details and real-world data matter for commercialization.

Guest backgrounds

Ken Goldberg is a long-time robotics researcher (45 years) bridging academic AI and large-scale commercial robotics. He founded/works with Ambi Robotics, focused on warehouse/logistics automation.

Key claims

LLMs don’t automatically yield physical intelligence. Manipulation fails due to subtle sensing/control needs, especially deformation and tactile feedback. Vision-only approaches may help (surgeons use eyes without tactile sensing). Robotics faces ~100,000-year data gap; real deployments help close it. Simple grippers can outperform complex human-like hands.

Notable examples

shoelace/bow-tie tying; robot bin-picking via DexNet (data-driven grasping); Ambi sorting packages (100 million sorted); bags folding causing suction failures; robot surgery as “telerobots/puppets.”

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Chapters

Tap a time to open that second in VO

Understanding the Robotics Landscape

0:45 to 2:00

Discussion on the current state of robotics and AI, highlighting key advancements and challenges.

“expert in this field, as you'll see in the conversation.”

Rodney Brooks' Perspective

2:00 to 4:30

Ken Goldberg shares insights on Rodney Brooks' statement about the field of robotics losing its way.

“And it was an article that was in the New York Times, and it's talking Rodney Brooks has quote unquote said, the field has lost its way.”

Current Advances in Robotics

4:30 to 7:50

Exploration of the significant advancements in mobility and how it contrasts with challenges in manipulation.

“that you see are missing on that particular topic?”

Complexities of Robotic Manipulation

7:50 to 11:40

Ken explains the difficulties associated with robotic manipulation and the nuances of human-like dexterity.

“In fact, there's like 100 different hands that are being produced by different companies in China right now.”

Sensing and Tactile Feedback in Robotics

11:40 to 14:00

Discussion around the importance of tactile sensing and how robots currently replicate human dexterity.

“You'll never see a demo of a robot buttoning up a shirt.”

Exploring Visual-Tactile Interactions in Robotics

14:00 to 24:32

Learn about the importance of visual feedback in robotic manipulation and the challenges faced in replicating human-like tactile sensations.

“of tactile and then using vision, their eyes.”

The Challenges of Robotic Manipulation

28:02 to 39:32

Learn about the complexities in developing robotic hands and manipulation techniques.

“Ken, if you're a program manager, you're kind of looking at all the different swim lanes to get there.”

Adapting Robotics to Real-World Challenges

42:01 to 45:00

Learn how robotics technology is adapting to the complexities of real-world shipping and packaging, focusing on handling bags and monitoring performance.

“And that was something we didn't have a lot of data on.”

The Nuances of Grasping and Simulation

45:01 to 47:20

Explore the challenges of simulating dexterous tasks in robotics and the progress made in grasping objects.

“Or is this something that you think we could simulate in a virtual environment to accelerate that speed or kind of a combo of both?”

Ken Goldberg's Art and AI Perspectives

47:21 to 49:22

Discover Ken Goldberg's dual passion for art and robotics, and how he views AI's role in creativity and innovation.

“You've said your views on AI creativity have changed.”
Show all 14 chapters

Humanoid Robots and Social Dynamics

49:23 to 56:00

Delve into the complexities of humanoid robots in domestic settings, discussing their learning environments and privacy concerns.

“And so your question about the creativity.”

Exploring Privacy in Robotics

56:00 to 57:40

The discussion delves into privacy concerns related to humanoid robots and surveillance.

“I'd rather have that than a stranger in my house.”

Exciting Developments in Robotics

57:40 to 1:00:04

Ken shares his excitement about innovations in robotics, including napkin folding and shirt folding robots.

“I saw this in a, they had a booth in a conference in Korea in September, and it was folding shirts as it just round the clock.”

Connecting with Other Innovators

1:00:04 to 1:01:04

Ken discusses his connections with other professionals in the field, highlighting their contributions.

“things like that, that's a way sort of bottom up from certain tasks.”
Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00You're listening to TIP. Hey, everyone. Welcome to this Wednesday's release of Infinite Tech. Today, we're talking AI and robotics and where there's still key areas of development that need some work. My guest is Ken Goldberg, a leading robotics researcher whose work bridges academic AI, real-world automation, and large-scale commercial robotics systems. One of the things we discuss that's super interesting is the assumption that large language models automatically unlock physical intelligence. And this is an area where Ken is really well-versed and does a great job explaining what that actually means.

0:35We cover what has improved, like mobility and automation, and what's still painfully hard, like dexterity, sensing, and real-world manipulation. This is a grounded conversation about engineering reality versus expectation, and Ken is a true expert in this field, as you'll see in the conversation. So without further delay, I hope you guys enjoy this chat.

0:59You're listening to Infinite Tech by the Investors Podcast Network, hosted by Preston Pysh. We explore Bitcoin, AI, robotics, longevity, and other exponential technologies through a lens of abundance and sound money. Join us as we connect the breakthroughs shaping the next decade and beyond, empowering you to harness the future today. And now, here's your host, Preston Pysh.

1:33Hey, everyone. Welcome to the show. I am here with Ken Goldberg, and I am so excited to have this conversation because you are an expert in this field of robotics and AI, and it's something that we talk about all the time on the show, and it's just exciting to have somebody like yourself here today to talk about it. So welcome to the show, Ken. Thank you, Preston. I'm excited to talk to you too. So before we started chatting, you sent over an article that I think is very pertinent to kind of set the stage for probably most of the conversation we're having today. And it was an article that was in the New York Times, and it's talking Rodney Brooks has quote unquote said, the field has lost its way.

2:13And for people that aren't familiar with Rodney Brooks, he's the former director of MIT's Computer Science and Artificial Intelligence. He's the a Romba inventor and running that entire company and product line. And so for him to come out and say something like, this is kind of a big deal. And I just really want to kind of capture your take on what is he talking about the field has lost its way? Well, I think he's a very, very respected individual. He's a good friend of mine. And I agree with him very much. And I think he's provocative. He's put it in his own words. But I sent that to you because I think it's very relevant for us to start this conversation about what's real and what's hype in robotics.

2:58And I have to be careful about the word hype, but I want to say there's a call inflated expectations that are out there. And I understand where they come from. You know, I think people are excited about technology. Everyone, I am too. We all grew up with science fiction and we love it and we love new things. and there has been some breakthroughs. I mean, there's no doubt that the advances in artificial intelligence, in particular, deep learning, and then generative AI with the transformer model have been transformative in the field. The AI systems are doing things that no one thought would be possible by now.

3:34And I will be the first to admit, they're capable of creativity, They're immensely valuable. But people then take the next logical step and say, okay, these systems have solved language, so therefore, they'll solve robotics too. And that is where I have a lot of concerns. We can get into the details, but Rod and I agree that it is not at all obvious that the advances in language in AI will extend to robotics. What would you say is the number one thing that you're seeing that's just grossly out of touch with reality when it comes to the robotics piece being not as far along or it's not coming in the talking point is in five years, we're going to have humanoid robots doing everything, right?

4:24So what are the big chunk pieces that people that aren't intimately familiar with the space that you see are missing on that particular topic? Okay. So let me tell you, first of all, where some of the advances have been made. And one of them is in quadrupeds. That's walking dogs, basically, and bipeds. That's walking machines and navigation, and I would call mobility. So the ability to get around with robots, with legs has made immense progress. That's been very exciting, and there's no doubt about it. Those machines are capable of doing backflips, as you know, side flips, parkour, all kinds of things that I certainly can't do.

5:01Also, huge advances in drones. And so the past decade, we've seen drone technology take off from something that was very experimental, but it's been a number of advances that have made that possible. In both cases, a lot of it has to do with motors and the hardware, but also advances in simulation. And the ability, for example, for drones is to stabilize themselves and then to be able to control very accurately the motors on the four or six rotors that are there. And the same is true for robots that have legs or quadrupeds or bipeds. So these are big, undeniable, and major advances. And if you just look at the field, you say, okay, all this is coming, and now the next thing we're going to have a home robot taking care of us.

5:49And this is around the corner, according to Elon Musk. And I'm sure I'm going to get some pushback from some of your listeners who are going to say, I don't know what I'm talking about. Okay, I've had that happen from A number of very confident, quote, experts from Silicon Valley tell me that. But I've been working in this field for 45 years, and I've studied very closely and understand where the gaps remain for particular manipulation. And manipulation is being able to pick things up, all kinds of things that just happen to be in your environment, and then being able to manipulate them, do things.

6:25That skill is very, very nuanced and tricky. And it's not clear that the current methods for doing AI is going to get us there. I've heard in interviews, Elon in particular, say that the hand, mimicking the hand and the tendons and being able to have that tactile ability is extremely difficult, is the way he has said it in interviews. But I think, I suspect that when it really comes down to it, what you're seeing is a lot of demos online that you see. like this video, somebody picks up a pen and the robot did it. But what's actually happening there behind the scenes, whether that was a programmed publicity stunt or something that the robot can just do quite well, there seems to be a large gap there.

7:12So talk to us about where you see that gap and what it is in reality in your humble opinion. Okay. And this is understandable. Again, I don't want to say people are naive. I get where they're coming from. They see something and it looks human-like. And so they attribute human-like qualities to it and skills. I understand that. And by the way, when Elon says the hands are hard, we can produce, people are designing hands that look very much like human hands. That is, they have 22 degrees of freedom and they can move all these joints independently very quickly. And they look almost identical to human hands.

7:49So we can reproduce that. In fact, there's like 100 different hands that are being produced by different companies in China right now. Okay. So the advances in the hand itself are very sophisticated, but the control of the hands is where the challenge is. And this is where if you have this hand doing this, but then get it to actually tie your shoelace, that is where the challenge is and this is because we have there's so many nuances in the interactions that we have with these fingers with the environment that we are sensing the environment we are exerting forces on the environment and this is very subtle and very nuanced and we perceive this through a variety of techniques we have something like 15 000 sensors in our hand in every hand yeah i know it's remarkable we don't even think about it because it's subconscious yeah but then we also have sensors in our joints every one of our joints so we are able to perceive very subtle forces slip and in particular one very very nuanced thing is deformation so if you look at your fingertips they've evolved in a really interesting way that those pads are extremely helpful if you put on let's say thimbles on your finger right yeah like you're doing your sewing that makes it much more difficult to do anything yeah you can imagine or just actually heavy gloves gloves yeah as well right but we can do these things very very subtly we have learned this ability to interact with the forces of objects that the objects are constantly being moved and deformed so if you think of the shoelace right that's the object is being deformed the fingertip is being deformed as well this mutual deformation is something that's really nuanced and subtle and we don't even know how to simulate it accurately.

9:40So we can't even simulate the forces and torques and deformations that are occurring. And then we don't have the sensing capabilities to perceive these nuances. Like you can feel a shoelace if it's a little bit slipping out of your fingertip. No robot can do that. So what happens is that when you now have this hand and you actually try to execute something, sometimes it works, but a lot of times it doesn't work. And now you have the issue of reliability. yes that is where we're seeing and by the way you can see robots all day long picking up stuff off a table and moving it somewhere that's actually not so difficult if you just want to pick up especially a stuffed animal by the way stuffed animals are very easy because you almost can't go wrong you just put your gripper anywhere near them and close it and you'll pick up that thing okay those are like you know they're sitting ducks right they're no this is super easy low hanging fruit let's call it and that makes it very easy to pick up and move things but now when you want to start doing things like inserting things, like repairing a stuffed animal by opening it up and getting things, pulling out the stuffing or sewing it back up.

10:48This is totally different and much, much more difficult. Yeah. Your example of a shoelace is really profound because until you take a step back and just think, if I had to design or build a robot to tie a shoelace, I can't even imagine how incredibly difficult something like that would be because it is such a complex task. And I've never even thought about how difficult something like that is. Well, here's what I know because shoelace we all do. We learn when we're young and we kind of do it without even thinking about it. It's a subconscious, right? I can be on the phone tying my shoelace. Don't even think.

11:22But think about this one. I don't know about you, but do you know how to tie a bow tie? A tie, but not a bow tie. Yeah. bow tie okay good i thought you might because you seem like a fashionable guy i i have tried it it's very tricky yeah it's very tricky business and it's subtle you have to be able to feel and pull in all these different directions yeah forget it there's no robot that's going to be able to do that for a long time i would love to have it happen because that would be something i would love to have a robot tie my bow tie and here's another one that's very simple it's just buttoning your shirt yeah it's actually a little tricky for humans if you think about it how you have to kind of fiddle with it a little bit to get a button on and off, especially a small button.

12:00So that's way beyond robotics. You'll never see a demo of a robot buttoning up a shirt. We're actually working on it in my lab, but it's really hard. Wow. Yeah. It's things that you just really take for granted. Now, when you get into solving that problem, it seems like you mentioned this earlier, that it's almost a sensing issue that we need a lot of developments on the whatever type of sensors you have in the fingertips or whatever you're using for the manipulation. Is that the biggest hurdle right now is in just kind of replicating how our fingertips can have so much sensing capability? Okay.

12:37So that's one, but here's something that's somewhat encouraging for me at least, which is that if you look in the realm of robot surgery, and by the way, there's a lot of misconceptions about that. I give talks when people say, well, robot took out my my nephew's appendix and i'll say that was not a robot that sir that was a surgeon using a robot as a tool yeah to do that operation right so they call it a robot but it's really a telerobot or more literally a puppet a very very important and very useful and expensive puppet but it's a puppet and so that's very important to understand so surgeons can do remarkable tasks they can sew sew up a wound, they can take out an appendix or a gallbladder with these tools.

13:24Now, they do not have tactile sensing. Actually, the very latest versions of it, they started to introduce some, but for many years, they didn't. And surgeons are still able to do amazing things. So this is evidence that maybe we don't need to know how to do tactile sensing. It's just a hypothesis, but it says that we have an existence proof that manipulation, dexterous complex manipulation with very complex deformable surfaces, right? I mean, it's harder than tying a bow tie to take out an appendix. You can do that without tactile sensing. Now, what's fascinating is the way surgeons seem to do it is essentially accommodating the lack of tactile and then using vision, their eyes.

14:08And they have cameras in there and they're watching what's happening and they're seeing what happens and that they have a feedback loop based on vision so they can see very small deformations of the tissues, and they infer what's going on. This is remarkable because this, I think, is the most exciting path to getting to manipulation, which is rather than trying to reproduce tactile, which is extremely difficult for all kinds of reasons, but I think it's interesting and worth pursuing, but there's another path, which is to understand the visual tactile interactions. And that, I think, if we can do that, we might be able to get away with just using cameras.

14:45Interesting. So this week or last week, I'm sorry, I saw an article that was talking to the difference between Elon's approach, particularly on the hands between him and what figure AI is doing, where they put right here in the palm, they put a camera to your point, they put a camera right here in the hand and Elon is refusing to put a camera in the hand. And the person who posted this was saying this is akin to him not using LIDAR in the cars because in the end, it's going to come down to a cost thing. And he wants to force his team to figure it out without additional sensors and for all intents and purposes, costs for manufacturing.

15:28And he's playing this longer game. Yeah. What are your thoughts on that? Well, that's a brilliant point, Preston. I'm really glad you made it it's a very good the analogy really works there elon is very in some sense you know he's very confident he's done amazing things understandably he should be confident but sometimes that can blind you so in this case you know his decision not to use lidar has really i think put a limitation on the tesla driving systems lidar it can be very helpful for filling in the edge cases with certain conditions when vision cameras can be distorted or blinded by light flares or especially in rain.

16:10So LiDAR actually is a great addition there. And also the cost, I don't know, I think it will come down over time. I'm not in the car business, so I defer to his expertise there. But in the same way, he has, you know, originally, you might remember when he first started Tesla, he wanted all the cars to be made in with robotic factories and he had a decree we will have no humans you know everything must be done by robots and i remember engineers coming in from tesla to my lab and saying can you help us we're trying to do this thing and we can't get it to work with a robot and he was just you know unrelenting and then finally he said i was wrong yeah he was wrong yeah he said i he was i was mistaken humans are underrated do you remember that yes yeah so that was really interesting because it was one of the rare times he admitted it.

16:58But it was also, it was a great example of the idea that you can't do everything, right, with robots. And even if you will it, you know, he can will things into existence, right, by demanding this. It doesn't always work that way. And so, the LiDAR story is very analogous. And I think you're right about the cameras. You know, having cameras in the hand makes a lot of sense. It's not how humans or animals work, right? They don't have eyes in their hand. But cameras are something we understand very well. We have very high quality cameras. They're very fast, they're very accurate, and they're really low in cost comparatively.

17:36So I'm for more cameras, you know, put a lot of cameras in there. Because the other issue is when you walk, it's one thing you have a camera on the head, you can sort of see what's around you, right? Or drive. By the way, driving, I should have mentioned this earlier, but driving is much easier than manipulation because driving, you're just trying to avoid objects, avoid hitting anything. In manipulation, you must make contact with objects. You must manipulate them, right? So, it's very different. To your point, this is really fascinating because to your point, when you talk about this idea of, you know, if I'm holding a shoelace and the tip of my finger is indented or I can see the compression of that, I can feel it.

18:14I'm relying on that touch, like I'm tying my shoe. I'm relying on that sense of touch. But if you were going to try to build a sensor that can do that and you're kind of hitting a roadblock or can't find something that can provide that tactile feedback, I could look at a camera and say, okay, it went in by a half a millimeter. Therefore, it's about this much pressure. And you can substitute that sensing capability through an image or a video of being able to see it. So, it is kind of interesting that right we have figure going that path and yeah well okay so let me let me add on to this so you just made a very nice nuanced point you said if you wanted just looking at your fingertip and you saw the shoelace pressing into it by looking at the shadow structures and others but if you you could probably figure out that it was yeah slipping away or it was firmly grasped absolutely that's what surgeons do and they by the way work with surgical thread which is really thin and they have to use a needle it's very complicated right but they're doing a lot of this with their eyes with their intuition now it's not just a matter of putting cameras around because it doesn't that doesn't solve it alone you actually now you need to be able to understand that imagery the video and you need to interpret that and that's also extremely difficult yeah because humans have this incredible ability and we can't underestimate it it's just amazing what humans can do yeah so So from an inference standpoint, as far as like, if I hold the shoelace this way, I can also kind of just intuitively infer that if it was held 90 degrees from that, that it's going to have this same slipping sensation.

19:51And that's something that's really hard to train a robot on versus humans can just kind of like figure it out like very easily. Is that what you mean by that? That's what I mean. Yeah. And here's the thing. We don't have good language for describing this, right? We're trying to because it's all intuitive for us. Yeah. know i if you ask me tell me how to tie a shoelace right i'd be like you know it's not easy right we don't have language and that's part of the reason by the way this is the the other issue and i'll come to is the data gap the gap between the amount of data we have for language versus robots maybe this is a good time to yeah let's talk that yeah let's talk this okay all right well there's a way of quantifying all this and this is something that i call the robot data gap and it is it's the following, that if you put together all of the data that was used to train language models, now it's vast, but it's hard to wrap your head around how much data is that?

20:43Well, my students and I were able to calculate that if you actually look at it, and actually there's another, Kevin Black, who's a researcher at physical intelligence, very, very smart guy. He had the first insight about this. And then we've been taking it a little further, but basically it's that if you added up all the hours it would take you to read a human, average human, to read all the text that's used, that's available to train the language models, right? So it's all the books that are out there. It's all Wikipedia. It's everything that's on the internet. If you add up all those tokens, if you will, and then to figure out, well, a human can read at the average speed of 238 words per minute, right?

21:20You can do the math and you end up with a hundred thousand years. Okay. So you could sit down and read everything that's used it'd be a hundred thousand years later you'd be done okay now we don't have such data for robot manipulation oh it doesn't exist it's not like we can just find it on the internet it's it's the data is very different there we want to start with vision images and then end with control signals to the robot this doesn't exist so we have to start and basically generate this data. But what we're up against, right, is it's 100 ,000 years. We're 100 ,000 years behind the language model.

22:00So again, I'm sort of exaggerating and to make a point, which is certainly there's a number of ways to accelerate that. And I think we can eventually get there. By the way, I'm not saying this will never happen. Please don't get me wrong. I believe it will happen. But my big question is when. I think it's really important to be prepared for the reality. There's a lot of people who say, hey, this makes sense. I want this. We should have this soon. And, you know, but remember, there's a lot of cases where people have talked about that in the past. Fusion energy, nuclear fusion, right? Makes a lot of sense.

22:33Sort of the technology is pretty obvious, but you have to contain this plasma. That seems like a technical issue. We can figure that out. Well, 50 years later, we're still working on it. And it's hard. It's one of these very, very nuanced problems. Another one is curing cancer. When I was a kid, they used to say, we're going to have a war on cancer. Just like we got to the moon, 10 years, we'll solve cancer. We haven't solved it. So there are problems that are extremely difficult and they take much longer than anyone expects. Yeah. It seems like robotics is like that. We don't know. And listen, I'd be the first to celebrate if someone wakes up, I wake up and I read, someone has solved it, right?

23:10It could happen. Yeah. And then you'll look back on this podcast and say, Goldberg was completely wrong. No. It could totally happen. But I want to be a voice to say, hey, it might not happen. And let's just think about that and be a little bit realistic, because I know how a lot of people are thinking that it's inevitable, it's going to happen in any, you know, hopefully by next year, according to Elon and many of his followers. But they have to be ready for that maybe not to happen. And I'm worried about a backlash that people will say, hey, this whole robotics thing is, you know, was, you know, hocus pocus, and we're going to move out of this field in droves.

23:47Preston Pyshkoff I don't, and I don't want to put words in your mouth. So correct me if I'm stating this wrong. I don't think you're saying it's not going to happen. You're just really suspect on the timeline that everybody seems to be. Yeah. Preston Pyshkoff Yeah, that's it. That's it. Exactly. And that's where I line up with Rod Brooks, because for very similar reasons, we have experience. We've both been working in this field for like 40, he's been working longer, slightly longer than me, 60, 50 years. But we have a lot of experience with trying to solve these problems, and they're much more nuanced than they seem on the surface, especially because a child can pick things up and manipulate it.

24:20It seems obvious. Why can't robots? It's very counterintuitive. But when you work with these things and you really see their limitations, you start to understand that this is a very, very complex problem. Let's take a quick break and hear from today's sponsors. Every business is asking the same question. How do we make AI work for us? Sitting on the sidelines is of course not an option. Your competitors are already making their move. But with NetSuite by Oracle, you can put AI to work today. NetSuite is the number one AI cloud ERP trusted by over 43 ,000 businesses. It unifies your financials, inventory, commerce, HR, and CRM into a single source of truth.

24:58And that connected data is what makes the AI smarter. It doesn't guess. It knows. Automating routine tasks, surfacing actionable insights, and helping you cut costs and make fast, confident decisions. From software and IT services to healthcare, equipment manufacturing, financial services, and many other great American industries, NetSuite delivers a customized solution for your business. This is not a bolted on tool. It's AI built into the system that runs your business. And if I hadn't needed this product, it is exactly what I'd use. If your revenues are at least in the seven figures, get their free business guide, Demystifying AI at netsuite.com slash tip.

25:34The guide is free to you at netsuite.com slash tip. That's netsuite.com slash tip. Curious about online trading, but haven't taken the first step yet? You're not alone. And plus 500 futures is a great place to start. The futures markets are moving fast. And with plus 500, you can explore popular assets like oil, gold, S &P 500, Bitcoin, and more. From crypto to commodities, there's always something happening. The platform is super easy to use, so you can trade on the go right from your phone. You can get started with just$100 and jump into the action. See something interesting? Once your account is open, you can trade it in just a couple of clicks.

26:14And if you're not quite ready yet, you can practice with a free demo account. No risk, no pressure. With 20 years of experience. Plus 500 makes trading more accessible than ever. Check it out at plus500.com. Trading and futures involves risks of loss and is not suitable for everyone. Not all applicants will qualify. Plus 500. It's trading with a plus. Okay, be honest. How many times have you been lying on the couch, scrolling your phone late at night, and you see that one thing you've been looking for? You tap the link, throw it in your cart, maybe browse around a little more, and then you hit checkout.

26:49And that is when it hits you. Your wallet is across the room. You have no idea what password you use for this site. And suddenly buying a$30 item feels like a whole project, but then you see it. That purple button, shop pay. One tap and you're done. All your info is already saved. No fumbling, no frustration, just that purple button. That's Shopify. And if you're business owner, that button is a game changer. Shopify has the best converting checkout on the planet, meaning fewer abandoned carts and more sales actually going through. But Shopify isn't just a checkout button. It's the commerce platform behind millions of businesses and 10 % of all e-commerce in the US.

27:29They've got hundreds of ready-to-use templates so you can build a beautiful online store that matches your brand. Plus, Shopify is packed with AI tools that write your product descriptions, create page headlines, and even enhance your product photos. It's like having a full team without the full team price tag. See fewer carts go abandoned and more sales go with Shopify and their ShopPay button. Then sign up for your$1 per month trial today at shopify.com slash TIP. That's shopify.com slash TIP. All right, back to the show. Ken, if you're a program manager, you're kind of looking at all the different swim lanes to get there.

28:09The hand seems to be one of the critical path, if you will, for getting there. Is there anything else that you would define as being on that critical path? Or is the hand so far out there as far as difficulty goes compared to everything else that that's really the limiting factor? Okay. Great question. I would say it's not only the... When you say hand, it's the manipulation ability. Because by the way, I do have another thing to say here, another opinion, which is that we will get much more out of very simple grippers than we will out of hands that look like human hands. Again, if you look at surgery, the tools that surgeons use to perform an appendectomy are very simple grippers like this, and they can do immensely complicated things.

Read the full transcript

28:55So I believe you don't need complex hands. So I'm not saying that's the path to go. I believe you can do simple grippers. In fact, my company, Ambire Robotics, uses an even simpler gripper which is a suction cup and you can do incredible things with them so it's not necessarily the hardware but it's the software it's a control of this nuanced interaction that is very very challenging i think many of the other aspects are addressable i mean we have the ability to tell a robot go pick up the orange you know the orange jumper off the table we can solve that now. Computer vision systems are good enough to know that a jumper is a sweater and there's an orange one and it'll pull that up.

29:38No problem. But it's being able to actually pick it up and maybe put it on you and then button it up for you. That's where it's difficult. Yeah. Yeah. I mean, maybe what we see in the interim is robots that go to market, humanoid robots that go to market that have simplified the hands or have the range of activities or things that they can actually perform is very limited relative to a real human being in there and being able to do it. I don't know if that's how they go to market or not. I want to talk a little bit more about your company, Ambi. So this is really fascinating. So you guys have gone to market primarily focusing on logistics and warehouse type activities for robotics.

30:19Is that correct? Correct. So this started about seven years ago. we had a breakthrough in robot grasping and that was just simply ability to pick things out of a bin okay so it's not manipulating you know doing surgery but it's just picking things out of a bit that was a very old problem it's been known as the bin picking problem and people have been looking at that for decades but we had it we made an advance and this was especially the work of jeff mauler who was the phd student of mine who was the lead researcher on this and we can go into more details on the technical aspects of this, but the system was called DexNet, Dexterity Network.

30:57And it was based on collecting data, lots of examples. And it was somewhat, it was analogous in many ways to ImageNet, which was a breakthrough for computer images. So we did something similar. We synthesized this data set. We added noise in a very specific way, but the system started working remarkably well. And so it could pick up almost any object that you put into a bin, it would just pull it out. And you would throw in a whole pile of objects. We were digging around in our garages and closets and throwing everything we could into it. And it was consistently just being able to pull these things out.

31:29And so that was a very exciting moment for us. We got some publicity. It was in the New York Times and other places. And then we were approached by a number of companies and we decided to form our own company. That's awesome. I'm curious where you've seen just good old-fashioned engineering matter more than additional data or larger models? And then to the converse of that, when did you have data actually really surprise you? Okay, good. Well, that was a case. Great example. That was a case where data really did surprise us. We were able to generate 6 million example grasps because we had collected 10 ,000 object models, and then we could generate grasps on those models.

32:10And then we had all these, and we trained a network to be able to learn essentially where to grasp an object. So that was a data-driven approach. But I will tell you that when you take that and you have to move that into an experimental system or into a commercial system, then you need a huge amount of what I call good old-fashioned engineering. And this is where you have to really sweat the details. You have to make sure that the sensors are calibrated correctly, that your robot arms are calibrated and accurate. You have to be able to do the computation to move the arms very quickly. You have to control the surfaces of the grippers, the suction cups, myriad of details like that.

32:50The lighting, we had a little scale underneath the system that would recognize when an object was removed from the bin. It was like a digital scale. It was just another piece of engineering that had to go in there. So lots of all that. That was just our demonstration system in the lab, experimental system. But then when we moved into Ambirobotic, and by the way, I want to give credit also to the other students who are involved. Matt Mattel was another computer scientist working closely with Jeff Mahler. And then I also had two other PhD students from mechanical engineering. And one of them, Steve McKinley and David Geely.

33:25Brilliant. All four of these guys, extremely, extremely brilliant engineering students. And so they really knew how to work. They were very good friends. They remain good friends. They all worked very closely and spent a huge amount of time camping and hanging out together too. But they were perfectly complimentary because we had the computing skills and the mechanical skills. And mechanical guys knew how to design machines that could work reliably over a great period of time. And that's when we moved into building the Ambi sort system, which sorts packages for e-commerce. And this was a little bit, We didn't go in with this plan, but what we saw very quickly was that e-commerce was growing and there's a huge demand for sorting packages.

34:08It's very challenging to get packages out to the customer fast. So we started using that technique, DexNet, and we evolved it and commercialized it. And then we could make it work very fast. And then all kinds of other elements had to come in. We had another gantry system that would drop it into, pick it out of bins, pick an object out of bin, had to be scanned for a zip code, figure out which bin to go into then put it into the right bin avoid jamming the whole time make the system reliable safe and easy to use right all this is what i call good old-fashioned engineering and so i become a big advocate for this because after all this is a body of research and ideas and insights that have been developed over 400 500 years in engineering and still what we teach at Berkeley and all the major universities.

34:58We teach the engineering principles. And my point is, let's not forget about those. Those are still extremely valuable for engineering and for robots and getting them to actually work in practice. And anyone working in robotics, I think, will acknowledge that. Although the public perception is, oh, it's just now, you know, we're using AI and that's solving everything. It's not. It's solving certain little pieces of it. And as I said, there's certain pieces that are very, very difficult that still remain very difficult. So this comes back to what I was saying earlier, Preston, about my fear, which is that because there's so much expectation around humanoids right now, that if the companies can't deliver on that ability, then there might be a big backlash.

35:43And that's going to hurt companies like Amby, who are not trying to do that. Amby is trying to solve a real practical problem and do it efficiently and cost effectively and actually you know basically something that's very valuable for every everyone who shops at amazon or any online companies right we've sorted 100 million packages so far and i'm very proud of that because these machines as we're talking are out there sorting packages and they're very reliable they're not featured in the videos about there's no humanoids doing this yeah by the way although some have said that you know we'll have a humanoid doing that.

36:16But humanoid with hands, it's going to be a long time before that's even close to the efficiency of the systems that we have with destruction cups. Let's take a quick break and hear from today's sponsors. Every business is asking the same question. How do we make AI work for us? Sitting on the sidelines is, of course, not an option. Your competitors are already making their move. But with NetSuite by Oracle, you can put AI to work today. NetSuite is the number one AI cloud ERP, trusted by over 43 ,000 businesses. It unifies your financials, inventory, commerce, HR, and CRM into a single source of truth.

36:50And that connected data is what makes the AI smarter. It doesn't guess, it knows. Automating routine tasks, surfacing actionable insights, and helping you cut costs and make fast, confident decisions. From software and IT services to healthcare, equipment manufacturing, financial services, and many other great American industries, NetSuite delivers a customized solution for your business. This is not a bolted on tool. It's AI built into the system that runs your business. And if I hadn't needed this product, it is exactly what I'd use. If your revenues are at least in the seven figures, get their free business guide, Demystifying AI at netsuite.com slash tip.

37:27The guide is free to you at netsuite.com slash tip. That's netsuite.com slash tip. Curious about online trading, but haven't taken the first step yet. You're not alone. and plus 500 futures is a great place to start. The futures markets are moving fast. And with plus 500, you can explore popular assets like oil, gold, S &P 500, Bitcoin, and more. From crypto to commodities, there's always something happening. The platform is super easy to use. So you can trade on the go right from your phone. You can get started with just $100 and jump into the action. See something interesting. Once your account is open, you can trade it in just a couple of clicks.

38:07And if you're not quite ready yet, you can practice with a free demo account. No risk, no pressure. With 20 years of experience, Plus 500 makes trading more accessible than ever. Check it out at plus500.com. Trading and futures involves risks of loss and is not suitable for everyone. Not all applicants will qualify. Plus 500. It's trading with a plus. No, it's not your imagination. Risk and regulation are ramping up and customers now expect proof of security just to do business. If you're a founder or business leader, you already know this. Every new deal, every new partnership, somebody is asking to see your compliance credentials and getting that stuff together manually.

38:48It is a massive time sink. That's why Vanta is a game changer. Vanta automates your compliance process and brings compliance, risk, and customer trust together on one AI-powered platform. So whether you're prepping for a SOC 2 or running an enterprise GRC program, Vanta keeps you secure and keeps your deals moving. And here's a stat that really got me. Companies like Ramp and Ryder spend 82 % less time on audits with Vanta. That's not just faster compliance, that's more time you're spending on actually growing your business instead of drowning in paperwork. I love that over 10 ,000 companies, from startups to big enterprises.

39:28Trust Vanta to handle this stuff so they can focus on what actually matters. Get started at vanta.com slash T-I-P. That's V-A-N-T-A dot com slash T-I-P. All right, back to the show. After shipping robots that work every day in the warehouse, what's one belief that you held earlier in your academic career that you've had to revise based on that? Lots. I would tell you, one of the things that is very interesting is that you think, okay, I have this great new technology that's the breakthrough that really solves an important problem. Therefore, I can rush out into commercial world and build a company around it.

40:10Well, it turns out that technology is only a very small core part. It enables, but then there's all these things that have to come around it that are equally, if not more important. And actually, when you go to the customers and you say, hey, we have this new AI thing. They're like, wait a second. I don't care about that. How much money is it going to save me? That's all they care about. And that's business. That's business. Both my grandfathers of business were entrepreneurs, and so was my father. So I grew up in this kind of environment, and it's tough. It's tough out there. One grandfather was very successful in electronics, and my other grandfather was in the housing business, building homes.

40:45But my father struggled. He was a metallurgist, and he had a company doing chrome plating and it was very very difficult and you know he was buffeted by things way behind his control like you know recession of the 70s actually really hurt his business very badly so he struggled so there's a lot of factors and it has to do with competition and timing what i would also say in industry is that and this is going to come back to the data aspect which is that you can do things in a lab that you think are you've really explored the full range of a problem so let me give you this example we were addressing the bin picking problem remember and we were dropping all kinds of objects in there in fact when people would come to the lab they would visit and i'd say well where do you have your car keys drop them in here i said uh if the robot will pick it out we'll keep the car and then uh but it would always do that it was no problem picking out someone's car keys right and we tried to talk all kinds of things again toys we made 3d printed weirdly shaped objects all kinds of things we could think of we try to basically consider everything and we were just trying to push the envelope right well the envelope was the keyword because it turned out that one thing we didn't ever really experiment with was bags oh and bags are extremely common in shipping yeah you probably receive if you know this if you receive bags from your from e-commerce from amazon or others you get bags of all kinds of forms now bags often plastic or paper but the problem the issue with bags is they're loose and so they have objects in them but there's a lot of slack and they tend to fold in interesting ways so we didn't we weren't testing those really in the lab that wasn't something that we would have thought about too much but that's so much more common in real shipping so my point is we had to adapt all of our systems to the reality of the consumer market, which in this case is bags.

42:42And that was something we didn't have a lot of data on. So we had to adapt our systems to work on data on real bags. And real bags are very difficult to actually even simulate and model because they fold again. And by the way, the folding matters because if you go to pick up with a suction cup right on top of a fold, as you lift it, the fold will unfold and you'll lose the suction and drop the object. Right. So we started collecting data as we started putting these robots to work. So as our customers were putting these systems into production at Ambi, right, we also had an agreement that we would maintain these systems very at high performance levels because we were constantly monitoring them.

43:22So we have a dashboard at the central headquarters in Berkeley where the team keeps an eye on every machine that's in operation out there. And so what we do is we get data on every single pick operation, what happens, how long it takes, whether it dropped the object, whether it was classified correctly, all kinds of things like that. Right. And we use that so that we can immediately tell when the performance, let's say the picks per hour performance, that's how it's often measured, drops. We can spot that early and say and we call the company and we say, what's going on? Did something change? Did the camera get knocked?

43:54Is the suction cup getting worn? and so we're constantly on top of it part of it is that that's a source of big pride for us we really customer focused and we want to make sure our machines work completely reliably but nice amazing side effect of this is that we've been able to collect data from all this real systems in real environments over the last four years and we now have a lapse on 22 years of robot data so remember i talked about the hundred thousand years yeah yeah now we have 22 years though and started okay but it's real robot data it's extremely valuable it's a high quality it's the gold standard for data and so we're now using that to refine our systems and that make them better and more higher performing more reliable but also allowing us to now branch out into new related types of products so we now have we introduced a new products called AmbiStack that stacks boxes very efficiently, very densely.

44:55And that's a new product that we sold out our first batch of these systems this year. Preston Pysh, MD, Amazing. On this idea of robot data or covering this 100 ,000-year gap that you're talking about, for a company that would be trying to overcome this because the data just isn't there, are they just having to construct a bunch of physical, real-world, going back to the hand example, would they have to have a bunch of physical hands with just a bunch of physical objects to then just be doing this? Or is this something that you think we could simulate in a virtual environment to accelerate that speed or kind of a combo of both?

45:34Good. So for grasping, it turns out simulations, it works pretty well because there you just need to know the geometry of the environment fairly accurately, and then the geometry of the object and the gripper. And then you can actually model that fairly well. So now grasping is just lifting an object off a table, okay? Or out of a bin. That's very different than tying the shoe that we talked about earlier, right? There, it turns out that we can't simulate that so well. As I mentioned, we don't know how to model and simulate the deformations, the minute forces that are going on in the process of interacting with that object.

46:11So that's a challenge. This is a little nuanced, And I know that your audience might say, what is Goldberg talking about? He said, this couldn't be solved. Now he says it can be solved. Well, it depends. There's certain categories of problems that can be addressed. And I think that picking objects out of a bin is something we've made an enormous amount of progress in the last five years. So I'm very optimistic about that. I think we're getting faster, more reliable. And those systems are, you know, that's the cutting edge of robotics. And it's real. but then tying shoes and doing things around a home by the way or in a factory where you're actually trying to put together you know electronic parts or car bodies or car installing upholstery and wiring inside a car these are extremely difficult by the way and they're even in detroit or anywhere in the world they're still humans doing those jobs because they're very very hard so those are hard to simulate and i do think it's everything's pointing toward this deformation is a key obstacle to doing it.

47:11And I've talked with people who are physicists and experts in deformation, and they agree this is a very, very hard problem. We don't even understand the physics of friction and deformation very well. Interesting. You've said your views on AI creativity have changed. Walk us through some of the timeline and what's changed and just kind of your overall opinion today? Okay. Well, on a very different note, I have been working as an artist in parallel with my work as a researcher and engineer. I like to say my day job is teaching at Berkeley and running a lab there, but I have another passion, which is making art.

47:50And I've worked on this for almost the same amount of time. And I make installations and projects. We did a project called the Telegarden, where we had a robot that was controlled by people over the internet and the robot could tend to garden a living garden we put this online in 1995 which was the very early days of the internet and i'm very proud of that project because it stayed online for nine years 24 hours a day people could come in and explore this garden and plant seeds and water them so it was a very interesting it was an artistic project but it was also a engineering proof of concept and it had to work reliably.

48:30And so, you know, it really pushed us. I sometimes say people think doing engineering is hard. Try art. It's really hard because you have to deal with the public and they're going to interact and do all kinds of crazy things. So we had to really spend a lot of time designing that system, but I continue an interest in art. And I have a new show coming up. It's a joint project with my wife, Tiffany Schlain, who's an artist and she and I are collaborating on a on a exhibition that's going to open in San Francisco in January 22nd okay all right so so this is a big passion of mine and it's using technology like AI and robots to ask questions about technology and I'm very interested in this contrast between the digital and the natural world when they they seem very symmetric and similar, but there's very profound differences between them.

49:22So that's what I think about or I try to express in my artwork. And so your question about the creativity. So I always said, AI won't be creative in the sense that you can ask it questions, but it's not going to actually come up with original ideas. But I actually have shifted my view on that. And I give this example where I I asked ChatGPT in the early days, hey, give me 100 uses for a guitar pick. I just thought it would start repeating the same thing over and over again. And it started with a screwdriver to scrape ice off a windshield, things like that, which all made sense. But then it started listing these as fast as I could read them or faster.

50:02And then it came up with one that I was like, it was a miniature sail for a toy boat. And when I saw that, I was like, oh my god that is a genius idea and i would not have thought of it and i you know immediately when you see something that's original and creative like that you spot it and you say ah why didn't i think of that those are those rare ideas and ai is capable of that now and so it's very exciting yeah it is exciting it's super exciting so i'm not in i'm not negative about ai at all i love it i use it i advocate for it my daughters my wife everyone uses it and so i'm 100 percent for it.

50:41I do think it's going to help with robotics, but the question is, is it going to do everything that people are hoping? And that's where I hope that this conversation, Preston, will put things into context for your audience. So I don't know if you're going to like this question or not, but I'm going to throw it over because I'm curious what you would think of this. So Figure AI recently sold their humanoid robot to put into the home. And there was a lot of pushback from at least the comments that I saw online that this was just a giant marketing scheme or maybe they're trying to raise their next round.

51:15I don't know. But for the audience, I'll just kind of frame it. It's a humanoid robot. All the demos that I've seen to date are extremely suspect as to its ability to actually do anything in the home. When you dig into it more, they were using, you're putting this thing in your house. And then I guess that it has this ability to go back to a human that would actually be manipulating the robot inside the house, which I think has all sorts of security, privacy issues, and everything else. But the reason I bring this up is because I don't know if he's, I'm pretty sure he's the founder and CEO of the company.

51:50He was suggesting that in order for AI to really start to accelerate It's learning that it needs to start being embodied into the physical form and to put itself into a challenging learning environment. And what he means by some of this, and Ken, correct me if I'm wrong in the way that I'm describing it, but what he's getting at is there's all these ambiguous situations that happen in the household with respect to social dynamics, the way that the family would interact and what they would ask of the robot, like, hey, go get me a cup of water. and then the person who's asking for it always likes it half full, or they like it warm, or they like it cold, or whatever.

52:29And so that learning that the robot would be forced to kind of undergo from a social dynamic would assist in its ability to get smarter collectively, because I'm sure all this information is then going back up into the mothership and getting networked. But his argument is the point of my question, which is, do you also agree that for AI to kind of take this next step or this next quantum leap from where it is today, that it really needs to be able to immerse itself and basically partition itself into the physical form. Well, I think that is helpful. And certainly understanding the dynamics of human interaction, especially in a home, is the social dynamics are very, very subtle.

53:18And as you said, very very important just understanding tone of voice gestures like my daughter will say you know does this right which is don't bother me she's a teenager okay or just rolls her eyes right like that oh yeah the world's right oh yeah yeah the subtle body language is super complex when you think about complex yeah we pick up on it in myriad of ways we don't even recognize right like i can pick up if one thing i always notice is when i'm teaching i can pick up if students are starting to lose interest or get tired or bored right yeah i just feel it you know i look around but i'm always watching that's why it's too tricky to teach online but all these things are very nuanced um body language can tell you a lot of what's going on and just interpreting what's the dog doing and what's the dog you know how's the dog feeling right there's all a lot of nuance there so all that is you're gonna you have to be in real homes to be able to do that and i think that's actually that makes sense i'm not opposed to having let's say a humanoid in a home that might be helpful for doing certain things like maybe fetching water or being able to pick up things around the house remember grasping i said that is actually something i think robots can do so if you said hey you know pick up all the things that are on the floor right we would all like that we have a Roomba you know you mentioned earlier the vacuum cleaners but the next step is to be able to actually pick things up and put them away yeah and that I think we can get there I do I actually think that's going to come that can happen in the next decade and it's very valuable because by the way if you're a senior citizen you really want things off the floor and if you're a young parent you have a lot of kids you have kids or if you have a teenager there's like can you clean your room you know that'd be great to have a robot go in and just clean off the pick up all the clothes we call that the teenagers problem by the way we have a paper okay okay which is how to get a robot to efficiently pick up clothes and it's not the obvious thing because you know if you just program a robot and go in and pick up it'll pick up one sock take it to the bin to pick up the next stock take it to the bin you actually need to be able to pick up lots of socks together and so how do you do that that's called multi-object grasping it's a very complex and nuanced topic and so we're studying that in the lab so just coming back to your bigger point.

55:36I think that robots will do something useful in the house. I think that's possible. They could be useful for security. Also, maybe in some form of companionship somewhere down the road, or as you get older, and I can appreciate this more and more, that I might want to have a robot that might help me shower or get changed or help me get out of bed in the morning. I think that would be nice. I'd rather have that than a stranger in my house. Let me put it that way. right i just don't relate just not one that's networked back to some other person on the control yeah right i mean well that the privacy issues are huge you're right and that's something also a lot of engineers don't appreciate that i faced this at berkeley a few years ago where i was talking about privacy and i made an art project about privacy and we had cameras surveillance cameras we did a whole installation about this and some of my friends were like i don't care about privacy i have nothing to hide i said oh really i said okay can i see all the letters of recommendation you wrote for the last 10 years?

56:33Oh, no. I'm not going to share those. I said, okay, how about all the research proposals that you're working on? Oh, no. I can't share those. Right. It's all kinds of stuff that you don't want to share. It's not that you're hiding. It's not that you're doing something criminal or embarrassing, but there's a lot of stuff you don't care to share because it's important and it's confidential. So same as in your home. It's not that it's going to catch me naked, but in the morning, I have bad hair day and I don't necessarily want that to be transmitted widely. So it's all kinds of things like that. So I'm not opposed to humanoid robot.

57:07I think it's going to be interesting to see what happens in the next few years, that we will probably start to see these. It'll be very interesting to see that roll out from figure. And Berndt is very, you know, he's a very compelling businessman. Like Elon, you know, he has a lot of optimism, a lot of confidence, and he's definitely building something that's working to some degree. So it'll be interesting to see. And, you know, I'm not a naysayer. I'm not saying that all this is going to fail. I just say that be patient. You know, it's going to take longer. The real science fiction stuff is going to take longer than we think.

57:38Last question I got for you, Ken, what's the most exciting or surprising thing that you've seen in the lab or just in the space in general that you almost gasped when you saw it in the past call it year okay so actually i have a good answer for that you know i'm so proud of ambi for being able to sort packages around the clock at very high speeds right but i recently saw a company called dyna dyna robotics okay and i'm friends with the founders so i'm maybe slightly biased but i have to tell you they demonstrated folding napkins with a robot okay and they did it for 24 hours so they just had the camera set up and they had and now this is by the way just two grippers two grippers okay right no head but it has cameras but there are two grippers basically folding a stack of napkins over and over again and they did it for 24 hours and they showed you the whole process now that to me as a roboticist is a big deal because they were able to do it fairly fast reliably the napkins were you know often get tangled up and it would figure out how to untangle them and keep going and the folds were actually pretty nice so that's impressive And then I got to see a live demo of the new version of that, which can now fold shirts.

58:47And it worked really well. I saw this in a, they had a booth in a conference in Korea in September, and it was folding shirts as it just round the clock. And it was fantastic. Even you could bring your own t-shirt and it would fold it. So that to me, that's very exciting that that shows. And again, it's a specific task. I do think we're going to make progress there. And by the way, everyone wants to have something fold their clothes. That's for sure. That is for sure. I'm so bad. I know. I'm so bad I got one of those little folding. Oh, you do? Yes, I do. Because I'm so bad at folding it. But when I use that, I'll actually, you know, do it.

59:23Oh, you have a folding board. Okay. Yes, I do. And I'm sure that - So you're going to be a great customer for this. But you know, you have high standards, right? Because you want the things just right. And that's where it gets tricky, right? But the Dyna Robotics guys, it's Jason and Lyndon, who are the leaders of this company. They really are pulling something off that I think is very interesting to keep an eye on. And a lot of the other robotics companies are now trying to emulate that, which is to show one task, one special task, doing it very reliably, making coffee or folding boxes. That's really exciting.

59:53And I think that is actually going to be important. Rather than trying to do general robotic, do everything in a home, which is, I think, going to take a long, long time. But if you get it to do certain tasks, like folding laundry, or maybe making coffee, certain things like that, that's a way sort of bottom up from certain tasks. learn other tasks rather than top down. I think that's going to be a path to getting progress. But again, it's going to take longer than most people think. Preston Pyshko, I can't thank you enough for making time. Your expertise is just off the charts. And I know the audience is going to love this.

1:00:27If you have anything else you want to highlight or point people towards that we can put in the show notes, just let us know what that is. Preston Pyshko, Okay. I'll send you some links because I have a bunch of things online I can to with that follow up on this in various ways. And no, I think it's great. Thanks for doing this. I'm really glad you're also going to connect with my good friend, Rich Wallace. Yes. Yes. Because he is fascinating. You know, he's a very, very original thinker and very, I would say very much an unsung hero around chatbots. People don't know, but he was really a pioneer in doing this, you know, very early.

1:00:59And he still has a lot of great, really interesting insights and ideas. So you'll appreciate it. Amazing. All right. Well, Ken, thank you so much for making time and coming on the show. My pleasure, Preston.

1:01:34Past performance is not a guarantee of future results. Listeners should do their own research and consult a qualified professional before making any financial decisions. Nothing on this show is a recommendation or solicitation to buy or sell any security or other financial product. Hosts, guests, and the Investors Podcast Network may hold positions in securities discussed and may change those positions at any time without notice. References to any third-party products, services, or advertisers do not constitute endorsements, and the Investors Podcast Network is not responsible for any claims made by them.

1:02:01Copyright by the Investors Podcast Network. All rights reserved.

From the publisher

Ken and Preston examine whether robotics has lost its way, echoing Rodney Brooks’ concerns. They dissect the gap between AI language models and physical robotics, focusing on dexterous manipulation, tactile sensing, and visual feedback.

IN THIS EPISODE YOU’LL LEARN:
00:00:00 - Intro

00:02:37 - Why Ken agrees that robotics may have “lost its way”

00:03:37 - The critical gap between AI language skills and robotic manipulation

00:04:33 - How robot mobility is advancing, but dexterity still lags

00:08:15 - Why tying shoelaces is still too complex for robots

00:12:37 - The role of tactile sensing vs. vision in robotic surgery

00:14:45 - How camera placement in robotic hands affects manipulation

00:20:18 - Why the robot data gap could be 100,000 years behind language models

00:25:13 - Why simpler grippers often outperform human-like robotic hands

00:27:03 - The engineering behind Dex-Net and Ambi Robotics’ success

00:34:37 - How real-world testing exposed unexpected robotic limitations

Disclaimer: Slight discrepancies in the timestamps may occur due to podcast platform differences.

BOOKS AND RESOURCES

Official website: Ken Goldberg.

Website mentioned: Ambi Robotics. 

Research Article: Dex-Net in Science Robotics January 2019.

Executive Education profile: Prof. Ken Goldberg. 

Ken Goldberg interview by Kara Manke: Are We Truly on the Verge of the Humanoid Robot Revolution?  

Goldberg on Moravec's Paradox.

Goldberg on AI and Creativity.

TEDx Talk: "Robots:  What's Taking So Long?"

Op-Ed by Ken Goldberg, Boston Globe: Let's Give AI a Chance.

Research Papers are available for download.

Related⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ books⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ mentioned in the podcast.

Ad-free episodes on our⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ Premium Feed⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠.

NEW TO THE SHOW?

Join the exclusive ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠TIP Mastermind Community⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ to engage in meaningful stock investing discussions with Stig, Clay, Kyle, and the other community members.

Follow our official social media accounts: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠X (Twitter)⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ | ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠LinkedIn⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ | | ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Instagram⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ | ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Facebook⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ | ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠TikTok⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠.

Check out our ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Bitcoin Fundamentals Starter Packs⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠.

Browse through all our episodes (complete with transcripts) ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠here⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠.

Try our tool for picking stock winners and managing our portfolios: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠TIP Finance Tool⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠.

Enjoy exclusive perks from our ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠favorite Apps and Services⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠.

Get smarter about valuing businesses in just a few minutes each week through our newsletter, ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠The Intrinsic Value Newsletter⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠.

Learn how to better start, manage, and grow your business with the ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠best business podcasts⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠.

SPONSORS

Support our free podcast by supporting our sponsors:

Simple Mining

Linkedin Talent Solutions

HardBlock

Alexa+

Unchained

Amazon Ads

Vanta

Shopify

Abundant Mines

Horizon

Public.com - see the full disclaimer here.

References to any third-party products, services, or advertisers do not constitute endorsements, and The Investor’s Podcast Network is not responsible for any claims made by them.
Learn more about your ad choices. Visit megaphone.fm/adchoices
Support our show by becoming a premium member! https://theinvestorspodcastnetwork.supportingcast.fm

More from The Investor's Podcast (We Study Billionaires) - The Investor’s Podcast Network

All 167 episodes
TECH010: The Real Robotics Timeline w/ Ken Goldberg (Tech Podcast)The Investor's Podcast (We Study Billionaires) - The Investor’s Podcast Network · 58 min
Listen in VO