Josh Wolfe: The ChatGPT of Robotics is Coming

22 Apr 2024 · 52 min

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

```markdown Odd Lots Podcast Episode Summary

Episode Title

Josh Wolfe: The ChatGPT of Robotics is Coming Description: In this episode, Josh Wolfe, co-founder and managing partner at Lux Capital, discusses the future of robotics and AI, including potential business models, market trends, and the comparison between AI in chatbots and robotics.

---

Key Themes and Discussions

  1. Evolution of AI and Robotics
  2. AI Popularity Surge: With the rise of chatbots like ChatGPT, interest in AI has skyrocketed, especially among venture capitalists.
  3. Potential of Robotics: Wolfe suggests we are on the brink of a similar breakthrough in robotics as we saw with chatbots, hinting at a "ChatGPT-like" moment for this field.
  1. Current State of AI Applications
  2. Barbell Extremes:
  3. Mundane Applications: Basic AI functions such as customer service.
  4. Frivolous Applications: High spending on novelty AI (e.g., AI girlfriends).
  5. Shift in Focus: Wolfe points out the shift from computational challenges to energy challenges in AI, highlighting the enormous power requirements of advanced AI chips.
  1. The Robotics Challenge
  2. Scarcity of Robotic Models: Compared to text generation models (around 60,000), there are only 19 robotic models, indicating a gap in development and opportunity for innovation.
  3. Physical Intelligence: Wolfe mentions a new company, Physical Intelligence, training robots to operate in unstructured environments, unlike current systems constrained to manufacturing.
  1. Learning Mechanisms in Robotics
  2. Types of Learning:
  3. Supervised Learning: Robots learn from input data with corrections.
  4. Unsupervised Learning: Robots discover patterns from unstructured data.
  5. Reinforcement Learning: Learning through imitation and experimentation.
  6. Transfer Learning: Knowledge is shared across different robots.
  1. Future Prospects
  2. Household Robots: Wolfe discusses the possibility of robots handling daily chores, such as folding laundry or retrieving misplaced items.
  3. Maintenance Focus: A new theme in investment includes addressing maintenance of existing infrastructure, leveraging AI and robotics to improve efficiency in various sectors.
  1. Investment Insights
  2. Venture Capital Landscape: Wolfe notes that while there's a buzz around AI, not all investments are profitable; many companies are struggling to monetize despite high valuations.
  3. CapEx vs. OpEx: The shift towards AI requires significant upfront investments in hardware, contrasting with previous tech models where operational costs were the primary concern.

---

Key Takeaways

  • The robotics industry has significant room for growth compared to AI applications in chatbots.
  • A major breakthrough in robotics could emerge soon, similar to the recent advancements in AI.
  • Effective use of AI in robotics will likely focus on practical applications rather than humanoid designs.
  • The intersection of AI with maintenance of existing infrastructure presents a new frontier for innovation and investment.

---

Conclusion Josh Wolfe's insights provide a comprehensive view of where the fields of AI and robotics are headed, emphasizing the importance of practical applications and the need for innovation in unstructured environments. The conversation highlights the potential for robotics to transform daily life and industries, paralleling the excitement seen in AI-driven chatbots.

Hosts: Joe Weisenthal, Tracy Alloway Guest: Josh Wolfe, Lux Capital ```

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00You're being sold an AI future where you're obsolete or irrelevant. That vision is wrong. At Palantir, they're building AI that helps workers and unlocks their full potential. American workers are our nation's greatest strength. AI shouldn't eliminate them. It should elevate them. Palantir is here to tell their stories. From factories to hospitals, AI is freeing people from drudgery, letting them do what humans do best. Create. Solve. Build. Palantir, making Americans irreplaceable.

1:01Business smartphone plan savings. Terms apply.

1:08Bloomberg Audio Studios. Podcasts. Radio. News.

1:25Hello and welcome to another episode of the Odd Lots podcast. I'm Joe Weisenthal. And I'm Tracy Allaway. Tracy, let's talk about AI some more. Okay. Well, we could just have AI write the script for us and save ourselves some time. No, I don't think the technology is there yet. You know what? So, I can't say who. Maybe I... I was talking to a professor recently, and she said something really interesting to me. I'm not supposed... Not sure. I don't know. It's fine. I think I can say it. Do it, Joe. And she said, like, you know, there's all this anxiety about, you know, kids cheating on their essays or having Chad GPT write their essays for them.

2:00and supposedly professors are tearing their hair out trying to figure out what to do about this, and the AI detectors don't really work all that well particularly. But apparently it seems like the solution is to just grade them as regular essays no matter what, and it sounds like at this point all the Chad GPT essays are basically solid C essays. And so if you just sort of take them at face value, even if you think they might be AI generated, at least at this point, it doesn't seem like a way, at least for college students to write good essays yet. So our baseline, our average is chat GPT now.

2:35Yeah, that's basically, can you beat the bot? Did you see the thing, someone was tweeting about one of the tells for AI generated words is if you use the word delve. Yes, I saw that. Which as someone who I'm sure has used delve numerous times on this podcast and in my writing, I thought was a little unfair. It is a little unfair. It's a cliche, but that doesn't mean it's from AI. All that being said, there's more to AI than just chat GPT, obviously, and chatbots. And this sort of has come up on a couple episodes recently, but only like very tangentially. People talk about the use of like AI and industrial applications.

3:11And I've seen a lot of stuff. There have been a couple of Bloomberg articles about some startups that sort of say like, okay, well, like what if we train robots the same way we trade large language models where you feed them just like tons and tons and tons of real world data. And so that, yeah, like, sure, you still have to solve the mechanical engineering part. But then what if that allows them like all this training data to do more advanced industrial things? Like, I don't know, like make a pizza or, you know, be a more powerful humanless assembly line or something like that, where it's like we see all these oppressive robots and videos like Boston Dynamics, but I never know if any of this is quite there yet in terms of having its value.

3:54Yeah. So the robotics aspect of AI is something that's incredibly interesting to me. It kind of makes me think about the world that we want to see. So it would be great if we had physical robots who are able to do stuff like clean up a house or take care of an elderly family member or something like that. It's not so great if all of our technological prowess basically goes into writing satirical lyrics via chat GPT. That's fun. I can do that myself. But what I really need is someone to vacuum or dust the house. Do the laundry. Yeah, exactly. All right. Well, I just want to jump right into it because we really do have the perfect guest.

4:35We're going to be speaking to someone who has been investing in AI for a long time. A lot of VCs like started investing in AI last year, obviously. But this is someone who has been investing in AI for quite some time before it became the hot new thing. We spoke to him last July and had a great conversation about what he was seeing in the space. So I'm really pleased to welcome back on the show. We're going to be speaking with Josh Wolf, co-founder and managing partner of Lux Capital. Josh, thank you so much for coming back on OddLots. Great to be on. I feel like I should say hello in like a robot voice.

5:11So what's interesting to you these days? What are you seeing out there that gets you excited? Well, you know, you guys started this off with AI and within AI, look, we've had what I would call maybe a little bit pejorative, a little bit looting crude. We've had chips. Everybody knows that. We talked last time about AMD. We've got chatbots. You already have some of these guys that are starting to fail. They've raised billions of dollars and in some cases just, relatively undifferentiated, big debate between open source that is approaching the asymptote of achievement that the big private models have.

5:45And then being a little bit lewd, you've got chicks. What do I mean by that? Most of the applications in AI are the mundane and passe on the one side, which would be like customer service and basic call center supplementation or substitution. And then at the other end, you have people that are spending tens of thousands of dollars a month in some case on AI girlfriends and people that are doing what they often do with technology, which is used for prurient interests. So that to me are the two barbell extremes in AI where people are actually making money and profits serving demand for basic human instincts, I guess, and needs.

6:19That's less interesting. Overall, you're seeing a big shift from the compute piece to the energy piece, meaning people now recognize this bottleneck in AI is not going so much about the chips. We also talked about this months ago when we said, look, you don't necessarily need these Nvidia chips for inference, the part that most people do when they're querying all these models. You do need them for training, but the power levels on these things are just enormous. There was a Dell earnings call that they think sort of accidentally leaked that this Nvidia B100 Blackwell chip is going to be a thousand watt draw of power, which is like 40, 50 % more than these H100 chips.

6:56Why does that matter? Because now you got to figure out how do you supply the energy for that. And a tidbit, which I thought was interesting, was Amazon acquired a nuclear power data center in Pennsylvania. They've spent$650 million. They got about a gigawatt of power. And I think that that is going to be a trend. I think it's actually going to usher in a wave of what I like to call elemental energy, but demand for nuclear power to power these big AI data centers. Yeah, it's kind of funny when you think about it. I don't think anyone expected uranium to end up being an AI play, but here we are.

7:28I want to go back to something you said, and you actually brought it up the last time we spoke to you last year. And it was the idea of, I guess, the novelty of some of these more public facing AI projects. And I think you pointed out last year, it's really fun to use some of these things like generate a bunch of cartoon versions of yourself or whatever, but it might not be a sustainable business model. And it might end up being a functionality that is eventually incorporated into another platform or a different project. Have you seen any examples, specific examples of more public facing novelty AI start to like go away?

8:07I think you mentioned a few failures recently. Yes. You've had a whole bunch of companies that basically took a chat GPT, GPT-3 or 4 and put a wrapper around it, basically meaning give the average user who doesn't know how to use these or even do prompts some means to interact with it. And those things raised a bunch of money. They made these things accessible and they've sort of gone away. The foundation models themselves that are undergirding all of this themselves are also starting to be relatively commoditized away. And some of these things have prominent people and have raised a lot of money, but they are what I would consider failing.

8:36Take inflection. You got Mustafa Suleiman, super smart guy, co-founder of DeepMind, raised I think a billion and a half for that company. I'm going to be careful here because Microsoft has been probably the savviest actor in this entire game, figuring out that they can acquire things by doing things in a clever way, skirting FTC and DOJ oversight. They effectively control OpenAI, as I think we also talked about, heard particularly going into the end of last year when there was all the drama around OpenAI, Satya said, look, if OpenAI went out of business, we own it, control it. We've got all the data up, left, right, center, all around them.

9:07Same thing with this company Inflection. They did, I think, a$650,$675 million license for the technology that basically was a payment above and beyond what the venture investors had made. Venture investors made a little bit of money, not a lot. Key management went over to Microsoft, but Microsoft has been very clever. So back to your question, I think the big are going to get bigger and are going to be most of the beneficiaries here. Microsoft, Adobe, Amazon, Amazon themselves coming up on the one year anniversary of Bedrock, they're going to announce that they've got the best performing model with Anthropic, which they made billions of dollars of investments in now, sort of a competitor to OpenAI, ChatGPT.

9:41They're also going to announce something with one of our companies that hasn't yet been publicly disclosed in biology, that's going to be one of the two biggest waves next, biology and what you started the conversation with, robotics. If you just take robotics as an example, I think in one of our company's Hugging Face, which is one of the main repositories for all these open source models, there's something like 60 ,000 text generation models. It's like 59 ,700, something like that, but just an enormous number of text generation models. This isn't like two or three. It's like everybody's doing this.

10:13Everybody's trying to do it all basically trying to predict the next word based on the prior one, what this transformer technology, which was invented at Google, ended up parlaying into. Guess how many robotic models there are? 59 ,000 in tech generation. Guess how many robotic models there are? A fraction of 59 ,000. I'm obviously leading with my tone here, but 19 robotic models. So you got that to me as a venture investor, we're just always looking at where's their abundance, where's their scarcity, their scarcity of robotic models. Now, why? Well, it's relatively easy to train on the open internet.

10:48You've got Wikipedia, you've got YouTube videos, whether you're not, you're supposed to be doing that or not. Like the woman who was asked at Sora, hey, how did you train these things? Was it on YouTube? And she gave it a few days and you probably saw that. So there's going to be all kinds of copyright stuff on that. Robots are hard. Why? Most of the robotic stuff that has been out in the world, like you talked about in your intro, is constrained in manufacturing facilities, in work cells, on an assembly line, very specific, parametrically constrained, so very few degrees of freedom of what they're actually doing.

11:18The robots themselves might have multi-axis grips and controllers, but they're not moving around very freely. You have exceptions with like Amazon, which acquired Kiva, moving the warehouse inventory stuff around, but again, relatively XYZ axis, not unstructured environments. You and I and our listeners, we all thrive every day in unstructured environments. And that is where you need enormous training data. You can't search the internet for that. So how do you do it? There's a few things that have emerged. And you mentioned some articles. We funded a company that recently came out of stealth called Physical Intelligence, instead of artificial intelligence, physical intelligence.

11:55And it is the creme de la creme team from Stanford and Berkeley. You've got some open AI folks. You've got Google DeepMind folks. They took investment from open AI, us, and a bunch of other VCs. And they are just 24-7 training robots doing all kinds of crazy things like folding laundry, pouring deterrent into it, but to let these robots encounter unstructured environments and then be able to thrive in them. The next thing that you're going to see are visual models where you're effectively giving like an Ikea sketch or you're drawing something and you're being able to instruct the robot to have a sense of intuitive physics of how the world works and how things might connect to each other and then learn from that.

12:35And then we're also training these robots with simple verbal cues. So there's a video you can see online from some of the researchers where they are picking nuts and M &Ms and separating them, you know, just as a task of being able to sort and filter with precision and dexterity. And if they picked a wrong one, you can actually, instead of physically grabbing the thing, say, stop, grab the M &Ms, not the nuts. And now it knows that. So I think that we're about to unleash in robotics, what will become a chat GPT like moment where people are so used to seeing robots and they see the arms and they've seen Westworld and this kind of stuff.

13:11And suddenly something happens and it just blows your mind. And I think that's coming soon.

13:31Silicon Valley is selling you a future where you're obsolete, or worse, identical. At Palantir, they're witnessing something different and revolutionary, From re-industrializing the nation's defense base to shipyard workers building faster and frontline workers boosting productivity, AI is transforming work across the nation. AI is not replacing American workers or flattening them into conformity. It's unleashing what makes each one irreplaceable. Their judgment, their craft, their creativity. When American workers become more powerfully themselves, they own the future. Palantir, making Americans irreplaceable.

14:38giving you unlimited earned potential to invest cash back into your business, from innovation and technology to everyday expenses. Inc. Business Premier is the only business credit card with 2.5 % cash back on every purchase of$5 ,000 or more, and is part of a suite of credit cards from Chase for Business, designed to meet your needs every step along the way. Learn more at chase.com forward slash business card. Chase for Business. Make more of what's yours. Accounts subject to credit approval. Restrictions and limitations apply. Cards are issued by JPMorgan Chase Bank and a member FDIC.

15:38robotics, this element where there is such a shortage of advanced cutting edge talent, people who really know how to do this stuff. And you mentioned that guy that got hired by Microsoft from his other companies. As an investor in AI or robotic startups, is this a dynamic that's different than in other software or other tech investing? Basically, this sort of like highly skilled tech key man risk, basically? Yes, in that you always are looking for what's scarce and you want scarce talent. If anybody could do this, it's just not that valuable. Companies would get funded. VCs would fund 40 of them at the same time or maybe 400 of them.

16:17Contrast to things where it's very web-based or the old Groupons of yesterday, this is highly technical. Often PhD scientists, the vast majority of the founding teams that we backed at companies like Covariant or Formic or this new company, physical intelligence, they're all PhDs that are coming out of Stanford, Carnegie Mellon, MIT, some of the best robotics programs in the world. And there's lineage of these great professors. Many of them have passed. But for example, there's this one guy, Hans Moravec, used to be a Carnegie Mellon. I got to meet him when he was still alive, but he was one of the very early pioneers in robotics.

16:49And he's got this paradox that insiders in the robotics world called the Moravec paradox, which is this weird counterintuitive phenomenon, which is basically like all the stuff that we think is really hard is actually pretty easy for AI. And all the stuff that we find totally intuitive and easy, like riding a bike, that's really hard for robots. So there's this great paradox that some of the most brilliant researchers are working on, which is how do we do the kind of stuff that a four-year-old can do very intuitively with these very complex, expensive machines? Then there's all kinds of considerations we could talk about, about where are these arms coming from, the acquisitions that China has been making from what historically was a lot of German companies.

17:27When I say arms, meaning the robotic arms that can move things. And then there's this great philosophical debate that hasn't yet come to fore, but I believe will. And investors are sort of lining up on this. I'm on the opposite side of some. People are funding humanoid robots. And the reason that I say I'm on the opposite side of it is I don't really believe in them. Yes, you would want somebody to help take care of your grandma and maybe provide some companionship. But this idea of the movies, of these ex machina kind of robots that embody a human in form, we know that engineering is better than evolution.

18:00If we were inventing a car tomorrow, it would be a terrible idea to take Fred Flintstone and use his feet to power these stone wheels. We know that an actuator and the axle and an engine are just better, and evolution didn't create that. Why would we create these humanoid hands where if I'm twisting the cap off of a bottle, I have to turn my hand like seven times to do that. Whereas if I was just designing the perfect robot, I'd have a little suction cup that would go on top, it'd have like a drill bit mechanism, it would quickly twist it off, and then it would Swiss Army knife, you know, swap out for the next technical gripper capability.

18:35So I think that people are misguided, and they're basically going to end up doing things for like prosthetics, or, you know, something that's sort of Westworld-like. But I think the practical robots that we're going to all be using in our homes are going to look nothing like these humanoid robots. This is funny. This is very reminiscent of a weird conversation I used to have with my dad. He had like some sort of bugbear around the shape of aliens hands. And he was like, why are they always shown or depicted in these illustrations as having like human like hands or sometimes even three fingers?

19:11Like, why wouldn't they have just evolved to the next level of very, very efficient physiology? Anyway, one thing I wanted to ask, and I'm trying to think how to frame this question or what the right word is, but how open source is robotics in the sense of like how much of the technology is shareable or replicable? Because I feel like one of the reasons, and you touched on it earlier, but one of the reasons we have seen this boom in AI is because you can go to places like Hugging Face and download a bunch of code, open source code, and build off of it. And it sort of multiplies around itself. But is there any aspect of that all in robotics or is it just much more proprietary?

19:57The hardware piece has historically been very proprietary, although there's lots of knockoff things. There is a Chinese company which is increasingly dominating the field. A lot of people don't know the name called UniTree, U-N-I-Tree, UniTree, that is sort of copying the Boston Dynamics robots that Joe was talking about and that you see in Black Mirror episodes and those kinds of things. On the software side, it really, because it has the same kernel, the same origins as many of the AI software things that led to large language models and came from Transformers, academic roots and academics like to share and publish.

20:33And of course you can patent certain things, but by and large, the early systems, something called Ross, as you might guess, robot operating system, people that were doing something called Arduino, which is sort of for hobbyist programmers with hardware and software at the intersection, Poppy, there's a handful of these things. But again, now you're in this mode where you need to find training data and you need to do the work and spend the time, and that costs money. So you will have a mix of open and closed models. And if you take a company like Physical Intelligence, their MO, their motive is, we want to build the operating system that any robot can basically use to navigate the world.

21:11They want to build the brains for the robots, as opposed to the robots themselves. And there's an interesting philosophical and scientific tangent, which Barbara Tversky, who is a friend, and she was partner of now the late uh danny kahneman who was also a friend her work and she was you know far less famous but i think actually more important work is all about motor function and her hypothesis is the entire reason for the existence of the brain like the sole purpose of it is to actually produce movement movement towards food or a mate or to run from a prey or predator which in turn is doing the same kind of thing and i think that some of the most interesting philosophical questions about consciousness and memory, spatial perception, embodied cognition, gesturing.

22:00I mean, I'm wildly gesticulating while I'm talking now with my hands. It's just an innate thing. Being able to do mental simulations, like when we think about human brains and machine brains merging, I actually think it's really going to be very revelatory as these robotic systems advance and us understanding that a lot of the purpose of thinking and intelligence is actually just about moving. And so that's a pretty cool side effect that I think is going to come from all the commercial and speculative venture stuff that we do in funding these things. You keep saying things that jog me onto something else that I was meaning to ask you, but you mentioned this impulse that academics like to share their work.

22:37And that reminded me of something that someone was telling me. So maybe I'm sure you are on this site a lot, But for listeners, there's the site archive.org where people like publish research and sort of like an open source sort of ungated manner about all kinds of scientific and computer things. And just today on the artificial intelligence page, there's like 15 new papers and they have headlines like autonomous evaluation and refinement of digital agents or a modular benchmark framework to measure progress and improve LLM agents. And this guy who I was talking to made the contention that's like, all this stuff is being published and investors, a lot of VCs don't really have these sort of like technical chops to judge a lot of this research.

23:20It's like the here, take my money meme. I'm curious what you see in this space where it's like, there must be a lot of investors like yourself who are wowed by PhDs doing all kinds of stuff. It's like, oh, we got 100x breakthrough in the energy efficiency of this NVIDIA chip by training the model differently. Like, how do you evaluate the science and how risky is that for investors with this sort of like plethora of ostensible breakthroughs happening left and right? Well, you're right. There's endless. I mean, it is why there's this endless frontier and sort of the Vannevar Bush sense. And it's always very exciting.

23:54And you need to have a very high filter for these things. Not everything is commercial. Sometimes there's just a breakthrough, but maybe that breakthrough can be licensed to a company. And so the people who are actually commercializing this and thinking about capital allocation and recruiting teams and then deciding these are our top three priorities. And even though there's 40 other really exciting things that we could and maybe should be doing, we're just not going to do that now. That's really what company building is about. And so oftentimes we might have a brilliant scientist, but maybe that person just isn't a good salesperson.

Read the full transcript

24:21They can't tell a narrative. They can't convince people to move across the country and join them. They can't raise capital. And therefore, they're not going to be a great entrepreneur and they're probably better off as a scientist. But when we're making evaluations, it's how much money is going to accomplish what in what period of time and who's going to care. It's like if you were playing poker, you're looking at your hand, you're figuring out how much money do you have to ante up for the next round? And then what's the exogenous? What's the outside view? What's the market going to say? And will they care?

24:45That's why I'm, you know, we talked a little bit about this, but very skeptical about other fields that people are funding right now in fusion or in quantum computing. I'm so skeptical about them in part from hardened cynicism of 20 years of people pitching us things that are always about unbreakable cryptography and femtosecond annealing of this quantum. And I'm like, so what? Most of the things that people promised about unbreakable cryptography or molecular modeling, people are doing. They're just not using quantum computers. They're using GPUs. They're using NVIDIA chips. They're using new algorithms.

25:17So I've been very skeptical about that. I've also been very skeptical about Fusion for the same sort of reason that, to your point, there's like this ignorance arbitrage that people take advantage of. They take advantage of that investors don't fully understand something. It's hot. It's on the front page of a newspaper or magazine or whatever. It's a buzz, and they want to play in it, and so they invest in it. And that's how you get frauds. So we're always looking and basically trying to say, is this academic practitioner commercially minded? They're probably not going to leave their job, so we're only getting them 20 % of their time.

25:46Is the intellectual property real? And then oftentimes, to your point about the papers, there is a high referenceability in papers. A paper that is cited enormously or immensely has a lot more credibility because you have the vainglorious error detection and correction of other scientists who are trying to shoot that person down who has all the fame for doing it, trying to seize that mantle. And so scientists are not a benevolent bunch. They're just as competitive as an investigative journalist trying to break the story or investor or an A &R rep for a music band trying to get there before everybody else.

26:18And we're no different. They're no different. But that's how all this stuff progresses. Talk to us about the robotic arm. I'm going to take the bait. Yeah. The first point I would make is I don't believe in these humanoid robot arms with like fingers and, you know, high dexterity. I think it's a cool parlor trick, but I just, I think we should have robotic arms that look more like Swiss army knives that are swapping and moving stuff. And you can see a bunch of these things online, you know, different tools for different tasks and be able to do them instantaneously. When you zoom out to the industry structure, you've got FANUC, which is a major Japanese player.

26:50They started with industrial robots. They do factory automation, but they've been a key player, probably a$25,$30 billion enterprise value company. You've got ABB, which is Swiss, Swedish, multinational industrial robot arms. Those are most of the things that you would see in like even a Tesla gigafactory or something where Elon's talking about all their automated things. And they've got some of these ABB arms or the other one is KUKA, K-U-K-A, which is a German company. And they were one of the great leaders. They got bought by a Chinese company, I want to say 2016 or 2017. And China's made a bunch of, I think, very smart investments acquiring technologies that were a little bit before their time.

27:28And I think it presents some geopolitical things that probably in five or 10 years, we'll be looking at and saying, my gosh, how is the dominant robot arm supplier or robot body supplier akin to being dependent on TSMC, a Chinese company? So I think there's going to be national robot companies that form in the same way you're starting to see national AI companies form. How does a company like physical intelligence, how are they solving the data problem? Because like you said, there isn't just the equivalent of a robot internet where they can watch millions of hours of a robot arm trying to do something or humans doing something or whatever.

28:08What is the approach by which the token problem is being solved? I would call it the easy way to do it, which is actually quite trivial and hard is doing what people originally did with robotic surgery. So we had a company called Oris Surgical Robotics. We sold it to J &J for$6 billion. It started with surgeons operating these things in like a telerobot. So they had little pinchers on their fingers and, you know, from five feet away or in a totally clean operating room, they were operating, but it was their hands being teletransmitted to the device. And so that is the first way, which is come up with a hundred different tasks, Maybe the highest frequency things like washing dishes, folding clothes, again, unstructured environments, being able to do them in multiple different houses, multiple different heights, multiple different, you know, wet clothes, dry clothes, being able to pour coffee, being able to have the dexterity to open up a K-cup.

29:00I actually don't drink those. I think they're disgusting, but, you know, put it into a coffee machine. I'll drink any of that slop. And there it's an engineer that is operating them. and the movement of compensating for gravity, how much force, how much tension, how much pressure, that's all information. It's information that historically has not been captured. And some of that is then extensible. And this is a really cool thing. You can see some of these robots. You might have five different robots, but they have this amazing thing called transfer learning. You teach one robot a thing and suddenly the other robot, which is disconnected, or it's connected through the internet through it, but it can actually learn what that robot just learned.

29:39perform the task. So that's actually pretty eerie and pretty cool. It's the same sort of thing. Like if I had one robot that saw where I tossed a ball in a room, but three other robots didn't know, they would instantly know because they have the eyes of the first robot. So there's all kinds of training like that. Then there's schematics and drawings. So I was alluding to this before of like Ikea drawings, but once you can take diagrams and schematics and actually use visual language models is something that opening eye is a partner here with physical intelligence and they have pioneered some of that, that's going to be wild too, where you can literally just show an Ikea drawing and the robot goes with a constrained set of limited pieces that they have to put together, a set of screws and wrenches and whatnot, and they can completely assemble whatever it is, a nursery thing or furniture or desk, which I think is going to be pretty wild for people to see too.

30:29That would actually be a major quality of life improvement, not having to put together Ikea furniture. That'd be amazing. Could you talk a little bit more about how robots are learning and I guess like what the different types of learning are or different patterns of learning and what you've seen that's been most promising so far? You have two main categories, or maybe three. You've got supervised learning. So there you've got input data. The robot is learning. It's being corrected. It's being told in some cases, like I described before, whether it's a voice or a gesture or a nudge. Then you have unsupervised learning where the robots are basically training on unstructured data.

31:11They get to discover patterns. They encounter the world. They encounter boundaries, gravity, those kinds of things. and it might be slower in that case, but they're reducing the dimensions for error. There's something that I coined this term, I call it MBTFU, which is mean time between F-ups. But you want that to be as long as possible. If you go back to like the early Roombas, you know, a Roomba would not know if it was cleaning up a spill of chocolate milk or if your dog made a mess and it smears it like Nutella all over your floor, right? You want to increase as long as possible the meantime between, I mean, you know, basically error reduction.

31:48Then you've got reinforcement learning, imitation learning, where you might be controlling the robot or having it mimic you. There's this idea of transfer learning where a single robot learns something, but it can transfer it to different robots or from a different domain. So people are trying lots of different approaches and the more different mechanisms you have, people are then going to figure out, okay, which is the least data intensive or which has the lowest latency and is the quickest or which is the best system for training a robot that, um, you put it in totally unstructured environment and without any training, sort of what they call zero shot learning.

32:23It's able to figure out from prior knowledge. Um, I know that I can't go through that chair. Um, I know that it swivels. I have to turn it this way. I know how much force I need to pick up a general Coke can, uh, and, and those kinds of things. And, and, uh, I think again, it's going to be enlightening of how much we, as we navigate any given minute in our life, take for granted all this intuitive, tacit knowledge that we have about the physical world. And there really is this intuitive physics of how we move around. Robots are going to learn that. Just really simple question. In the next five years, is it plausible that I'll have a robot in my house where I can take all the clothes out of the dryer, drop it into something and have it turned into folded clothes?

33:10And, or if not that, what could be that chat GPT of robots that's right around the corner? Well, one thing which I posited to the team, because I was thinking about exactly that, you know, what would be a really cool thing? I lose stuff in our apartment all the time. We have a bunch of different rooms. I would love to basically say, has anybody seen, which is often what I do to my wife and three kids, has anybody seen my wallet? Has anybody see my glasses. Okay. Just announcing that you can see that a robot with a series of things in your home that would have visual identifiers and visual learning, machine learning to be able to spot objects in a video frame could say, yes, Josh, I know exactly where they are and go and retrieve them.

33:52So fetch and retrieving objects in the home to me would be a pretty cool thing. Where did I put that remote or whatever? And the robot basically knows because they can go through the DVR of the home and they basically know where it is and they can fetch and retrieve it with the right physics. Folding laundry, I don't know how to handicap that. We can do that now pretty crudely. That's the one I want because I have a small New York City apartment. I don't lose things like too much basically. I need that folding robot. What are you going to pay for that though? I don't know. Would you pay five grand, 10 grand for a robot that folded your clothes?

34:25Probably not. So it's got to have a high, that's why most of these things have found their way into industrial uses first. And over time, they'll get cheaper and cheaper, they'll get better and better. But look, I'm one of the few people that have an Amazon Astro. It's a robot that rolls around the house and you can tell it to go into a room. You can put something in the back of it and it can do facial identification for my family. So I can say, where's Quinn or Bodie? And they'll find my younger kids and I can send a message. It annoys the hell out of my wife, but I think it's sort of cool. And every robot that comes out, I'll be an early adopter.

34:59It's really cute. And yeah, we like funding these things.

35:18The Chase Inc. Business Premier Card is made for business owners who make things happen. Designed for high spend and limitless cash back, Inc. Business Premier is a painful card with built-in flexibility. Get the buying power you need to make large purchases, cover unexpected expenses, and help your business grow. Earn a total of 2.5 % cash back on every purchase of$5 ,000 or more. Plus, earn unlimited 2 % cash back on every other purchase, giving you unlimited earned potential to invest cash back into your business, from innovation and technology to everyday expenses. Inc. Business Premier is the only business credit card with 2.5 % cash back on every purchase of$5 ,000 or more.

35:58And it's part of a suite of credit cards from Chase for Business, designed to meet your needs every step along the way. Learn more at chase.com forward slash business card. Chase for Business. Make more of what's yours. Accounts subject to credit approval. Restrictions and limitations apply. Cards are issued by JPMorgan Chase Bank and a member FDIC. Support for the show comes from Public.com. You're thoughtful about where your money goes. You've got your core holdings, some recurring crypto buys, maybe even a few strategic option plays on the side. The point is you're engaged with your investments and public gets that.

36:32That's why they built an investing platform for those who take it seriously. On public, you can put together a multi-asset portfolio for the long haul. Stocks, bonds, options, crypto, it's all there. Plus an industry leading 3.6 % APY, high yield cash account. Switch to the platform built for those who take investing seriously. Go to public.com slash market and earn an uncapped 1 % bonus when you transfer your portfolio. That's public.com slash market. Paid for by Public Investing. All investing involves the risk of loss, including loss of principal. Brokered services for U.S.-listed registered securities, options, and bonds in a self-directed account are offered by Public Investing, Inc., member FINRA, and SIPC.

37:11Crypto trading provided by XeroHash. Complete disclosures available at public.com slash disclosures. So one of the interesting things about the current tech cycle and all this enthusiasm for AI is that so far it's been the big incumbents who seem to be winning here. And part of that is because the capital investment needed is so large. The amount of data needed is so large. When it comes to robotics, would you expect to see a similar thing and then added on to that? Could you have a situation where, you know, if you are a large manufacturer or perhaps you are a company that has a lot of proprietary data, like an insurance company or a financial company or something like that, could you develop your own robotics?

37:58Like, would that be your edge here? And could you potentially just do it yourself? Adam Werner On the first case, if I look at the current landscape, the one company in sort of the big magnificent seven would be Amazon, just because they have already been investing in this for a long time. Jeff Bezos is very passionate about robots. So I think there's a DNA there where doing things that enable them to do the three things that Jeff loves to do historically, which is increased choice and availability, increased convenience for customers and lower prices and factory automation warehouses delivery.

38:34Even when they bought our company for a little over a billion dollars called Zooks that was doing autonomous driving, they have a long-term intention to be able to do 24-7 right-hand turn lanes navigating around the city with a human that's basically delivering last miles kind of stuff. And so I could see Amazon doing that. Microsoft, I don't really see them getting into robotics in a significant way. They have some R &D efforts. Google, and we talked a little bit about this phenomenon, but they are the third or fourth group where we have taken a team out of a big tech. We did it with Google with a company called Osmo to create basically Shazam for smell.

39:08We did it with a bio AI company called Evolutionary Scale out of Meta that's going to be announced more publicly soon. And then we did it with this team out of Google that became physical intelligence between Google, DeepMind, and OpenAI and Stanford and Berkeley. So I think that this is going to be more the startups. The beneficiaries of the money will still be NVIDIA and some of the chip players, some of the hardware providers, because we need the hardware to be able to train the robots. But I really think that this is an open field. And again, just going back to that stat of how many large language models there are for chatbots and how few there are for robots, I think it's a big opportunity.

39:43Now, five years from now, we might have a bubble in robots, but today I think it's a really exciting field. Just on existing AI and competitive advantage. So when I first in the year 2000, I think, encountered Google, I used it. I was like, this is way better than Yahoo or anything else. I never stopped after that again. With chatbots, just going back, not even talking about robotics here, it's like, I got a chat GPT Pro account or whatever early on, and I thought it was pretty cool. And I used it for some stuff. And then the new version of Claude came out from Anthropic, And I was like, oh, this is actually kind of cool.

40:20And I kind of like it more. I don't really know why I like it more, but for some reason I like it more. And I had no problem switching over. Could it be possible that some of these core models do not prove to be as sticky or have as deep moats as people expect? Totally. Inflection, which launched there is called Pi, just wasn't that good. They've now gone to Microsoft. Anthropic, at first, was a little bit behind. They are the most performative model. They're the best performing one. They're the one that I also, like you, use the most. why it's fastest. It has a little bit more. It seems to talk a little better.

40:55Yeah. But here's an interesting thing to your point about, you know, sort of moats and Google early on. Most searches for Google, and remember Google's$280 billion ad revenue generated, you know, enormous. Google, most of those are like five to 10 word searches, right? So you put something in your restaurant in West Village or whatever. Perplexity, which I don't know if you've used. We met the founder early on and we ended up not investing and it was probably a miss for us, but the founder there focused, you know what, I'm going to do the 0.2 % of searches or the 1 % of searches that are longer form where people really want to ask a full question.

41:34I see a lot of people that are using it and it's not coming up with some woke answer or some pithy grok-like response. It's actually a well-researched, footnoted, sources cited response. So to me, the two things that I use most on the chatbot side right now are Claude from Anthropic and perplexity. But in six months, there might be something totally different. And the sheer number of models that are available on open source, who knows what Apple ends up doing here and that being integrated. Siri sucked, but so did Alexa. Amazon's making moves. Apple will too. So yeah. But you zoom out for a second.

42:13All of this stuff in venture, venture is going through this downturn. The one area where there are very high valuations and a lot of money flowing and a lot of talent has been in AI. Therefore, the future returns on these things are going to be lower. That's why we at Lux decided we're going to focus on AI in the physical world, having done all the stuff over the past five years. I would say there's this five-year psychological bias. Everybody wants to be invested today where you should have been five years ago. So Hugging Face and Mosaic, which we sold the Databricks, we were in that five years ago.

42:44Today, we're really interested in biology and robotics and AI's use in those. And then I have a really weird theme, which is so sexy because it's unsexy to me and to others. You understand accounting, vast majority of venture investors and many startup people don't, but you take CapEx. CapEx is made up of two pieces, growth and maintenance. And everybody's been funding growth, growth, growth, growth, growth, investor, growth. So I got interested in maintenance. Why? Because you have trillions of dollars of assets, infrastructure, hospital systems, energy systems, buildings that need to be maintained.

43:19And every generation and every new startup and every new investor always wants to do the new, new thing. It's why we get new music and we get new food and we get new fashion, but there's all these neglected assets. And I think you can apply new technology to maintaining these systems. And so I've become obsessed with this unsexy theme of maintenance, which I think is going to become a hot area over the next few years. Wait, you mean maintenance of physical infrastructure? So the idea that you could have, I don't know, a little robot that goes around your factory or a bunch of highways and sort of surveys it for cracks or things that it thinks needs to be fixed.

43:53Totally. Could be infrastructure for transportation. It could be inside of hospitals where there are road routine things. And it's also oddly, and I know you guys have covered this, but the idea that AI is really coming for the white collar workers. You know, you joke that you could talk about AI and generate a script, you know, based on AI. Oh, no, it wasn't a joke. I'm very serious. They always thought that they were relatively insulated and it was the blue collar workers. But let me tell you, the guy that put me in business, Bill Conway, the founder of the Carlisle Group, he's spending all his philanthropic money or a significant portion of it funding nursing schools.

44:28Why? Because they identified a very high magnitude impact because we have such a shortage of nurses in this country. That's an opportunity for maintenance where robots and technology can play a role. How do you augment and help help nurses? Plumbers, we have a massive shortage of plumbers in this country. And so I actually think that the blue collar workers empowered by technology and maintaining all of these systems around us are actually going to be a winning combination. I want to talk about another aspect of, I guess, AI investing, which is that in the sort of the SaaS wave, the 2010s decade, like compute was very cheap, right?

45:05And so basically like that part, you like plug into AWS and it's sort of, yeah, I know it probably costs them money, but it's not a big lineup or a line item ultimately for a lot of these companies. How does that change in 2024 when you're dealing with an AI company and electricity bills exist or hardware accumulation, depending on where they are in the stack. How as an investor do you think about like the changing? I guess like people talk about like, you know, shifting, you know, having to spend more on CapEx versus OpEx relative to the prior generation of tech startups. How does that play out in the investments you choose?

45:40It's a great question. In the AI world, and then I'll give you the biology world. On the AI side, you know, take open AI. These are all rumored numbers, nothing's fully confirmed, but 2 billion, maybe 3 billion of revenue. I think about 10 million people paying 20 bucks a month or thereabout, and probably 100 million users. I don't know how many of those are unique, but they're not making money on that. They're losing several billion dollars today because you have these upfront costs, big capex, a lot of training. And then you try to maybe do some big enterprise deals. A company like Hugging Face is profitable because they're just hosting it and letting people run inference and then charging and making margin on that kind of stuff.

46:16So that to me is interesting of the people that spent a ton of money and they've got to earn it back. And can you get pricing power by going from 20 bucks a month to 30 bucks a month? And maybe you get that because now you have OpenAI Premium where you have access to, say, Sora for video generation or something like that. So that's going to be a big question on are these profitable investments? Not are they cool, not are they world changing? Absolutely. But are they profitable investments? And look, the market may not care if they're profitable. Market funds all kinds of unprofitable things that they believe in the narrative and the story.

46:46But thinking about fundamental businesses and the economic changes between CapEx and OpEx, I think in AI, it's very hard if you are building out your data centers, trying to do your own training, your own inference, hosting these models. It's very hard. Biology. We will see an AWS moment where instead of you having to be a biotech firm that opens your own wet lab or moves into Alexandria real estate, which specializes in hosting biotech companies in all these different regions approximate to academic research centers, you will be able to just take your experiment and upload it to the cloud where there are cloud-based robotic labs.

47:23We funded some of these. There's one company called Stratios. There's a ton that are going to come on Wave. And this is exciting because you can be a scientist on the beach in the Bahamas, pull up your iPad, run an experiment. The robots are performing 90 % of the activity of pouring something from a beaker into another, running a centrifuge. And then the data that comes off of that. And this is the really cool part. Then the robot and the machines will actually say to you, hey, do you want to run this experiment but change these four parameters or these variables? And you just click a button, yes, as though it's reverse prompting you.

47:55And then you run another experiment. So the implication here is that the boost in productivity for science, for generation of truth, of new information, of new knowledge, that to me is the most exciting thing. And the companies that capture that, forget about the societal dividend, I think are going to make a lot of money. Yeah, this actually reminds me of the conversation that we had regarding snack food innovation and this idea that you can use a sort of factorial like simulation just to run new processes through your factory and see how they would actually work out and what the supply chain might look like.

48:30But not to give in to my five-year bias too much and overly focus on chat GPT, but where are we in terms of context window expansion? Because this is something we spoke about with you last year. And I think for a lot of people, it's probably one of the overriding annoyances with something like chat GPT, the fact that you can't actually copy and paste that much text into it and that you are limited in terms of the output that it actually gives you. Have there been major advancements since we last spoke to you? Well, the Claw 3 is one of the largest. And then you've got all kinds of interesting collaborations.

49:06You've got NVIDIA and Microsoft did one with a huge number of tokens. You've got A121 Labs that has this thing called Jurassic. Again, a lot of people are making headway here. But we are, I think, a year away from you being able to upload hundreds of PDFs, thousands of books, if they're not already immediately referenceable, and be able to detect pattern change amongst documents, summarize and unearth the entirety of key concepts. And then I think the most valuable thing will be it prompting you to say, here's a question you didn't ask about all these documents that you just uploaded. So yeah, I think we're just keep increasing the context window.

49:50But that said, most of the history of innovation is just like, keep increasing this factor. And then somebody else comes along and invent something. It's like that factor doesn't matter anymore. You know, my favorite example of this is like sailboats. You find these sailing ships back in the day, they just kept adding more and more sales. Like these things started to look ridiculous, you know, and then somebody invents the electric motor and you have a motorboat. So I think we'll have the same sort of thing. And then people will figure out, hey, there's a better architecture here than just constantly increasing the context window.

50:23And some of that might be with memory retrieval, being able to reference other models and just go into the archive of what they have. So yeah, that's going to keep expanding. Josh Wolf, Lux Capital, thank you so much for coming back on OddLots. Always great to get an update on what you're interested in. It was great to be with you guys. Yeah. Good. You're preparing already to ingratiate yourself and to blend in with the humanoid. Thank you so much. That was fantastic.

51:06First of all, Tracy, I really like talking to Josh and always like getting an update. I I really do want the folding, the clothes folding robot though. Like I actually think that's a really big deal and would make almost everyone's life better if they didn't have to worry about folding clothes. I agree. It would be far more useful to have something doing physical tasks like folding laundry versus telling you where your lost room is in your house. That's what I want. I need that folding robot. I mean, I will say I know everyone likes to make fun of Alexa as well. Yeah. But our house, we've kitted out all the lights on.

51:41They're all those smart bulbs because we don't have any overhead wiring. So like everything has to be lamps. So if you didn't have a robot that was able to turn on all of your appliances at once in a room, it would be incredibly annoying because you would be going from lamp to lamp to lamp. So it does make a difference in my daily life, at least. I mean, there's so much to pull out from that. So one thing that I thought was interesting from an industrial policy perspective was Josh's discussion of some of the robotic capabilities being developed in places like China and the idea that we might have another chips semiconductor like situation on our hands where we wake up in 10 years and realize that a primary component of robotics is being built much more efficiently and cheaply elsewhere outside of the US or the West.

52:32And then the other thing I thought was interesting was the idea of leapfrogging, right? So I think a lot of people, myself included, when we think of technological advances, it's like, can this do this thing slightly faster? Can it do it on a slightly larger scale to the point about the context window and expansion there? But you can leapfrog in technology, as Josh was saying, and you can go from the sailboat to the motorboat or you could bypass human evolution, for instance. And instead of having humanoid robots, you could have a Edward Scissorhands like thing with a Swiss Army knife on the end of his arm.

53:11Yeah, that made a ton of sense to me, which is like if you're like starting from scratch, like it's not obvious that the human form that was, you know, developed over millions of years through evolution is necessarily the thing you want to create or recreate to do various tasks that you need. There was a lot in there that I like. The thing that he would talk about at the end, it sort of sounded like cloud kitchens, but for biology labs. So if you just have all the robots do it and then they can prompt you for other ideas, that's interesting. It does seem exciting, the idea of ways to accumulate training data for these sort of like, you know, that you could maybe solve the mechanical engineering.

53:50But without, you know, there's no equivalent of like all of the text on Reddit or Wikipedia or whatever that change or, you know, Google Books or YouTube. So like having to recreate that as a bottleneck for building robots was really interesting. I love the term he used. I think it was ignorance arbitrage. Yeah. Which is a really great term. So it's like, yeah, like when a lot of like pure science spaces, you're going to get investors who are willing to throw money at someone who just like has a really good idea on paper because that person is smart. Well, I think this is also the really unusual thing about this particular cycle, which is the dominance of the incumbents and the fact that on the one hand, you do have a bunch of open source software.

54:31And to some extent, you can take something off of a repository and you can pitch it to investors and say this is the next big thing. And they might not have the technological expertise to actually evaluate that. But when it comes to making actual advancements in something like robotics, it does feel like you have to have an edge in one respect or another. You either have to have the capital to deploy or you have to have access to that data. So I don't know. I guess we'll see how it shakes out. I guess we'll have Josh back next year. Yeah, next year. Next spring or summer to see what the next big thing is then.

55:06Hopefully he can bring a robot with him of some sort. A folding robot. Yeah. All right. Shall we leave it there? Let's leave it there. This has been another episode of the Oddbots podcast. I'm Tracy Allaway. You can follow me at Tracy Allaway. And I'm Jill Weisenthal. You can follow me at The Stalwart. Follow our guest, Josh Wolf. He's at Wolf Josh. Follow our producers, Carmen Rodriguez at Carmen Ehrman, Dashiell Bennett at Dashbot, and Kale Brooks at Kale Brooks. Thank you to our producer, Moses Andam. For more Oddbots content, go to bloomberg.com slash oddbots, where we have transcripts, a blog, and a newsletter.

55:39And if you want to chat about all of these topics, including AI and robotics. There's a room in that in the OddLots Discord chat room, discord.gg slash oddlots. Go check it out. And if you enjoy OddLots, if you want us to crowdsource buying a Unitree humanoid robot or something similar. On AliExpress. That's right. Then please leave us a positive review on your favorite podcast platform. And remember, if you are a Bloomberg subscriber, you can listen to all of our episodes absolutely ad-free. All you need to do is connect your Bloomberg subscription with Apple Podcasts. Thanks for listening.

56:46We buy insurance for peace of mind, but every year millions of claims are denied. Not because people did anything wrong, but because their policies quietly excluded what happened. Insurers know every detail. Policyholders rarely do. That's why My Policy Advocate exists. For just 27 cents a day, their platform reads your policies and explains where you are vulnerable. They don't sell insurance. They deliver transparency. Before you trust your policy to protect you, let My Policy Advocate tell you what it really says. Go to MyPolicyAdvocate.com. In business, a thoughtful gift does more than say thank you.

57:20It recognizes achievement, builds loyalty, and shows someone they are genuinely valued. With 4imprint, you can choose from thousands of high-quality products, apparel, drinkware, tech, and more, designed to leave a lasting impression. And with expert support, dependable service, and their 360-degree guarantee, your gift will arrive exactly as intended, on time and on brand. Explore gifting with purpose at 4imprint.com. 4imprint, for certain.

From the publisher

Over the last year or so, probably every venture capitalist has become interested in artificial intelligence. So people are still figuring out what types of business models actually work, and who will end up making money in the space. Josh Wolfe has been at it for a long time. As a co-founder and managing partner at Lux Capital, he's been involved in a number of deals in the space, and is already looking at what's next after the wave of excitement for chatbots since ChatGPT was released. On this episode, we talk to Josh about what he's excited about right now, including robotics, biotech, and maintenance. He tells us that just as ChatGPT opened everyone's eyes to the power of chatbots, a similar moment is coming in the robotics space.

See omnystudio.com/listener for privacy information.

More from Odd Lots

All 682 episodes
Josh Wolfe: The ChatGPT of Robotics is ComingOdd Lots · 52 min
Listen in VO