In short
AI security and “rogue agents” defenses (NVIDIA Open Agent Safety Platform); Meta’s enterprise push via hiring MongoDB’s CEO; Tesla’s Optimus humanoid robot production scale-up; Ginkgo Bioworks’ AI-vs-humans protein-design competition; Zapier’s view of AI agents vs deterministic automation.
Guests (and backgrounds)
- Gil Luria, Managing Director, Head of Technology Research at DA Davidson.
- Grace Kay, The Information reporter covering Elon Musk/Tesla.
- Amy Doxler-Marcus, The Information health and science reporter.
- Wade Foster, CEO of Zapier (automation/integrations platform).
Key claims
- NVIDIA’s safety products are “symbolic” and meant to coordinate defenses; agents are likened to viruses, with humans as the unleashing cause.
- Meta is positioning itself as a cloud/enterprise competitor; MongoDB’s CEO move signals seriousness.
- Tesla can ramp physical robot output but the hardest part is the internal AI for autonomous task performance.
- Ginkgo’s contest tests scientific “recipe” creation (protein reactions) and reframed competition to address AI training/data concerns.
- Zapier argues deterministic workflows should run critical steps; AI should assist where judgment is needed.
Notable examples
- Optimus: several hundred robots/week (Aug), goal >1,000/week; Fremont line repurposed; “alpha” internal testing; hand manufacturing complexity (100+ components).
- Ginkgo: protein-design “bake-off” with three rounds; community “Team Human” vs OpenAI agent fleet; Ginkgo assesses by running recipes in its autonomous labs.
- Zapier: claims 80% of agent work could be deterministic; “mini-agent” Zaps run reliably.
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Chapters
Tap a time to open that second in VONVIDIA's New AI Safety Platform
1:04 to 4:30
Discussion on NVIDIA's new platform to enhance AI safety and security.
“NVIDIA released a new product this morning to fight against agents going rogue.”
Concerns Over AI Agents Going Rogue
4:30 to 7:20
Exploration of the risks associated with AI agents and the potential for malicious use.
“What's really important is getting everybody together to make sure that they have an approach to use the most advanced models to harden their own code.”
Meta's Enterprise Strategy and Leadership Changes
7:20 to 11:12
Analysis of Meta's recent leadership hire and its implications for enterprise strategy.
“He said, we found a fix for viruses and we'll find a fix for the agents.”
MongoDB's Position After Meta's Move
11:12 to 14:00
Discussion on how MongoDB is affected by Meta's hiring of its CEO and the competitive landscape.
“And now, because they have the computer resources, technology world, the leadership, they're going to go after that market, not just the code market.”
Impact of Zuckerberg's Moves on MongoDB
14:00 to 16:10
Learn about how Mark Zuckerberg's actions are affecting MongoDB's stock and leadership.
“Let me ask you very quickly about MongoDB because they are the company that are sort of the collateral damage here on Mark Zuckerberg's excitedness.”
Tesla's Optimus Robot Production Challenges
16:10 to 24:44
Discover the latest updates on Tesla's production of the Optimus robot and the challenges they're facing.
“My colleagues Chenna Liu and Grace Kay reported that story.”
AI in Protein Design Competition
24:44 to 28:01
Explore the competition between AI and human researchers in designing proteins and its implications.
“Amy Doxler-Marcus, the information's health and science reporter, covered that story in detail this past weekend with some startling findings.”
Exploring Protein Development vs. AI Drug Discovery
28:01 to 29:56
Discussing how protein development differs from AI-generated drug discovery and the creativity involved in scientific processes.
“they wanted to test who would do it better, AI agents or people, person.”
The Evolution of the Protein Competition Concept
29:57 to 32:06
Examining the changes in framing a protein competition from individual scientists against AI to a broader community approach.
“You know, Kasparov, you know, the world-reigning chess champion going up against a supercomputer, or, you know, Lee Sedol, the reigning Go champion going up against AlphaGo.”
AI's Role in Scientific Inquiry
32:07 to 35:02
Investigating the implications of AI in scientific research, including its potential as a collaborator or competitor.
“And then who will judge these recipes or these scientific processes down the line.”
Show all 14 chapters
The Intersection of Automation and AI
36:05 to 39:20
Delving into how automation platforms like Zapier can coexist with AI agents to enhance productivity.
“Walk me through your business because I think a lot of people may have used it in some way, shape or form without knowing what it is exactly.”
Ensuring Predictability in Automated Workflows
39:21 to 42:04
Discussing the importance of deterministic workflows in avoiding unpredictable behaviors of AI agents.
“I mean, you know, does that mean there's sort of an end state to the automation or the function?”
The Challenges of AI Misuse
42:04 to 43:36
Discover the reasons behind AI agents going rogue and the misconceptions surrounding their use.
“So, okay, so if that's your view on how to prevent, so why do you think we have found ourselves in this mess then where we have agents going rogue?”
The Future of Software Engineers
43:36 to 44:58
Explore the evolving role of software engineers in the age of AI and automation.
“There's more engineering job openings than there ever has been before.”
Transcript
Automatic transcript. May contain errors.0:13Gil Luria:Welcome everyone to the Informations TI TV. My name is Akash Pasricha. It is Monday, September 28th and it is a busy news morning. NVIDIA is out with a new platform to protect against Asian hacks, and Meta has poached the CEO of MongoDB for its new enterprise software push. We're going to get to the implications of both of those announcements shortly. We're also going to dive into exclusive reporting on the current state of Optimus and Tesla's humanoid robot production scale-up. We're also going to be talking with our health and science reporter about Ginkgo Bioworks and how the biotech company is hosting an initiative to see if AI can solve some of biology's hardest problems.
0:56Gil Luria:And we're going to close out the show with a conversation with the CEO of Zapier. It's going to be a great show, so let's get right on into it. Jensen Huang is taking matters into his own hands. NVIDIA released a new product this morning to fight against agents going rogue. Jensen, of course, has been very outspoken on why AI products need to be more secure. And Mark Zuckerberg also made a big move this morning, poaching the CEO of MongoDB for his enterprise push. To break it all down, I want to bring on Gil Luria, Managing Director, Head of Technology Research at DA Davidson. Happy Monday to you, Gil.
1:31Gil Luria:Happy Monday. What a Monday morning indeed. I want to get to all of the headlines. I want to start with NVIDIA. So Jensen has been louder than anyone on this topic that we don't need regulation. We just need more safety. Do we need more thoughtfulness about products and how they're being released? Here he is taking matters into his own hands. Walk us through exactly what it was and NVIDIA announced this morning. So NVIDIA recognized, Jetson Wong has been solving all the problems in the AI value chain because his perspective is if I can build the whole value chain, the whole market, the whole ecosystem, there'll be a lot more supply that will feed demand and keep the growth of AI.
2:14I know by the way that they'll buy my GPUs. And so he solved a lot of problems along the way. This is just the most recent one. He saw that the main concern around AI is around safety. And so he took it head on. He said, hey, I'll give you the safety products and I'll bring everybody to the table so we can implement them together. And he's making a very important point, which is for all the scare that we're getting from the labs, the only thing that AI models do well right now is hack systems. They are incredibly powerful, but the dangerous thing they do is that they can hack into any system. And so if what we need to do is make sure that all our important systems are safe, this is the move to say, let's have a safety framework and let's bring the important people to the table to make sure they're implementing it internally.
3:03They're looking at their own code with the most powerful models and implementing the fixes so when bad actors have their hands on these powerful models, then they'll be more resilient. There was a need in the market. Jensen Wan had the wherewithal and resources and position to step in and do something about it.
3:24Gil Luria:Okay, so now what they've actually released, the open agent safety platform, it's called, and they also have this open shell platform, which I'm not sure if they had that already before. So this is a software that they're hoping enterprises will buy and attach onto their products? Is this something that the labs will use? What exactly is this and who's going to buy it? I would call the product as more of the symbolic part of this. No one product is going to be able to defend us from these very powerful models. Bad things are going to happen, to be clear. There will be more hacks, and some of these hacks will be initiated by malicious actors, not by irresponsible actors.
4:11Up until now, All these attacks have just been irresponsible engineers at Anthropic and OpenAI, sending the agents into the free world without any guardrails. When these models actually get into malicious hands, they will be attacking us and they'll be attacking our most vulnerable, most important infrastructure companies and agencies. So the product itself is symbolic. What's really important is getting everybody together to make sure that they have an approach to use the most advanced models to harden their own code.
4:44Gil Luria:When you say symbolic, is this not a software that they're encouraging people to buy? Is it just a framework then or what is it actually? It's unclear how much of the product they're actually going to be providing. I doubt they're going to even be selling it. This is so important in video. This isn't a revenue line. This is just them stepping in and facilitating the defensive part of the AI models. What service they provide is almost beside the point. There is a product they'll probably provide it for free. But what's more important for them, just like with Nemotron, they don't want to be in the open source model business.
5:24They don't need it. They don't need to sell open source models. They need there to be American open source models, open-weight models. And since nobody else was doing it, they said, hey, we'll step in and make a point of the fact that we should use American open source models. Now they're stepping in and saying, there needs to be safety and security products. That's the way to mitigate risk. If you don't do it, we'll step in and do it and we'll provide whatever we can. But really, we're just encouraging everybody to come to the table and start working on this problem.
5:53Gil Luria:Yeah, and I'm certainly thinking about the taking the American leadership approach to this. And NVIDIA is very much, you know, look, Jensen and Trump agree on this issue. And so maybe there's something to that as well. Jensen sees President Trump as part of the ecosystem. So just like he has influence over clouds and model companies and hyperscalers, part of his sphere of influence includes this administration and he's played that very well and very deliberately he hasn't been entirely successful he's not selling chips in china right now yeah he has been able to get the administration to be reasonable and it's an approach right although i should point out i mean so we we reported that um that china is considering allowing uh domestic companies there to purchase uh more chips now from the likes of nvidia um we've been talking forth on that for the last year year and a half yeah my sense on that we're not selling my sense on that is is is you know whether or not china says one thing or not i mean it's nvidia is still not going to include it in their in their financials for a long time coming it's not going to be significant so that that really would be the thing that that moves the needle um i i would ask you about the the meta stuff in a second gill but i have one more question here, which is that Jensen has likened agents going rogue to viruses that we saw when software initially was coming into the world.
7:32Gil Luria:And he said this on CNBC. He said, we found a fix for viruses and we'll find a fix for the agents. Do you think that is a fair comparison to make? I think there's a parallel here. And importantly, we can't forget that humans unleashed it. So this is a human unleashed virus, right? Again, it's engineers at OpenAI and Anthropic that put out swarms of agents and told them, go accomplish a goal, however you want to do it, whatever it takes, unlimited time, unlimited resources, do whatever you want. That's how we got into this mess. And yeah, they weren't deliberate about it. OpenAI and Anthropic are in the business of shifting liability to the government.
8:15They're in the business of regulatory capture. this played into their hands. And that's really what's going on here with these agents. So it's a human-engineered and released virus, but it is very potent. It's orders of magnitude more potent than the computer viruses we've dealt with in the past. It's incredibly powerful, incredibly potent. Again, bad things are going to happen. We have to prepare ourselves for that, both in terms of how we react to it as well as what we do to defend ourselves when these attacks happen right right
8:48Gil Luria:uh gill i want to get your take on another headline this morning so meta has poached the ceo of mongo db and uh i think what they're calling him now is the chief enterprise platform officer which is that that's a new i haven't heard that one for the sepo that's a that's that's a new title i guess so i mean look meta has been making a push for the enterprise for many years now it finally has a product that's that people seem to really uh i mean i think it has enterprise potential i mean muse people are liking it you came on the show when it first came out the reviews were good now it has the agent so is this it is this the enterprise play for meta it is and so So what happened was just a few weeks ago when Mark Zuckerberg went on a conference call and said, hey, we have plans for AI.
9:41We're going to have a consumer assistant. We're going to have an enterprise strategy. Trust me. The market responded by selling Metashares because it was very nonspecific. Right. He said it before. The investment was very specific. Right. The investment was large and specific. Now we know what he was planning. Muse is very compelling. That is the AI assistant. That could be very compelling. and now there's clearly an enterprise product that's going to be competitive with Google Cloud, Amazon Web Services, and Azure. And to make sure that we realize how serious he is, he hired a CEO of a publicly traded company to leave this business.
10:21Mind you, that's cheap compared to hiring Alexander Wang for$14 billion. But it's the same point. It's Mark Zuckerberg will be a player and he is making very clear that everybody knows he's a player and he'll do whatever it takes it's a signal to the market and it's a signal that he's bringing a very well-respected leader in enterprise software to do this to attack this market because he already has the compute resources he has the technology wherewithal now he wants to enter this
10:50Gil Luria:new market have you or your team at all modeled out how big you think this an enterprise business could be for meta i mean even if we just take uh muse code as as one example here you know leave out the agent just if you take code and you think about the penetration that claude has had with anthropic and they are our growth rates have you have you put any numbers to this at all to see how big it could get i think we know orders of magnitude right the code market in itself is billions if not tens of billions just ai for code but he's going after the bigger opportunity If you add up AWS, Azure, and Google Cloud, now we're talking about approaching half a trillion dollars of profit, of revenue that those three companies have that Meta has not participated in at all.
11:41And now, because they have the computer resources, technology world, the leadership, they're going to go after that market, not just the code market. That's a very big opportunity. That's a very big pie that they're going to try to slice their piece out of.
11:54Gil Luria:So you think they're going full vertical integration here? It's not one or the other. I mean, we are going to see it in the next two years, you know, give a suite that is as broad as something like Azure AWS. Yeah, he's had that option for a while. And I think he was waiting to have the resources. And again, he has a lot of excess compute. It doesn't matter how much you and I use Muse. He's still sitting on data centers that are underutilized. So he can turn around and sell that capacity. And with a whole enterprise suite, he can actually sell it at a markup the same way, especially Microsoft, Amazon, and Google do.
12:32So it's a very big opportunity. I think I'm sure he gets is to be determined. And he doesn't have a natural customer base, right? He doesn't have any of these large businesses as customers apart from an advertising basis, but he has the ability to do it. And anything they do is really upside to the current line of business that they have.
12:50Gil Luria:Right. Oh, well, because that's what I'm thinking about is that, you know, while they may very easily attract customers, enterprise customers for the agent and for the coding product, I mean, migrating, you know, an entire cloud infrastructure um that almost seems i mean that's much harder than just selling the compute capacity on its own which you know that might i feel like they might go uh you know on the high level on the low level before building out a cloud product in the middle that's a really important point and what i would say is that means they'll probably go after the google cloud market so smaller companies startup companies that are already on the meta platform advertising.
13:36There's a corporate relationship. Companies are relying on meta for their marketing, and therefore, it's a natural upsell for them. And again, that's the part of the market that Google is most participating in, right? Microsoft is the largest companies. AWS covers really the entire span of companies that use cloud and AI compute. And Google Cloud tends to skew more smaller companies, SMBs, startups, which is more likely that that's the market meta is going to start off with.
14:05Gil Luria:Right. Let me ask you very quickly about MongoDB because they are the company that are sort of the collateral damage here on Mark Zuckerberg's excitedness. So, yeah, shares are down. I mean, they're down 20 % as we're taping this. I think they were down a little bit further earlier this morning. I mean, look, Mongo, we should say CJ Desai, the executive here that Mark posted, I mean, he has had a heck of a three years. ServiceNow, Cloudflare, MongoDB, and now Meta. So, you know, he's getting no less busy. What do you think this leaves MongoDB with? This is a company that we talked about AI being a beneficiary for companies that operate in the back end, not so much the front end.
14:53Gil Luria:And what do you think that leaves this company with? Well, it's never fun to wake up to your CEO leaving to take a middle management job. It's a little insulting. There is that. But it doesn't change Mongo's business. They have a good business selling the operational databases. It's a nice niche within the ecosystem that has some leveraged AI, but really not that much. It's not a core technology for deploying artificial intelligence. And in fact, where the winds are blowing is more companies are actually using open source Postgres for more database needs. Mongo really just has been left with a niche.
15:30And it's not a bad niche, but it's not a great business. If I was CEO of that business and I had an opportunity to lead the fourth hyperscaler, I think that's not an unreasonable decision. And again, somewhere between where he's making now and$14 billion is probably what lured him away anyway.
15:49Gil Luria:Yeah, Chief Enterprise Platform Officer certainly seems like a negotiated title, but we'll see if it catches on. I guess it certainly couldn't have been Chief Enterprise Officer because the acronym wouldn't have worked there. Gil, I want to thank you for coming on. Great conversation as always. That is Gil Luria from DA Davidson here on TITV. Tesla is trying to scale up production of its humanoid robot Optimus and new exclusive reporting from the information revealed the extent to which it's actually been able to do that and also the challenges that still remain. My colleagues Chenna Liu and Grace Kay reported that story.
16:32Gil Luria:I want to bring on Grace to share more about what they learned. Grace, welcome back to the show. It's great to have you here. Hi, thanks. So how is Tesla's Optimus build out going right now, Grace? Yeah, so Channer and I discovered that they've been ramping up production tenfold in the last few months. But at the same time, they've discovered some challenges with building this robot at scale. So they've had to make a lot of changes. They've been changing the robot design and changing the factory lineup, you know, kind of in tandem. And so how many are they able to produce every week now? What was the goal that they were trying for?
17:09Yeah, so they were at several hundred in August. According to our sources, they're producing several hundred, like five, six hundred robots a week. And the goal ultimately is within the year to be producing more than a thousand a week, which would be another significant ramp up. But ultimately, Elon Musk has said that that site in California is going to produce about 20 ,000 a week with a goal of a million, you know, a million robots a year.
17:35Gil Luria:And has he given a timeline for that 20 ,000 number at all? Because I know every earnings call, it seems to be a bit of a moving target. Yeah, it's a shifting timeline. I don't think the timeline for a million robots is clear yet. I think they still have to make some changes to the internal AI system for the robots too before a million robots would be useful. Right. And where are they making these? Right now they're building a line in Fremont, in the Fremont factory in California, in place of the Model S and Model X lines. So they discontinued those cars and they're now building Optimus there.
18:10They're also building a much larger line in Austin as well, but that's not up and running yet.
18:16Gil Luria:And so in terms of what they are actually building, so the, I think you said it was 100 units a week right now? Several hundred. Several hundred. Okay. Several hundred. Sorry. We're not quite at 20 ,000. We're at several hundred. But so what they are actually producing, how close is this to the commercial version of the robot that inevitably could get sold? How far are we in that process? Yeah, this is still a very early version. So they're calling it their alpha version. So this alpha version is basically for internal testing. It's mostly being used for data collection, training, you know, testing the durability of the robot.
19:02And then they're also using it on a smaller scale at some very confined areas in their factories in Austin, Fremont, even in Berlin. but it's not for external use. And, you know, there's this alpha version and later they plan to build a beta version which will be used with customers. So, you know, it'll be more validated. It'll be more streamlined, more reliable.
19:24Gil Luria:Now, one of the other parts that you touched on in your story are some of the challenges that the production scale-up is going through. Talk to me about why they haven't been able to reach their goals and what it's looking like on the ground from a technical perspective? Yeah. So it's one of the difficulties Tesla's running into is I think the same one that all these robotics companies are running into. It's such a developing, you know, it's a new industry. So they kind of have to figure out how to set this up from scratch. And it's something Elon Musk has talked about. They're having some issues with like the placement of the machines on the line because the Optimus parts are very small.
20:01They're also having some issues with the hands, which are very difficult to manufacture at scale. Someone told me that there's more than 100 components, including very small screws that need to be put together by hand in order to build these super intricate hands that, you know, essentially are supposed to have the dexterity of a human hand.
20:18Gil Luria:Well, that's a little ironic, don't you think? Yeah. Trying to automate everything to make these by hand? I mean, that's not terribly efficient. Yeah, and that's something that they're trying to fix, something they're trying to address. And also, I think there's some issues with the durability of, you know, the machinery on the line because they're trying to fully automate this process so they can pump out all these robots. You know,$20 ,000 a week, you have to have a pretty automated process to do that. And what about cost? I mean, if they're doing it by hand, then surely the cost can't be as efficient as they want it to be.
20:53Gil Luria:Have they been able to make any progress at all insofar as bringing the cost down? Or where are we in that? Yeah, we don't have as clear a view on cost. I think we've definitely heard that the hands have made it more expensive because they've had to do The design for the hands has changed several times. It's a major engineering feat to develop these robotic hands that are equivalent to humans. So that's definitely increased the price. Elon Musk has said that they want to eventually sell it for$20 ,000 to$30 ,000, and I can't imagine they're anywhere near that right now. What about the training of the robots?
21:28Gil Luria:Where does that stand right now? Yeah, so there's like two very different problems. So one problem is trying to build a robot, and that's its own engineering difficulty. And I think a much bigger difficulty is figuring out how to build this internal AI system where the robot can perform all these tasks. And that's the one thing I think I'm less certain about of how that's going to shake out, what the timeline will look like for that. Right now, it can only perform very specific tests that it's been kind of pre-programmed for. And when it finds itself in a variable environment, it can't act. You know, it doesn't necessarily always know how to act.
22:03It's a little unpredictable.
22:04Gil Luria:Right. And I guess maybe just going back to not just the training, but also the manufacturing component here. I mean, one thing I've been thinking about is how much of this is inside Tesla's control and how much they rely on outside partners for. is a lot of this is a lot of the supply chain issues right now or is this something that they are confident they can solve down the line yeah i think it's a mix of both so tesla is kind of known for being incredibly vertically integrated and they are building a lot of this machine in house um but they are also reliant on suppliers i think mainly in china a lot of the robotics companies are getting their parts from China.
22:48But because the humanoid robotics is so new, the supply chain isn't really set up. So getting these suppliers to build these parts at scale is another difficulty that could hold them back.
23:02Gil Luria:So Grace, what's your best guess here, or I guess your latest guess then, on whether or not Tesla can inevitably get to the 20 ,000 number? And also, not just your opinion, but the people you talk to, I mean, like, are these solvable problems? Is this something that it will just take time? Or is this really something that we just don't have the solutions for right now? Yeah, I mean, I think it's like a two-part problem. Like, Elon Musk and Tesla, they're, you know, they're really great at the manufacturing side of things. And I do think that they will probably be able to build a robot, you know, a physical robot.
Read the full transcript
23:37I think the bigger challenge is, are they going to be able to build an AI system that can perform all these tasks, you know, put itself in an environment and act autonomously. I think that's something that would need, you know, as we are right now, like a major breakthrough. And I think that's the larger question. Like, I think they could build, you know, a physical robot that could maybe, you know, perform these tasks if it was teleoperated, but building the inside is going to be the difficult part.
24:01Gil Luria:Right. And rebuilding the product suite for Tesla altogether. I mean, you know, moving it from a car company ethos to a robot company. I mean, that's, that's a high bar. It's not just building a robot, it's building the robot. And then finding a market for who wants once you build this thing, who wants a robot like that? Right, right. I mean, because you know, I think it's going to be a lot more than$20 ,000,$30 ,000 out of the gig too. So we'll have to have robot financing, I guess, in place for some of these devices. Okay, well, it was great reporting, Grace, by you and Shanner. I want to thank you for coming on and sharing more with us about it.
24:38Gil Luria:That is Grace Kay, our Elon Musk reporter, here at The Information. OpenAI's models solving some of the world's most difficult math problems has very much been a hallmark of AI's potential, but some scientists are also trying to test the model's strength in the realm of biology and designing proteins. Amy Doxler-Marcus, the information's health and science reporter, covered that story in detail this past weekend with some startling findings. I want to bring her on to share more about what she found. Amy, welcome back to the show. It's great to have you here. Hello. Always good to talk to you. So before we get into this race that is shaking out here in the world of biotech and AI, the company at the center of the story is Ginkgo Bioworks.
25:25Gil Luria:Tell us about what this company is. They run autonomous labs. So instead of scientists sitting at a lab bench pipetting chemicals or, you know, growing stuff in petri dishes. Imagine robots doing all the work and you could like, you could order up an experiment and the robots could do it for you. And presumably this is not, this is not anywhere close to humanoid robots doing this. These are like machines basically doing experiments in a more industrial fashion. Yeah. I visited their lab. It's actually really cool. It's, you know, these machine kind of robot looking arms encased in glass and there's like tracks that run so that all of the, you know, all the different things get moved from, from station to station.
26:10You've got like maybe one or two humans just making sure the lab runs, but it's, it's pretty autonomous.
26:16Gil Luria:Right, right. Okay. And so they're at the center of this competition. Can AI rival human researchers in the realm of biology. What is this competition that they themselves have sort of created or tried to create? Walk us through the backstory here. Yeah. I mean, the original idea was they wanted like one person, you know, one scientist to go up against a fleet of AI agents from OpenAI. And that part of the story is how that kind of didn't work out. And they had to revise the competitions set up in part because of all of the tension that's emerged in recent weeks with, you know, is AI better than people when it comes to science now?
27:03Gil Luria:And so the race was designing protein, like who could design a protein faster or better? Or what was the exact? Yeah. So let me, I'll just briefly like, you know, proteins are the building blocks of our lives. when our proteins aren't working, we get sick. And they're also therefore a backbone of the drug development industry because a lot of drugs are proteins or they're being designed to fix proteins. So it's a really important issue in science and in drug development. And they wanted to see, they had a series of three challenges. Each round was going to involve developing a protein reaction that was a little bit harder each round, but that was the idea.
27:44If you took out the fact that robots can just look for proteins and develop proteins faster, if you just put the ingenuity of scientists, the devising of experiments, building on the data and refining your experiment, they wanted to test who would do it better, AI agents or people, person. Right.
28:07Gil Luria:And Amy, can I just ask, I mean, these proteins that they're trying to see if they can develop, how is this protein development different than, you know, AI generated drug discovery? I mean, this is something we've heard about for many years. So what is the difference here between what they're trying to do? I mean, like they chose three different challenges that would be like important for scientists who are trying to work in labs and also scientists who might want to work in labs that eventually will lead to drug development. But the goal was not so much to create something that was going to become a drug that everybody is going to use.
28:49Rather, it's trying to get at a concept of the scientific discovery process. You know, it's very important, like overall in thinking about who can do the scientific process better, you know, and that involves a lot of creativity. I think a lot of people don't realize how much of science is also art and not just, you know, thinking about equations. And that's what they were trying to get at. Got it.
29:15Gil Luria:So this wasn't medicines or drugs. This was just finding different combinations of proteins. Is that the idea? I mean, it's the idea of coming up with a formula that could create a reaction, and then you would know who came up with a better formula. Think of it more like a bake-off, right? Got it. You know, like who's going to come up with a recipe for the best cake? got it got it so it's the it's the recipe that that we're after not not necessarily the end product okay yes yes so so so ginkgo so they uh they come up with the idea for this competition but then they decided to postpone it then they they brought it back in some way shape or form walk us through sort of the the the hiccups here i guess i think the major hiccup was they started getting, I think, a little bit uncertain about the framing of the contest is being an individual scientist going up against a fleet of AI agents.
30:18You know, Kasparov, you know, the world-reigning chess champion going up against a supercomputer, or, you know, Lee Sedol, the reigning Go champion going up against AlphaGo. Like, they originally framed it to be like that, very dramatic. One person against AI. You know, what does this say about us? And then stuff happened that made them sort of think twice about whether that was the right framing for their contest.
30:44Gil Luria:Stuff happened, meaning you're talking about the Naviar Stokes open AI beating the mathematicians, people sort of getting all up in arms about, well, they were using maybe some of the training data. You know, that seems to be what ruffled the feathers of Ginkgo. I think that was part of it and a major part of it, a major driver of this. In science, people do use other people's work. I think that that's a huge building block of science, but you are supposed to credit other people. You're supposed to acknowledge, and I think that can be some of the tension. Are these companies fully acknowledging the work that they're building on.
31:27And I think, you know, that was some of it. But, you know, the competition is still happening. It's just that instead of it being so much on the shoulders of like one man or one lab, they've decided to open it up to the community, the wider community. If you're interested, if you're interested in joining, you know, Team Human, you can join Team Human. If you want to like go it alone with your lab and enter the contest and go up against OpenAI's, you know, fleet of AI agents, that's also acceptable. But I think one of the main lessons that you could draw from this is that it's really hard to be Garry Kasparov.
32:05Gil Luria:Right. And so now they've sort of framed it as a community, the biotech community of human researchers against AI. And then who will judge these recipes or these scientific processes down the line. Is this Ginkgo that will do the assessing? They are going to do the assessing. And they're going to run the recipes that are submitted. They're going to run them at the same time in their autonomous lab with the robots. Everybody's going to have access to their robots. And they've come up with a set of criteria on how they'll judge the winner of each round. And then the winner of the competition would be the winner of two out of three of the rounds.
32:45Right.
32:46Gil Luria:And Amy, I mean, just taking a step back here. So this co-op petition as you reframed it in the story or as the company seems to reframe it. They did. Not me. You explained it in the story. You pointed on the story. It was not a word that we had used very often. And so I very much appreciated the explanation of what a co-op petition was. But they have framed it as that. What do you think the significance is for this co-op petition and how the biotech and AI story will play out more broadly? I mean, now I guess there won't be a winner, although, well, there will be a winner. So what happens then?
33:31Gil Luria:If AI wins, then what? Yeah. I mean, look, AI, some of this reframing of the competition, I think also says something very important, which is they couldn't tell the scientists that they can't use AI when they're trying to come up with their own recipes because a lot of scientists already use AI in the lab. So open AI's advantage here is it's going to have access to its internal models that haven't been commercially released. The scientists can only use AI that's been commercially released. So you'll get to see how good some of these models are and how rapidly they're developing. and I think we're going to find that the AI models in biology and science already are rapidly developing and are better than we even know.
34:19That's one thing. But I think more broadly speaking is I think scientists and all of us that are interested in science, and we should all be interested in science, I think that we've reached the point now where we have to understand what role AI models are going to play in the development of science. We have to think about how we're going to credit that. We have to think about whether these AI models are going to be like rivals to human scientists or they're going to be, you know, colleagues, you know, working on joint projects. And then I think the bigger question that remains unanswered, but that we'll keep covering is what happens when AI models come up with their own scientific questions?
35:01Like right now, we're assuming that we're going to, we're going to ask the questions and they're going to like do the work and we're going to see if they do the work faster and better than we do. But when they really let loose, when they're really good, and I think they're going to get really good pretty soon, like what if they ask questions that we don't like? And, you know, who gets to ask the questions in science? It's actually a really interesting and provocative and kind of philosophical question that we should all be concerned about the answer.
35:29Gil Luria:Right, right. Well, Amy, there is so much more to share on this topic. And so I'm looking forward to all of your reporting to come I want to thank you for coming on. That is Amy Doxramarkas, our health and science reporter here at The Information. The agent conversation is all about automation, but automation is not a new capability for software. In many ways, companies have built entire businesses on this for years now. Zapier is one of those companies. I want to bring on CEO Wade Foster for a conversation about this moment for his business. Wade, welcome to the show. It's great to have you here.
36:04Wade Foster:Yeah, thanks for having me.
36:05Gil Luria:Walk me through your business because I think a lot of people may have used it in some way, shape or form without knowing what it is exactly. So just remind us what the company is.
36:16Wade Foster:Yeah, Zapper is an automation platform. We started 15 years ago, focused on integrations, connect the apps that you use. But in the AI era, it's increasingly easy to have AIs build those automations for you. And we make it really easy to hook those automations up to all of your data, connect to your email account, your CRM, your project management tool, you name it, and build automations that are reliable, performant, low cost, things like that.
36:43Gil Luria:And so in some ways, I mean, I guess, were you guys kind of building the original agent before there was an AI agent with all this automation?
36:53Wade Foster:Yeah. I mean, you can think of a Zap as kind of a mini agent. The difference was it didn't have, it was all deterministic, right? It didn't have an AI sort of trying to guess how to do the steps. It just performed exactly the way you wanted it to do every single time.
37:08Gil Luria:Right. So then I want to ask you sort of the flip side of that question, which is that you guys were doing agents or Zaps before AI very much became popular. I mean, what do you say to people then that say, well, AI agents could mean competition for Zapier's business and maybe we don't need automation software like yours as much if we can just build it with, you know, with Claude or OpenAI.
37:36Wade Foster:Yeah, I think that these agents and deterministic workflows actually should coexist. And in many ways, that's what we're building with Zapier is you have a, if you use Zapier, if you install Zapier into your agent of choice, now instead of you as a human having to build those automations, click, click, click, click, click. Instead, you can have your agent go build that automation. But when it runs, if you use Zapier, it will run as deterministically as possible. And this has advantages over agents because it runs predictably, it runs reliably, it runs low cost, and it only uses AI in the places that you actually need it.
38:16Wade Foster:We did a study across all the agent usage across Zapier, and it turned out that 80 % of all that work could have been done with simple deterministic workflows. And if you do that, you're going to burn way less tokens and you're going to get way more accuracy. So I think it's a matter of agents and workflows actually should coexist. One does not replace the other.
38:35Gil Luria:So when you say that the, so you're talking about agents building the automations in the background, that's sort of where Zapier's business has lasting sustainability.
38:47Wade Foster:Running, running the automations is the challenging part, right these running agents break there's things that fail uh and you want them to run as efficiently and cost effectively as possible now when it comes to building you probably do want to delegate the building to an agent because for humans it's hard you have to think through like exactly what the logic is you don't know how to uh you know sort of um break down your processes as well as possible so it's really nice to be able to talk in natural language and have the agent go build it but when you go but what it builds you want it to build something that's as deterministic as possible and as reliable as possible.
39:20Wade Foster:Right.
39:20Gil Luria:And so when you say deterministic in this case, I mean, you know, does that mean there's sort of an end state to the automation or the function? In other words, once it completes a task, it's over. There's nothing recursive about the automation. That's sort of the way that you've built your business traditionally. Yeah.
39:42Wade Foster:I mean, most people want their agents to be goal-seeking. They want to achieve a goal. and usually you assign them a particular task and you want them to do that you know job anytime you have that job come up and so you know maybe it's I want you to score leads or I want you to reach out to prospects or maybe it's I want you to prep me for meetings or you know I want you to respond to support tickets and so anytime there's you know a task that pops up that has that goal you want the agent to go achieve that goal and work it from start to finish right but I think in the ideal world, it's using a mix of code, deterministic workflows, and probabilistic ones, AI workflows, to achieve that goal.
40:22Gil Luria:Well, and the reason I'm asking the question is because now all of the concern is around these agents going rogue and taking actions that they didn't want. And given that you have been building an automation business for so long, I mean, I'm trying to sort of suss out if maybe there were any lessons that you learned when you were initially building these automation functions that you think these AI labs should be keeping in mind as they seek to automate even more work? Because, I mean, you know, there's all this talk about regulation, whether or not that's correct, but then there's a talk about how you actually build the product and build the guardrails around that and enable safety.
41:07Gil Luria:How do you sort of reconcile this automation conversation, is there anything that you wish you could see more of?
41:13Wade Foster:Well, I think you said the important thing, which is oftentimes these agents don't behave predictably. They do things that you as the user don't want. And so when you're thinking about the critical workflows you have in your business, you want them to run a particular way. And this is where deterministic workflows are so valuable because they use code. They use code to do the same thing every single time. And so So most workflows can be broken down into something that is more predictable, that is more deterministic. That doesn't mean you don't want AI. You probably do want AI when there's a management decision to be made, when there's judgment to happen.
41:48Wade Foster:But that's not every step in the workflow. And so if you lean harder on determinism, you get more predictability and you have less of a chance of the workflow doing something that you didn't want. So if you want to align to a human, the simple way to do that is to take out AI when you don't need it.
42:05Gil Luria:So, okay, so if that's your view on how to prevent, so why do you think we have found ourselves in this mess then where we have agents going rogue? What is the root cause of it, do you think?
42:18Wade Foster:Well, you know, I think a lot of it is that, you know, you're using agents for jobs that don't necessarily need it. And right now we are in a world where most companies are incentivizing their employees to token max to use AI for everything. And don't get me wrong. We use AI a ton at Zapier. We want to use it everywhere inside of our own company as well, too. But, you know, there is a real skill in using AI effectively. uh you know it's you know i i sort of it's kind of like when you go you know if you get really into something i don't know you got really uh into uh uh you know workshopping or something like that and you bought this fancy new tool from the shed and i walk around and everything looks like i want to find reasons to use this thing but it's just one tool that you have there's many other such tools uh that can be used to do the job right now ai is the tool uh that is popular and so But, you know, we're probably overusing it for many tasks.
43:12Wade Foster:Right.
43:13Gil Luria:When you were starting out building Zapier with automation, were there the same questions around what are software engineers going to do, you know, for automating some of this stuff? Did you face some of those questions? And obviously they didn't go away. So the reason I'm asking is what do you make of this conversation about what are software engineers going to do with AI?
43:38Wade Foster:no you know i think a lot of the discussion is you know pretty short-sighted i think uh you know for most of history well all of history uh we have found ways to build tools to automate work to do things more efficiently and every single time we do the job doesn't disappear it just evolves uh and i think that's what's happening again now and in fact if you look at the data uh the data would suggest that the demand for engineers is at an all-time high. There's more engineering job openings than there ever has been before. Now, what engineers do on a day-to-day basis looks quite different. No one's writing bespoke code anymore, but the demand for the output that engineers can deliver is higher than ever.
44:21Right.
44:22Gil Luria:And so I was at an event last week, actually. It was Aaron Levy from Box on stage, and he was talking about there's something like 30 million software engineers in the world today. And the big question is whether or not three years from now, there will be more or less software engineers because of the way that agents will develop. Do you think there will be more or less?
44:48Wade Foster:More, for sure. We may not call them software engineers. Maybe we call them builders. Maybe we call them something else. But there's absolutely the demand for people building stuff is going up. Got it.
45:00Gil Luria:Great. Well, I want to thank you for coming on, Wade. That is Wade Foster, the CEO of Zapier here on TI TV. That does it for today's show. A reminder, we are on the stream Monday to Friday at 10 a.m. Pacific, 1 p.m. Eastern. If you can't make it then, episodes are available on theinformation.com, on our YouTube channel, or wherever you get your podcasts. Make sure to follow us on social media, on X, on Instagram, on TikTok, and on LinkedIn. I am already excited for our next show tomorrow. Have a great rest of your Monday. Bye-bye for now.
From the publisher
D.A. Davidson’s Gil Luria talks with TITV Host Akash Pasricha about Nvidia’s software to control rogue AI agents an Meta's enterprise push. We also talk with The Information's Grace Kay about Tesla Optimus production snags and Amy Dockser Marcus about the AI vs. human biotech race. Lastly, we get into AI agents going rogue with Zapier CEO Wade Foster.
Articles discussed in today’s show:
https://www.theinformation.com/briefings/nvidia-releases-products-stop-ai-going-rogue
https://www.theinformation.com/briefings/meta-taps-mongodb-ceo-lead-new-enterprise-ai-division
Subscribe:
The Information: https://www.theinformation.com/subscribe_h
Sign up for the AI Agenda newsletter: https://www.theinformation.com/features/ai-agenda
TITV airs weekdays on YouTube, X and LinkedIn at 10AM PT / 1PM ET. Or check us out wherever you get your podcasts.
Follow us:
X: https://x.com/theinformation
IG: https://www.instagram.com/theinformation/
TikTok: https://www.tiktok.com/@titv.theinformation
LinkedIn: https://www.linkedin.com/company/theinformation/
Chapters:
00:00 - Introduction
01:13 - Nvidia Agent Safety & Meta's Cloud Push
17:38 - Tesla Optimus Hits Scale-Up Production Snags
26:11 - Inside the AI vs. Humans Biotech Race
36:44 - Zapier CEO Wade Foster on AI Agents Going Rogue
