How Focus Killed Sora and Saved Anthropic | This Week in AI with Victor Riparbelli, Nick Harris & Jeremy Fraenkel

1 Apr 2026 · 1 h 12 min · 27 chapters

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

CEOs discuss how AI is shifting from automating “physical” tasks to automating cognition, and how three infrastructure layers enable it: tabular foundation models, AI video, and photonic networking for AI data centers. They also debate “vibe coding”/agent-driven software customization, emphasizing verification and cost tradeoffs.

Guests (backgrounds)

  • Jeremy Frankel, CEO/co-founder of Fundamental; building large tabular models for enterprises. Raised $255M Series A (Oak lead; Valor Battery, Salesforce participation). Emerged from stealth as a unicorn 16 months after founding.
  • Victor Riparbelli, CEO of Synthesia; AI video platform with 90% of Fortune 100 companies as customers; $100M+ ARR; $500M+ raised; $4B valuation.
  • Nick Harris, CEO of Lightmatter; photonics/optical networking for AI supercomputers; focuses on new “Moore’s Law” via faster interconnect; claims 3x faster training in research.

Key claims

  • LLMs don’t solve structural (rows/columns) data well; tabular models target enterprise prediction at massive scale with low latency.
  • AI video is moving from broadcast to real-time interactive experiences; bandwidth/inference cost must drop.
  • Copper networking bottlenecks AI training; photonics can enable kilometer-scale GPU linking and faster training.

Notable examples

  • Credit-card fraud detection, demand forecasting, Uber ETA prediction (tabular).
  • PowerPoint-to-video, voice/video/interactive avatar models at Synthesia; “real-time video” for role-play sales training.
  • Lightmatter optics: 1.6 Tbps per fiber via 16 wavelengths; megawatt racks; 114 Tbps chip bandwidth analogy to undersea cables.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Chapters

Tap a time to open that second in VO

The Role of Automation in Accounting

0:00 to 0:43

Discussion on the impact of automation on accounting jobs and the perception of job opportunities.

“I was talking to a friend of mine, she's an accountant, and she told me accounting is never going to be replaced by automation.”

Jeremy Frankel's Company and Vision

1:33 to 2:07

Jeremy Frankel discusses his company, Fundamental, and the focus on tabular data.

“He's the CEO and co-founder of Fundamental.”

Understanding Large Tabular Models

2:07 to 3:33

In-depth explanation of large tabular models and their architecture compared to LLMs.

“So, what we are doing is we built a foundation model for tabular data.”

Applications of Large Tabular Models

3:33 to 6:27

Discussion on the predictive capabilities of large tabular models in various industries.

“It's based on massive corpuses of text-based data, generally speaking.”

Intro to Victor Riparbelli and Synesthesia

6:27 to 7:21

Introduction of Victor Riparbelli and his AI video platform, Synesthesia.

“So the company is named Fundamental, and your flagship model, the LTM, large tabular model, is called Nexus.”

The Evolution of AI Video Technology

7:21 to 8:35

Victor Riparbelli shares insights on the development and future of AI video tech.

“ChatGPT's image generation and why you exist as a company dedicated to just working on video models?”

ChatGPT's Influence and Market Focus

8:35 to 10:53

Discussion on ChatGPT's impact on the market and the importance of focus in AI companies.

“And that has worked really, really well.”

Nick Harris on AI and Energy Bottlenecks

10:53 to 11:55

Nick Harris discusses the challenges of energy supply in AI data centers and computing.

“This has become notable in the industry.”

Photonics Revolution in AI Supercomputing

11:55 to 14:00

Exploration of photonic technology and its advantages in connecting AI supercomputers.

“You know, as a company, we've been focused on driving the future of computing.”

Understanding Light Matter and AI Supercomputers

14:00 to 17:40

Learn about the differences between copper and optical fiber in AI supercomputing.

“so we all understand what you're doing, Nick, at Light Matter, Ethernet, cables, that's how we connect computers typically.”
Show all 27 chapters

The Future of Video and AI Content Creation

17:40 to 21:56

Explore how AI will transform video creation and content interaction.

“And it's all needed to drive AI scaling.”

Building Custom Chips for AI Infrastructure

21:56 to 26:18

Discuss the significance of custom chips in boosting AI infrastructure and performance.

“the idea of doing a video call for an hour with someone across the world, like that's an absolutely ludicrous idea, right?”

The Data Challenge in AI and Business

26:18 to 28:00

Understand the challenges of data management and speed in AI applications.

“And then we'll be able to keep unlocking incredible things like custom movies.”

The Challenge of Big Data in Decision-Making

28:00 to 31:20

Explore the challenges and strategies for handling massive data volumes in decision-making, especially in sectors like banking and healthcare.

“The largest LLMs can maybe take 100 ,000 rows.”

The Future of Customized Software Solutions

31:20 to 37:40

Discuss the shift towards fully customized software solutions for businesses and how AI will drive this transformation.

“You'd say, hey, what is it costing us to store all this data for the last 10 years?”

Verification Frameworks in AI Development

37:40 to 42:00

Learn about the importance of verification frameworks in AI development and how they ensure software reliability and productivity.

“and I don't think that it is, I think we'll see the beginnings of it now, right?”

The Customization Dilemma in AI Tools

42:00 to 45:30

Explore how AI tools can enhance productivity through customization.

“is also a decrease in productivity, right?”

Economic Perspectives on AI Costs

45:30 to 47:20

Discuss the economic implications of using AI including cost-benefit analysis.

“I was using I wanted to get like root access to Slack so that my open claw could be like, here's everything that occurred on Slack.”

The Role of AI in Leadership

47:20 to 49:40

Examine how AI tools provide leaders with enhanced decision-making capabilities.

“Now that Athena assistant was able to move up the stack to do better work.”

Accessing Company Data and History with AI

49:40 to 52:00

Learn how AI helps in accessing and interpreting company data for better insights.

“You go and meet with other CEOs and you understand their whole worldview.”

Innovations in Communication with AI Tools

52:00 to 56:00

Discover how AI tools like Whisperflow enhance communication efficiency.

“So we just turned on the Slack, turned on the Gmail, turned on the Notion edits of the person who left two years ago.”

Exploring Whisper Flow and Its Features

56:00 to 57:50

Discover how Whisper Flow enhances communication and productivity.

“It's okay to take a 15 second thinking break.”

Innovative Gadgets for Enhancing Workflow

57:50 to 59:46

Learn about helpful devices like foot pedals and Plod pins that streamline tasks.

“Jason, how often do you use that foot pedal yourself?”

Perspectives on AGI and Its Implications

59:46 to 1:01:45

Explore various viewpoints on AGI and its potential societal impact.

“And they make one that goes like on the back of your phone too, like a MagSafe.”

The Rate of Change in AI and Its Perception

1:01:45 to 1:05:32

Discuss the rapid advancements in AI and society's understanding of them.

“Or where do you sit on the, hey, this could get acute, this could be society disruptive?”

Concerns About AI and Public Sentiment

1:05:32 to 1:10:01

Analyze public fears about AI and the potential for social unrest.

“I very much agree with Nick here in terms of the rate of change is just unbelievable.”

The Scapegoat of AI in Society

1:10:01 to 1:11:19

Learn about how AI is perceived negatively in society and its implications.

“how do you prevent that when the rate of change is happening so quickly?”
Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00I was talking to a friend of mine, she's an accountant, and she told me accounting is never going to be replaced by automation. I'm like, what are you talking about? It's the first time we're really automating cognition as opposed to just automating the physical part of a job. 70 % of them think they'll have a decrease in job opportunities. Only 30 % of Americans are worried in the same poll about themselves, so they all think it's happening to somebody else. I do think that humans will want to play status games. I think we'll find other jobs. I think we'll probably be doing less numerical and logical jobs.

0:28It feels like something very big is coming. The world doesn't appreciate that it's happening because most people are not very good at asking questions. You can taste the singularity at this point. I can't even imagine the end of this year is going to be shocking. Thanks to our friends at PayPal, the exclusive sponsor for This Week in AI. Try the payment and growth platform that's trusted by millions of customers worldwide. PayPal Open. Start growing today at PayPalOpen.com. All right, everybody, welcome back to Not This Week in Startups, Not All In. This is a new roundtable I'm doing. It's called This Week in AI.

1:03It's in the name, folks. Every week, three amazing CEOs, just like on All In or the VC roundtable we do over at Twist, three amazing CEOs who are actually building the future, and me, an investor in the space and an entrepreneur, talk about the week's issues and sometimes the bigger picture issues. You can find out more about the podcast This Week in AI.ai, or if you want to see the YouTube channel, This Week in AI.ai.ai. And this is our seventh episode. It's March 31st, 2026. Three amazing guests with us today. Jeremy Frankel is here. He's the CEO and co-founder of Fundamental. They're building large tabular models for enterprises.

1:46They emerged from Stealth as a unicorn just 16 months after founding$255 million Series A, led by Oak with participation from Valor Battery, Salesforce, and more welcome to the program, Jeremy Frankel. So, Jeremy, explain what your company is doing and how it's going so far. Things are going great. So, what we are doing is we built a foundation model for tabular data. So, what does that mean? So when people think about the AI boom or the AI revolution, everyone is thinking about LLMs. And for good reason, right? Like ChatGPT, a creative breakthrough where you can now pre-trained one model on the entire internet and you understand language and you can use it to power thousands of use cases.

2:34But what's less appreciated is that LLMs really mostly solves unstructured data issues, such as text, audio, video, images, coding, but they really didn't impact structural data. And structural data means everything that comes in rows and columns. So think about spreadsheets, databases, CRMs, ERPs. It's all rows and columns, and that's the vast majority of useful data for enterprises. And that part of the enterprise has never had its tragedy moment. And so this is the modality we're going after. And for a variety of reasons, it's the one modality that acts very differently than others. And what we're building is really the tragedy moment for tabular data.

3:21So if I can repeat it back to you to make sure I understand this vision, it's what I always like to do with founders, is see if I can repeat it back. You have large language models. Those are built, as we all know, like guess the next word and transformers. It's based on massive corpuses of text-based data, generally speaking. You're building an LLM to focus specifically on tables and tabular data structures that we all know as a, you know, might experience an Excel sheet or a database, a Notion database, you know, a SQL database. Am I correct? So it's not an LLM. It's a large tabular model. So it has a very different architecture than LLMs.

4:04Basically, if you look at the LLMs, as you said, they're built on being next token predictors. It's an autoregressive model. The problem with that is that if you look at the way transformers, for example, are applied to LLMs, they have a positional encoding as part of it. So the order of the sentence matter. If you change the orders of your sentence in Cloud or Chagipty, you can get a different output. But with tables, you actually don't want that. And the reason why is imagine if you have a table with a million patients and you try and predict which one of them have cancer. And your first column has the weight of the patient and your second column has the heart rate of the patients.

4:42If you switch the order of those columns and you first lose the heart rate and then the weight, you shouldn't expect or you wouldn't want to expect a different output. But with LLMs, if you change the order of the data, you get a different output. And that's fine when you're writing an email. It's not fine when you look at the deterministic outputs. And so that's what we've focused on. Got it. So large tabular model and LTM is how they're first. Are you the first people to do this or is this like a known alternative to an LLM? It's very nascent. There are a few smaller companies working on it as well, more in an academic environment, an academic setting.

5:18But we are the first like large company doing that at an enterprise scale. What is the benefit here? Is it because you'll have a better fidelity, better results, more trustable results? than the problem we have with hallucinations in large language models? Would that be the reason to do this? It's very different use cases. So if you look at everything in the economy, for example, every time you swipe your credit card, one of the credit card providers has to make a split-second decision of whether the transaction is fraudulent or not. When you work with retail, for example, forecasting demand, all of those, or like, for example, if you order an Uber, Uber has to make a prediction on the ETA of your driver.

6:00Each one of those stars is tabular by nature and it's predictive. But when you look at the way those predictions are being made, they still rely on traditional machine learning algorithms that predate LLMs. And those algorithms still do better than most LLMs at making those predictions. And so what we've built is a model that can essentially unify all of those use cases into one model to allow you to make much more accurate predictions than what you would otherwise be able to make. Genius. So the company is named Fundamental, and your flagship model, the LTM, large tabular model, is called Nexus.

6:36Am I correct there? Correct. Correct. All right. And we just had Perplexity CEO Aravind, who's really crushing it. He's one of your angels, huh? Correct. Awesome. Victor Riparbelli, I got your name correct, I hope. You did. Riparbelli. Welcome back to the program. You're with Synesthesia? Synesthesia. Synesthesia. S-Y-N-T-H-E-S-I-A You're an AI video platform for business 90 % of Fortune 100 companies are customers already Over$100 million in ARR And you've raised over$500 million $4 billion valuation And we're seeing an incredible demo here Explain to us how you're different Nano Banana, the free services out there ChatGPT's image generation and why you exist as a company dedicated to just working on video models?

7:28So I think we started the company in 2017, way before any AI video tech actually worked. So we've been quite a bunch of different companies all the way up to 2026. What we decided on five years ago was we're kind of looking at the early iterations of AI video, which is the models that we're seeing right now, like Vio, Sora, which just been discontinued, our models. obviously very high fidelity, fairly inexpensive to run, assuming you're just like creating single videos and really getting to the point where you actually can't tell the difference, which unlocks a whole bunch of new use cases. But what we figured out five years ago was that the first iteration of this technology was not ready for prime time.

8:07It would definitely not make a Hollywood film. It would definitely not make performance marketing ads. But there was a very real use case in taking all the world's PowerPoint users and enabling them to communicate in video as opposed to slide decks of documents, which in 2022, when we launched the first product, was what everybody wants. People want to watch and listen to their content. They don't want to read that much anymore. And we provide a way for PowerPoint creators to very easily switch to making video and stuff. And that has worked really, really well. And today, we both have our own models.

8:40We build voice models. We build video models. We have interactive models. So, an avatar, we can actually talk to in real time that's launching very soon. And then we also use a mix of the big models from some of the bigger providers to solve some work for our customers. And for folks who want to hear from you, three years ago, we had you on This Week in Startups as part of our next Unicorn series, Before You Were a Unicorn, episode 1776. What a great episode number to have. Why did chat GPT OpenAI shut down Sora? And why is Elon doubling down on video? He's been very vocal just this week talking about how video is the most important thing.

9:24Take us through your take on that. Obviously you were in video years before chat GPT was even launched. I mean, I think it's kind of interesting that even a company like OpenAI found by some of the smartest people in the valley, right? So those accomplished people still had to learn the lesson of focus you know it's kind of I think I feel like it's one of like unteachable lessons but they had to learn the hard way I think it's very obvious to anyone looking at the way that Anthropic is ripping right now that code gen is probably the most valuable near-term use case for all these technologies and I think OpenAI probably had a little bit of a flying too close to the sun moment but it decided to do like absolutely everything all at once right which often the PowerPoint it sounds doable but in reality I think I don't anyone who's run a business knows that doing too many things at once is like rarely a really good idea.

10:13And Frohbic focused on no voice models, no video models, just like CodeGen, B2B, no freemium. And that has clearly paid off really well for them. So I think my take on what's going on in OpenAI is that they're like, let's cut all the side quests and focus on the market that's really, really going to matter. And I think that's going to be probably screwing more towards B2B and it's going to be heavy on CodeGen and powering just this like campaign explosion of a product that we're seeing being built with the bike coding right now. I guess Claude's got people shaking. They've done, or specifically, it's got OpenAI shaking.

10:47They've added so much revenue. They've become such a darling. Jeremy, I see you smiling about this. This has become notable in the industry. Yeah, Jeremy? No, correct. I mean, it's funny. I was at the founder retreat a few weeks ago and everyone was just talking about Claude Code. No one was mentioning anything else, the Claude Code, so. What founder retreat was this? It was a Lightspeed event. Ah, Lightspeed. Okay. The venture caliber firm. And that's fascinating. Nick Harris is back in the This Week in family. You were on This Week in Startups. I remember this discussion August of 2023 as well, episode 1787.

11:24And so we got it right having you guys on early. And we were talking about, and you were predicting just how important these data centers were, and that photonics, using light instead of electricity to connect AI chips, would be critically important. And you explained to me back on that program, Nick, that energy and data centers were going to be a major, major issue. And here we are three years later. Energy is the bottleneck, isn't it, Nick? Yeah, it's exactly the bottleneck. You know, as a company, we've been focused on driving the future of computing. The central challenge that we're solving at Light Matter is around how do you create a new roadmap for Moore's Law, for Denard's scaling?

12:09These are rules that drove computing progress for our entire lives. I think about being a kid in the 90s and every 18 months, you get an incredible new chip, more performance, all these things. That's over now. And there's only two ways that computers get better at this point. One is big computer chips. You put more chips in a package, computer chips are getting to the point where NVIDIA sells nearly$100 ,000 chips. So those chips are getting really big and the size of the chip is going to keep growing. And the other way is that at any given time, there's a biggest chip you can build. So networking them together is the other piece.

12:44So big chips network together. This is the future of computing. It's the new Moore's Law. And we power both of these with our product passage. and we also since we spoke last started building lasers which i never thought we would get into but when you look at the photonics revolution what's interesting is that you've got this device that powers all of the communication for these ai supercomputers and it relies on the laser it's kind of like batteries for electric vehicles it's a really fundamental huge part of the bomb and it drives all the progress and how these computers are going to connect.

13:19You know, one of the cool things to tie into the software piece of this is with photonic technology, we've shown, you know, in research and so on that you can actually 3x time to train. If you guys are watching Anthropic and their incredible tear, I'm hearing about the new model Mythos that's coming out. We can actually 3x, 3x faster time to train. Imagine if you have PE to the RT, where you've got R times three now. So the rate of takeoff is going to go up like crazy. The first companies that adopt this photonic technology for linking up GPUs and AI data centers, the foundation companies, they're going to have an enormous advantage.

13:58Got it. And for the audience, again, my typical technique of repeating back, so we all understand what you're doing, Nick, at Light Matter, Ethernet, cables, that's how we connect computers typically. Obviously, consumers are using Wi-Fi. You would never use that because it's very limited bandwidth, but Ethernet, which is typically copper wrapped in plastic versus photonics, which would be made of glass, I'm assuming here, and fiber optics. Yes. And the throughput is radically different. Maybe you could explain that and give us a bit of a primer, and then you could sportscast what we are seeing on the screen.

14:35Right now, the way that AI supercomputers are built, you think about NVL72 from NVIDIA, they take 72 GPUs and they link them all together they're in a very high bandwidth domain. So here we're talking about petabit per second bandwidth within a rack. That's all linked together in copper. What's really interesting about copper is it can't go very far. The cables have to be quite short. And so what you're seeing is the racks are getting packed as tight as possible. Now people are building racks that are a megawatt. So you have a rack that's a megawatt. You have to reinforce the concrete below it because it's so heavy that it's actually a load on the infrastructure.

15:11And you're building these custom racks that are just for delivering the cooling to these systems. That's kind of where people are at today. And the reason they're there is you have to bring the density because the copper can't reach very far. So just to give you an example of the Delta and what we do, we just announced a chip with Qualcomm where with each glass fiber, we're packing 16 wavelengths of light and we're pushing 1.6 terabits over a single optical fiber. That bandwidth is crazy. It's like 1 ,600 houses worth of internet. A normal house has one gig internet, so 1 ,600 houses. So copper really doesn't have very much reach.

15:49And the reason it matters is when you're building these AI supercomputers, if you want to have great performance, you want to link as many GPUs as you can tightly together. If you have optics like what we do, you don't need to put it all in one rack. You can separate it by a kilometer. It travels at the speed of light. There's very little loss in the optical fiber. And you can build giant systems that act like a single brain rather than a bunch of mini brains with 72 GPUs talking in parallel. You could have thousands of GPUs working together on a workload. It drives interactivity, drives time to train.

16:25Both inference and training get a huge benefit out of switching from copper to optics. And we're kind of the leader in performance in this space. And just so people can conceive of a pet a bit, you're talking about thousands of 4K movies from, you know, coming from Netflix every second. So this and probably 100 million high res photos from your camera, your library per second. So if you had 100, if we as consumers had 100 million photos somehow in our photo libraries, Victor, you could be sending just, you know, hundreds of people's photo libraries, the entire, you could send the entire corpus of Netflix movies in 10 seconds.

17:12Yes, Nick? Yeah, exactly. And there's a kind of a cool analogy here. We have the chip M1000 that we announced last year. That chip is 114 terabit per second. So that's 114 ,000 gigabit per second. That's 114 ,000 houses worth of bandwidth. And a more interesting comparison is that that is about the bandwidth of the cables that connect North America to Europe for the internet, the undersea optical cables. So we're building chips that have just an obscene amount of bandwidth. And it's all needed to drive AI scaling. Jeremy or Victor, in terms of your data usage, when you hear about light matter and the impact it could have, what goes through your mind, Victor?

17:54Because obviously you're working in video and your data centers. I'm not sure what your standard platform is and where you host, but maybe thinking ahead to the future, how do you think about what Nick is building? I think it's super exciting. So there's kind of two big ideas we found on Synthesia. The first one was like, as AI increasingly can generate data, the marginal cost of creating video, audio, all the other content has got dropped to zero, right? Both the dollars, both very much in time required and skills required. I think we're in the middle of that right now. But this is still video as we know it today.

18:26It's a broadcast medium. You make one video, you put it on YouTube, and everybody watches exactly the same version of it. The second part of our thesis was always around, when we invent new technologies as humans, we always invent new media formats that are native to those technologies. like the idea of a podcast or TikTok video wouldn't exist without modern technology. And for us, the big question is like, what does video look like if you were to reinvent it in 2026 with all the new primes we have around us, right? We have LLMs with essentially intelligence on tap. We have offline video models that can create extremely high quality content.

18:59We have real-time video models that you can interact with, advertisers you can talk to, canvases that can be drawn in real time, and a whole bunch of other like cool technologies around it. And so what we're building for and what we're actually launching, it's in private beta right now, launching in a couple of months, is real-time video, which is the idea that if you, to take one of our use cases, if you're a salesperson and you're doing a bunch of training to understand the competitive landscape or new product that you're launching, instead of just receiving a video that you sit down and then you watch it and then you hope you understand it, it's got to be an interactive experience.

19:33It's got to be, maybe first you consume some content, you go into an agent, you role play with it, It pretends to be a customer. You have to answer questions, overcome objections. Then you go to another thing where we actually in real time draw a diagram of a customer's potential tech stack, how you're going to work with this, how you're going to integrate it. That's a very different type of video, which is almost closer to maybe like a game or like a website, something like that. But one of the bottlenecks here is, of course, that if we're actually going to do this with video and we're going to do this with avatar models, we're going to draw things in real time, that's going to take up a lot more bandwidth.

20:06it's also going to have much high inference costs. And so the more we can reduce these, the more accessible this becomes. So I think in the next couple of years, we'll see this becoming a new type of interface that's going to emerge. But for it to really take off and just be, every interaction we have with the computer could be done with technology like this, we need the cost of serving that content to drop very significantly. I think that's the core of what the problem Nick's working on. So I think it's very exciting. Nick, when we have this ready for Victor to experience it. And like, we could probably do a deal right now that it could be one of your beta customers because it would be amazing for Disney.

20:44I mean, I'm thinking in a consumer mind frame to sort of help the audience follow along here. But imagine, you know, Disney releases Mandalorian and they had done a deal with Sora to try to get the IP to work. Now imagine with Light Matter being able to enable Victor's company to be able to make a short film with Grogu and the Mandalorian, and you're talking to them in real time, and it's making that in real time. That's just... Yeah, that's absolutely awesome. And to put some economics on that, right, I think if you were to do that today, let's say you were to personalize a one-hour movie for a kid from Disney, that would cost you a lot of money, right?

21:24If you say an eight-second clip with a state-of-art video model costs$1 or$2 a day, you're going to add that up for like an hour of eight second clips, right? That's not going to be sustainable within like a$15 per month. It'll be, yeah, if it was$6 a minute, if we just made it like six bucks a minute, 120 minute, you're talking about$700 for a custom movie that you can live in. Exactly. And we're not that many years ahead of like, I remember when I was a kid, right? And I had to like call my dad and ask him if I could download like a 10 megabyte file because it was like ADSL and you were like mirrored how much you would download.

21:56the idea of doing a video call for an hour with someone across the world, like that's an absolutely ludicrous idea, right? But probably in like X amount of years, this is going to be like completely normal. We're going to be just generating content in real time in front of people. And we're going to be able to offer that at like, you know, within the subscriptions that these services charge today. Nick, you were going to add to this. Yeah, we're actually busy building chips for a bunch of companies. We typically work with hyperscalers to build their own chips. Think about like the Google, Amazon, Microsoft, Meta type companies who are building their own hardware to do both training and inference.

22:30And then we also work with semiconductor companies, both GPU companies as well as networking companies. So those are the people we build for. We're building a ton of chips right now. So I would say in the next year and two years, you're going to start running on light matter hardware. These will be in the new data centers. Think about like the Texas stuff. Yeah, CoreWeave. What's the one? Not StarBay, Stargate. Another great film. speaking of film yes excellent film yeah and so there's a picture of um i think that's stargate and what you see in the middle is that plus i think is i think i was talking to jensen or the ceo of core weave about this somebody on my team will tell me i believe this is uh core weaves data center you have the cooling there that bottom line that looks like memory chips in a motherboard these are starting these data centers are starting to look like giant motherboards But I think those are the cooling apparatus where the contained water system, what do they call it?

23:27Closed loop water system? Yeah, closed loop water system. So that was Crusoe's data center. I remember the CEO was walking me through it on a previous episode. That's the closed loop water system and the data exchange. Pretty compelling stuff. Jeremy when you look at all this oh by the way Nick Amazon making their own chips and I don't know if they're a customer or if they were you could say so but you gave us the sort of like Amazons are called Tranium for training AI models and Inferentia for running inference models. Somebody at Amazon needs to go to branding school that's a little too on the nose Tranium and Inferentia.

24:10I mean what did they do? They asked ChatGPT to come up with names um but these are going to be dedicated chips and i think broadcom generally builds people their chips is that typically what happens so if we explain it to the audience you have nvidia they work with tsmc they're making their own chip sets they're the leader of the pack every single other hyperscaler uh tensors from amazon tensors from google yeah then you have these Infrantia, Tranium. And MTIA from Meta. MTIA from Meta. So explain to the audience why people are doing two different supply chains, Nick, and then we'll get to you, Jeremy, on your thoughts on this next wave and how that'll affect your business.

24:57If you look at the incredible spend, I mean, they're over 100 billion a year. They're like 180 billion a year, I think is what Google announced they spent. I think Amazon was over $200 billion for the year. When you're spending that kind of money, developing your own custom silicon is a little bit of a rounding error. So I think that they're really looking at these costs. They're trying to figure out how they can optimize costs, and they think they can build their own solutions. Now, building a chip is one thing, but building all the software and the ecosystem around it is another. And that's where NVIDIA has had decades of experience building out the moat there with CUDA and everything.

25:32But everyone's trying to build these chips. And the reason is that it's a race on the infrastructure point. People are trying to get power. They're investing in these micro nuclear reactors to go power the data centers, 100 megawatts each. So you get 10 of those and you've got a gigawatt data center. They're working on that power delivery. They're working on building the chips. They do their own. These hyperscalers are becoming like very heavy duty infrastructure players from cement to energy, all the way to chips, and obviously the software stuff on top. There's just so much money in this space that they're all kind of making the bet on doing it themselves.

Read the full transcript

26:09And it's all in service of powering technologies like Jeremy and Victor's. It's really about the apps that run on top of this and getting the cost to the right point, because the AI models are incredible, but we've got to keep driving down the token cost and driving up the inference rate. And then we'll be able to keep unlocking incredible things like custom movies. And you're going to need blazingly fast interconnect for that. Jeremy, I'm assuming you're building on CUDA, which is the proprietary layer for coding and sending jobs to NVIDIA hardware, correct? Correct. And if you were to consider other platforms, other hardware platforms that were non-NVIDIA, Have you considered that?

26:53And is there a path for you? Or would you have to maintain, you know, CUDA plus some other open source software? I guess there's some abstraction layers for CUDA now to get on AMD processors. So as the CEO, how do you think about where to spend your energy? Is it just too much to even consider other platforms? Or are you like Amazon, Meta, and Google saying, hey, we need to have two swings at bat? I very much think that's not. We are in the process of exploring different chips as well. You mentioned Traniums, one of the chips we're in the process of exploring. And the idea here is that we don't want to just be dependent on one hardware, one type of chip.

27:35Of course, it comes with, like, QDA gives you a lot of advantages. And it's not easy to switch away from QDA, but it's definitely something that we're in the process of exploring. And what Nick is doing is really exciting. Because the funny thing about everyone knows, but with video, you know about the amount of data that is being moved from one place to another. But people also don't realize that you have the same problem with tables. If you think about a table with 10 million rows and 100 columns, which is not even that big of a table, it's like when you have a billion cents, that's orders of magnitude more than the context the largest LLMs can even take in.

28:14The largest LLMs can maybe take 100 ,000 rows. But when you're working, for example, with banks on fraud detection, you're working with billions of rows. So like you just need and, you know, and they're like, you know, millisecond matters, right? Like you make like a decision, like when you strike a credit card, you don't want to be waiting for 10 minutes before you get an answer. You just want to get an answer right away. And so the amount of data out there in tables is just massive. Like we've been, you know, talking to a few companies where like they think about every IoT sensor. Every time you get some data, that comes in some form of structure form.

28:50And the amount of data that they are dealing with is like petabytes of data. And so being able to move data much faster and having a lower latency, and as Nick said, also lower cost, will really be essential. Yeah, I mean, if you were to think about, I have these air things. I don't know if you guys care about air quality in your homes, but it turns out like in your office, in your home, like CO2 and radon, all this stuff, very important for health, very important for like cognitive function, especially CO2. So I have these era things and it's taking recordings in six rooms in three different houses for me.

29:26The amount of data that just one person consumes or let alone your whoop or your Fitbit, like how many heartbeats is whoop and shout out to whoop. They just raised money on a$10 billion valuation. What's the data processing there when they have to do my sleep and my recovery and my run and my heartbeat? I mean, my Lord, it's a huge amount of data. Yeah, exactly. It's unfathomable amounts of data. And as you said, you don't spend your day thinking about all the data that's being collected, but there's so much data. And I think that if you look at just in terms of volume, I think 70 to 80 % of enterprises' data comes in structured form.

30:06Not all of that data is valuable and not all of that data is used, but the volume of data is massive. Well, it's not used because big data as a discipline wasn't able to use it. But if AI and this new hardware layer makes it affordable to do it, who knows what you could find in that data like we it really is great and that's that's exactly that's it that's exactly what we do right like that's literally where we're at where like we realize that if i now go to you like if you go for example to whatever an energy company and they have petabytes of data what will end up happening is that some internal some data scientists will summarize their data into a whatever two-page document and give it to the ceo but like that's a compression of you know of the information you much rather work on that raw data as opposed to a compressed form of that data.

31:00And that's essentially what language really is. And what we do is really work directly on the raw data to get you much better predictions and decisions than you could get by just compressing that data into higher forms of - The way to think of that would be whenever you work with some sys-op or somebody who's working in data engineering, you would do a roll-up. You'd say, hey, what is it costing us to store all this data for the last 10 years? And like, yeah, just make a roll-up table, average it out for the last by hour or by day or by week, and we'll just throw that data away. It's not worth storing.

31:37We can't process it anyway. And this opens up a whole new world for healthcare, for finance, for Uber, tracking rides. They may not have the fidelity to know every ride in every city on New Year's Eve. They probably just have some roll-up table with that, but they could actually unlock all 20 years of that data by car, by second. It could be all kinds of interesting things in that data. Correct. And getting inside of that data is much more valuable than the cost it takes to store that data. Right. The analysis is now more than the storage. The storage was the issue 20 years ago. Storage is essentially unlimited and free now.

32:15It's kind of done. It's a solved problem. When will Nick and Victor, when will compute be, you know, when will we be talking about compute like we talk about storage here, which is it's a non-issue, it's trivial? Yeah, so that's an interesting point. Right now, if you profile the runtime for a program like an AI model running on one of these, you know, supercomputers, these AI supercomputers, most of the time is spent on networking. So moving the data between the GPUs and moving the data from memory. Compute is actually a pretty small fraction. So it's funny you say that. Right now, compute is not the limitation at all.

32:50We have these incredibly intelligent, ultra-high throughput processors from NVIDIA and everybody else. And those guys can just work really quickly, but they can't talk. You know, a lot of people are like this too. When you get smart enough, it ends up getting hard to talk. And that's where the GPUs are, and we're trying to help those people talk. Yeah, it's a pretty great analogy. Like you've got too much flowing out of your head at once, and you've got to figure out a way to structure it. so that other people can process it. This is where Neuralink will solve that problem for all of us. We'll be on this podcast just Neuralinking, connecting our brains, and then there'll just be one output stream that'll be like, the four of them think this.

33:28The four of them debate this. It's like, it sounds science fiction, but it is coming. Yeah, Victor? No, I think it's definitely coming. I love the discussion because I'm much more focused on the application there, right? But there's a similar kind of thing with things like video, right? Video is a much higher bandwidth way of communicating, as opposed to, you know, if you're like, language and text is amazing. It's made the world what it is today. But ultimately, it's very, very high compression way of sharing your ideas or your knowledge or whatever. Like the archetypical example would be like, you know, describing an image to someone is impossible, right?

34:05Like it's literally impossible to like, I call you on the phone, Jason, and I explain an image to you and you see exactly the same thing I'm seeing in front of me. There's so much compression that happens when we communicate in text, which is why I think people prefer video and audio so much more in the modern world. And I mean, this goes all the way down to how our GPUs and data centers work as well, which is interesting. So it just feels like the world is going into overdrive, right? We can create and disseminate information at a faster and faster pace, which is fascinating. It's funny, the way that content is delivered now, I mean, I think, Victor, you were talking about this.

34:42people kind of create a video and then they ship the video to everybody. And it's the same, it's the same video for everyone. And then, you know, with, with databases, people are looking at, you know, Jeremy, like you're talking about, they provide an analysis, they give it to the CEO and it's a compression of the underlying data. It seems like one of the principal things that AI is doing is it's allowing us to deliver the data and a genius along with it to interpret it in any way that you want to ask the question. And that's this new thing. It's like data is now completely interactive, but it's going to come with an enormous cost because like typically with infrastructure today, we write programs, the program programs are easily distributable and you don't need to do all the work of designing that program every time.

35:22Now AI is taking on the job of it's going to rewrite the program every single time. Like there's an enormous amount of right. Yeah. Literally it's like, okay, I opened up Slack and it just coded Slack and customized it for me for my use case and then just ran it. And I think that was, you know, I was talking to elon about this not to name drop but you know he's talking about the idea of like you know the somebody was talking to him about like are you going to make a phone a spacex phone a tesla phone or whatever and he thought you know there's a decent chance we'll just buy a slab it'll just be like a black mirror and you you just have an operating system of some type it's a dumb terminal maybe it's got some processing bar and it just boom your software's here boom your app is here for meditation boom your abstraction of the uber app for when you're in tokyo is different than the abstraction of the Uber app when you're in your home city.

36:13It's very hard to conceive of this. I think even in enterprise software, right? Like what's going to happen to Salesforce and ServiceNow, like this whole discussion that's going on. I think often we have a tendency to think that the world's going to look like it is today and the agents are going to take a lot of the work. And that's in many cases, I think true. But I also think what we're going to see is that today, the world's largest companies all have customized integrations of Salesforce, ServiceNow, SAP, like pick your like big software vendor. And probably what's going to happen in the not so distant future, right?

36:44It's just that no matter how small your company is, you're actually going to get like a completely customized software stack that works like just exactly the way that you want it to work. Because most small businesses today, they're kind of like fitting into like the paradigm of like the software that they buy as opposed to the other way around. But with agents and vibe coding, right? You're probably going to have like 50 % of what you're using. It's probably still like the system of record. It's the thing that makes it safe to use. It's the core of the product. But then the last 50 % is probably just going to be either just in time for every single user.

37:13I think definitely it's for every single company. I think that's going to create a whole new category of mix between salespeople, forward deployed engineer, product manager, whatever you want to call it. How do you take a mid-market business and you actually generate an entire software stack that works just for them, right? That feels like the way all the stuff's going to go. And it's just going to be such a different world, I think in three or four years. I'm seeing it. Go ahead, Jeremy. No, I was saying, I agree that, and I don't think that it is, I think we'll see the beginnings of it now, right?

37:44How many companies, how many startups do you know that still use Salesforce? Very few, right? We've built our own agent system. I actually disagree with that, but I can come up to you. I'm curious to hear your thoughts. Yeah, go ahead, Victor. We like a little debate, yeah. I think one of the lowest EV things you could do right now as a founder is to try and replicate a CRM system. If you have 10 amazing engineers, I think you should just buy Adio, Salesforce, whatever thing that you're using and focus those 10 engineers on building something that's not just going to remove... But why would it be engineers?

38:18You could just literally have the sales, customer success person tell their open claw or clawed code or whatever, or perplexity computer, yeah, just VibeCode me this and build it. I mean, I think that's what's actually happening. That's exactly what we've done. We've built our own system that's called Fetch. We essentially integrate it within Slack. And then you can just, it's essentially your CRM. You can ask any questions, get you the answers, get you anything you want. You've via-coded your own CRM for the sales team. How big is your team? The sales team is relatively small, 15 people. So it's not like a massive team of hundreds of people.

38:58And I agree that Microsoft or Amazon is not going to via-code Salesforce, But my point is like small startups can definitely do that because, you know, you don't need to have the same reliability as a big enterprise player. It's an interesting thing. Like the main problem with this is your CRM is so important. If it screws up, you've really got an issue for the business. And so one of the central challenges with Vibe coding is how do you build a verification framework to make sure that software actually works? And I think most of the work that goes into building these things is in the verification.

39:33I think if you go to Google and you talk to software engineers there, they're not spending their time on like writing the lines of code as much as they are writing the hooks to test the software and make sure it works every time. So I think it really depends on how mission critical it is, whether you'd build it yourself and verification is everything. When I'm prompting a lot of the time, I'll do engineering stuff, finance, sales, marketing, you know, all sorts of stuff, a technical background. But I usually start out by describing the problem. I say, we're going to fix this. But before you give me a solution, I want you to come up with a whole verification framework.

40:05And really working on that piece, I think that's one of the really important parts of kind of developing solutions that you can use because there's a lot of ways to get trash out of these AI models. Yeah. So if the fidelity is there and if the redundancy and the security, the stability is there, then we're going to see more people vibe code or just take me take vibe coding out of this, just build internal solutions versus external. And there's that natural tension, Victor, of, hey, what is the highest use of our tech team? Is it what we do? Make videos, work on photonics, you know, make our LTM.

40:46Like we need to really think about that resource. And I'm having this experience internally all the time because these tools, I think, are getting better every two weeks. I was kind of feeling like they were getting better every month and you could keep up with the cycle. But now it feels like every two weeks, Claude Code, Perplexity Computer, and OpenClaw do something so good that it makes you wonder, am I using the right platform? Maybe I should move platforms. And it's becoming disorienting for my team because we did this big investment in OpenClaw. And then people were like, wait a second, CloudCode gives better results.

41:26And then somebody else in another group is like, perplexity is computer is just trouncing everybody. And then up the next week, a CloudCode's got skills. So how do you think about managing multiple platforms? And are you having the same experience, Jeremy, where these multiple platforms are lapping each other? And is it disorienting for your team when you're making these solutions? I agree with both Victor and Nick that, you know, you need to make sure that you have verification in place. And like, you know, it depends on what, where you apply those models. But like, essentially not using them is also a decrease in productivity, right?

42:03Because at the end of the day, like if you want to build something and something is fully, and now, you know, enterprises especially, but startups as well, expecting to be fully customized, right? And like, if I can have something that's fully customized to me and works fully for my team in the way we want it, it's just going to make everything much faster as opposed to having to teach people to learn a new system, sorry, an old system, and to go the old ways. Now, if you can marry that with the proper amount of verification and knowing when to use them and when not to use them, I think that you will just see more and more startups and enterprises start using them.

42:42Yeah, I mean, just to make sure, of course, this is the way the world is going. I'm not saying it's not. And I think these things are extremely powerful. I just think to your point, right? I don't know how big your team is, Jason. I don't know what you would spend on like a CRM system. Okay. So let's say a CRM system for 21 people. I don't know how much is that, like 10, 15K a year, maybe something like that. If your team has to constantly like fight battles with like new models that come up, open, close, delete half the code base, you have to vibe code again. It's like very fun. I just think your team could probably like make more than 15k if they took that time and they you know spent their time to do exactly yeah but victor why do you have to redo it every single time you don't have to redo it every single time right you can you can i don't even think it's bad i don't i don't think it's about redoing it so like we just had a perfect example we just had a perfect example of this that is exactly what victor's talking about so i have this team that's doing chip verification work and they're spending so much money on tokens.

43:40They keep coming back. You're like, hey, can we get more tokens for this? And, you know, it's quite expensive at this point. We're looking at it. And what it looks like from a spend perspective is we just hired another two engineers. And so you sort of, you start to take on this view of, is it going, how much am I going to spend in tokens to do this task? And you can really quickly quantify whether it's worth it. Because you look at a subscription cost for a tool, like what you're saying, you know, Victor, you're talking about Salesforce. course, if the subscription cost is a lot cheaper than how much you're going to spend in tokens to try to make it, then don't do it.

44:13Don't waste your time. It's funny because there's such a really clear economic way to measure this. Just are you going to spend half a million or are you going to spend 30 ,000 a year? I think what's often is lacking in that calculation is like there's a monetary cost, which you can calculate like you just did. And then there's a focus cost, right? Which I think OpenAI is learning the hard way right now, like, you know, trying to do like 16 things at once. If you also need to have a team that's like building all your tools, that can't do that. then it breaks half the time because they don't really know what they're doing.

44:39Like, I think if the world is going to go this way, I just think I would rather just pay 15K and then focus on like value because the cap, the maximum amount you can make on that team, right, is 15K if you're just automating like a piece of software. So I think there's a bit of like, sometimes with this bytecoding thing, I think there's a bit of like what I call the AR-SDR fallacy, which people are like, oh yeah, now like, you know, like my open clock, I like do the job of an SDR now. But that's like, that's thinking of an SDR's job, it's like emails, right? That's a part of an SDR's job, but an SDR's job is a lot more than just writing emails.

45:09I think we're going to get there. I think we are going to get there eventually, but I think that we're in a little bit of a bubble sometimes in the tech world, but I'm not sure that a lot of focus is going towards the most productive thing. I think we're in the middle of the... We're in the eye of the storm, Victor, is a way to sort of say it. Like it is choppy waters and we're in the soup as like people in, you know, maybe flying a plane through a hurricane might say it's like it's a little bit soupy right now. So it's hard to understand. I was using I wanted to get like root access to Slack so that my open claw could be like, here's everything that occurred on Slack.

45:47Here's every DM. Here's every private chat room. Here's the report. You're the CEO. I have God mode. Give me everything. And I'm like talking to Benny off about it. And it's like, well, you don't really have God mode. Like it's kind of our data. I'm like, well, isn't it kind of our data? And like, so we use Slack bot. I'm like, I don't want to use Slack bot. I want to pull them all my data out. And so finally my open call was like, I'm like, how do I get everything? They're like, well, you could export everything and then we could analyze it and you could just export it every Friday. And I'm like, well, that doesn't work.

46:14And they're like, and the export feature on Slack is like 50 bucks a person or something. It's like some crazy amount to be able to export. And I'm like, oh my God, they've locked up my data here. This is making me mental. and then I looked at what I'm spending and it's like would you like me to make you with matter post I think it was or something there's some open source version of slack and my open call was like this weekend we'll make a open source version of slack and we'll just convert everything over pay for the highest level export everything and then uh cancel it in the same month and you'll only have to pay one month to get all your data and like even down to the likes on the post and And I'm like, how much are we spending on Slack?

46:53They're like$6 ,000 a year. I'm like, you know what? No, forget this. If I'm spending$300,$400 a year on Slack, I'm not replacing it. It's just too much headache. But when it came to SDRs, Victor, I was like, wait a second. How much are we paying our Athena assistant to do this work? It's like$3 ,000 a month. Go to athenawow.com and you'll get like a month off with my discount code. I'm an investment company. I'll give them a little promo here. I had the Athena assistant going through the sales for the podcast and making like a sales report every day. We were able to get open claw to do it. Now that Athena assistant was able to move up the stack to do better work.

47:31Then when you're doing a podcast company and you might look at who's advertising on the other podcasts. So they would in their spare time, if the Athena assistant had nothing to do, they would go look at other podcasts and say, okay, who's advertising on Bill Simmons or Joe Rogan. Put it into the database and put it into the CRM. Open Claw, we were able to automate that. So it's just every level of what an SDR does has been given to the Open Claws. Every time we get an iteration, I'd say it happens every two to four weeks, like is the cadence right now, we're able to automate another thing that took somebody 10 hours a week.

48:10And where do you spend your time, Nick? How do I reconcile this? Is my time to free up everybody's time as the CEO of the corporation? Or is my job to focus on the thing that we do better than everybody else in the world? And how do I allocate my resources to do that? I mean, I think that's what we're kind of getting at here is what do we do as CEOs of companies, as leaders? You know, it's so interesting. One thing I'm taking away from hearing all of you talk is we're able to so clearly put a price tag on how much a piece of software is worth. That's really weird because it's a new thing. That's totally it's totally new.

48:44So so I guess the way I'm using my time, obviously, there's so much going on. One of the fun things about the company growing, you know, as the way that it has is there's so much data. I wake up. There's so many cool emails, new partnerships, new things to build all this stuff. But it's too much to keep track of. And so I've always got an anthropic, you know, Claude session up and it's summarizing, you know, emails and Slack and everything else. Just like you were saying, Jason. And I think that gives enormous leverage. And it's also the case that there's so many micro details that really matter.

49:13And these AI tools let you zoom in on those. I'm not missing anything. Like my hit rate is very, very high at this point. That's incredible. As a leader. I can keep the tension. Yeah. You know, when you're running a company, I don't know if you guys have felt this, but I can feel the tension on the rope. If you are not pinging the team, you're not checking on things, the rope slack. Something happens and you all get jerked by it. But the real task is to keep it tight. And these AI tools are allowing that to be possible. And meeting prep's amazing. You go and meet with other CEOs and you understand their whole worldview.

49:48Everything they've said, their personality, whatever it is, it's just an enormous leverage. And I feel like you can taste the singularity at this point. I can't even imagine the end of this year is going to be shocking, I think. I feel like you could be, what was it, Dr. Manhattan from that superhero show where you're just like omnipresent. You're everywhere at all times. It's kind of like a Jesus. I'm not saying I'm a Jesus CEO, but it kind of feels like we're, watch me with the show. I feel like we're moving into like Jesus CEO. When I was a kid and you're Catholic, they tell you Jesus is everywhere.

50:24When you're like eight or nine years old and you're like, is he here right now? It's like, yes. And it's like, was he at lunch? Yep, Jesus was there too. too. I have now said there is there's Dr. Manhattan from Watchman. He's just like omnipresent. But Jeremy, like I set up root access, obviously Slack, Notion and Gmail and everything. So I was just working with one of my people and they're like, I'm going to be on vacation next week. I'm going to check email every day at like six o 'clock every morning at like seven o 'clock. I was like, don't bother. Here's the operations person. And I said, check in report, CIR.

50:55I built a skill for my open claw agent to just summarize and prioritize the person's emails every day at noon and 6 p.m., put that in categories, investments, operations, human resources, and then rank them by importance. And if we needed to get back to the person, the person's got vacation message on. And then the person's like, oh, you know, there was one email in there that like maybe people shouldn't see or whatever. And I had to like remind them like, please, it's a corporate email. It's like the company's property. We're a finance company. All emails are seen by all people. But like, we just have perfect clarity into their inbox, their Slack, when they're not here.

51:35Then my team was like, would you like us to bring these three former employees back to work and make them an open claw persona based on their old email and Slack, Jeremy? And I was like, am I allowed to do that? Because that's kind of like, what's the Stephen King cat's paw or something? Pet cemetery where they bring the pets back to life. I'm like, I'm not sure if that's a good idea to bring past employees to life. But yeah, let's do it. So we just turned on the Slack, turned on the Gmail, turned on the Notion edits of the person who left two years ago. And now you can talk to them and say, hey, tell me about this deal we did four years ago that we invested in the company.

52:13Give me the whole history. Very strange. How is it affecting you as a CEO, Jeremy? Are you becoming an omnipresent, keeping the strings nice and tight on the guitar? How do you? I mean, to the point back, the reason why we build this is just to have access to all of that data, to essentially have one system where all the data flows into. And it's not just me, but pretty much everyone at the company has access to everything. And that's really amazing because now you can know what's happening at the company as opposed to just knowing what's happening within your own team or your own departments or your own reports.

52:50And I think that to us has been a massive boost in productivity. How about from your perspective, Victor, how has it changed you as a CEO and a leader having this omnipresence and this cadence and all these tools that didn't exist three years ago? Hugely. And also, to set the record straight, it's not because I'm anti-AI. I just try to be very intentional about where I think there's actually value to be gained versus just playing with toys. And that's something I try and instill in the organization. even though that can also in itself be valuable. But I think stuff like I'm right now building one for kind of what I call like an executive changelog, which just scans like everything that's happening in Slack, emails, et cetera, and just on a daily level, just like which decisions did we make today in which team, right?

53:39And that's actually really cool. Like you'll get a list of decisions that's been made and that could be anything from like, we decided to like buy this platform, we churned on this product, this customer upgraded with like X amount. And I used to always, you know, read every single Slack message in the entire, we're 650 people, right? So like six months ago, that started to become like pretty challenging. But I thought it was really important always because it gave you the pulse of the company. You know what's happening in every single team, right? And this is like one way I think of trying to scale that.

54:08You have to use it in so many like areas of the business, like going to go to market team. It's hugely valuable for things like call prep, customer research, coming up with use cases. But you trained it specifically to say, if a decision is made, I just want to know who was involved in that decision and what was it. So it's the change log. So you've narrowed the focus of this operation of this cron job, just tell me the changes, the decisions people made, and you can just checkbox them or check in on them. Exactly. And the level of granularity is the thing that's difficult because if it's just a decision, at first it would show me everything that's going on in linear GitHub.

54:45That's way too much information for my level. So you have to fine-tune a little bit to figure are like, what's the kind of right level? But that's one of the things I've done recently that's hugely valuable. Obviously, connecting all your calls, even just the fact that you've recalled your calls and that becomes part of the context for whatever LLM you're using. As a sparing partner for strategy stuff, it's just amazing. I think there's no strategic decision I don't make where I don't discuss it with a GPT or an LLM first. And the other thing I'd say, which is very basic stuff, but starting to use like Whisperflow to actually talk.

55:22Oh, Whisperflow is awesome. That's the thing that's been one of the biggest productivity things for me because you really realize - Did you get a foot pedal yet? Did you get the foot pedal? No. Oh my God. Explain Whisperflow and why it's special versus just typical text to, speech to text. Yeah. Like Siri. I think so. The way Whisperflows works, you install it in a computer and you set a hotkey and then any text field that you operate on, no matter if it's a Slack, if it's an email you're writing, anything like that you just hold down the key and you speak i think what they've done well is that like there's some of these things that just transcribe you like directly and that's not always like that doesn't always like sound great but they they fixed the last five percent of like grammatical errors yes speaking or stuff like that so it actually comes out sounding like you know pretty reasonable i think that's like a super cool feature and i think they did that better than than any other product i've learned what i've had to learn myself is that it's when you talk to whisper flow, right?

56:18It's okay to take a 15 second thinking break. That's weird if you're speaking to another human being. So the way I speak or you speak to it, I think you kind of have to learn, right? Because I'll be like, you feel this like a pressure of like, I'm like right now, if I stopped speaking for 15 seconds, one of you would interject, right? But with whisper flow, you can sit in silence for five minutes if you don't know the next thing to say. And once I mastered that, which took me, it took me probably like a good week or so to like really internalize like how to use it. It's just like amazing. When you make a bullet point list as an example, you're like, okay, there's three things we need to focus on.

56:50We need to make sure that everybody's got a great microphone for the podcast. We have to make sure that we have great show notes. It will make it one, two, three. It'll format it for you. If you say somebody's last name and it's like Frankl, it's like, okay, I know Jeremy Frankl. It's going to spell his name correctly. It's really bizarre when you start using it. and everybody gives up on Siri because the mistakes are, there's so many mistakes that you wind up spending more time fixing Siri than you do the gain from not having to type. So you just instantly are like, I'll just type this. Siri is retarded.

57:28Whisperflow is like a genius editor who, or like the greatest executive assistant ever taking a memo. Like they know the context of what you're doing. They know your last name. producer Oliver, get everybody's address on the show. I'm sending everybody a foot pedal. This$26 foot pedal is my gift to you guys. It's a$26 foot pedal for your hour. Jason, how often do you use that foot pedal yourself? I just started. I'm on the road right now. I didn't bring it with me. I looked at it when I left and I was like, should I bring that with me? I used it 20 times a day in the first week because I was like, let me just try this.

58:06You put the foot pedal down and I could be drinking my coffee, I'm talking, I could be writing in my notepad, I could be doing whatever and moving a window around the screen. But it's in that text box, as Victor was saying. And then when I release it, that's when it puts the text in. So as Victor was explaining, Nick, you know, you could be brainstorming here. Hey, here's my to do list for today. This is now add that to talking to an open claw agent. Yeah. You know, I go on walks all the time with my team and by myself and I'm thinking, and I'm constantly at this point, like, I wish I had an AI model that could keep track of this thought process because I've just come up with a bunch of things that I lose them every time.

58:48I feel like the probably companies are working on this. Okay. You've got something. I'm going to send everybody on the show. This is becoming like the Johnny Carson show. Our guest today got like these three things yeah not only am i sending you each a paddle i'm sending you each a plod pin i'm not i didn't get them free i'm gonna pay for these like 150 bucks each the plod pin uh you can pin on your jacket i put it on my ski jacket when i'm skiing then you press this button boom it turns red it vibrates got a haptic now it's recording everything then when you get back and you put it in this little cradle to charge it it connects to your wi-fi automatically it then transcribes it it makes a summary and then you can do whatever you want with that so and it will do a mind map so it's got like all these templates so after i'm on my walk here we go this when this combines i believe plot at some point will have a native open claw agent in it and i told them like why don't you build like an earpiece that connects to the plot and like maybe we could have like a little back and forth they didn't tell me anything I don't have any inside information.

59:57I am so taken with this company. And they make one that goes like on the back of your phone too, like a MagSafe. Let's talk about AGI. It feels like to me that AGI has been achieved and we just haven't deployed it yet. That's my personal belief. Here's Dario who talks a lot. It is surprising to me that we are, you know, in my view, so close to these models reaching the level of human intelligence. and yet there doesn't seem to be a wider recognition in society of what's about to happen. It's as if this tsunami is coming at us and, you know, it's so close. We can see it on the horizon and yet people are coming up with these explanations for, oh, it's not actually a tsunami.

1:00:41It's, you know, that's just a trick of the light. And I think along with that, there hasn't been a public awareness of the risks. And, you know, therefore, governments haven't acted to address the risk. There's even an ideology that, you know, we should just try to accelerate as fast as possible, which, you know, I understand the benefits of the technology. I wrote Machines of Loving Grace, but I think there hasn't been an appropriate realization of the risks of the technology and there certainly hasn't been actions. Just specifically with Dario, he is on a heater. I don't think like we've ever seen an AI added more revenue in a month than like anybody in the history of capitalism has ever added.

1:01:19I'm not sure if there's like the top drug dealers in the history of like moving heroin and cocaine and fentanyl around the globe. You put them all together. They didn't add as much revenue in a month as he added. This is just a generational run, I think, is probably a good way to sort of frame it. But he kind of thinks the shit's going to hit the fan. He kind of thinks we're here. And we were talking about singularity before. Or where do you sit on the, hey, this could get acute, this could be society disruptive? And where are we in the AGI scale? How do you define AGI? I would say I'm not on the alarmist camp.

1:01:58I think technology is fundamentally interesting and useful, and it's a tool. I'd say the rate of progress you talk about every two weeks, I'm seeing releases from Anthropic daily, it looks like. To me, looking from the outside, it feels like the rate of progress is accelerating. So you had an exponential, but now this is like a double exponential. It feels like something very big is coming. I think that the world doesn't appreciate that it's happening because most people are not very good at asking questions. When I go around my company, I'll sit with engineers, I'll sit with people from any team.

1:02:34And what I find out is they're not that good at asking questions. And when you're not good at asking questions, it's hard to see the value in these things. And so I think most of the world isn't quite experiencing it yet, but they're going to realize it. There's sort of two skills with seeing the value in these, asking really good questions, which is a core skill from science. And the other one is management. because they're kind of like a person that you have to manage. So I think that's why the people don't see the wave. But from what I can see, it's just wild. The rate of progress is accelerating.

1:03:11Yeah. I mean, Dario Escobar is just delivering the good. He's got the high-quality good stuff. It's crazy. Jeremy, your thoughts on agent. So I very much agree with Nick. But to me, I guess, taking a step back, I don't really like the term AGI because to me, it's a moving goalpost with no real benchmark. If I showed you what we have today, 10 years ago, you would have definitely said it's AGI. But now, we're constantly moving the definition of what AGI really means. and from my perspective and I definitely think that from my perspective when I look at AGI I also look at the fact that I look at it as the two halves of the brain we have one half of the brain that understands language and creativity and all of those things and we're doing really well with that the other side of the brain which does math and understand structural data there we've done very little progress so far and humans generally are really bad at statistics and I think that for whatever definition you really have of AGI, I think that if we want to get to true AGI, we really need to do both of those well.

1:04:24And I don't think that we're not there yet. And that's really where we are focusing on, on improving that other side of the brain. But to Nick's point, I definitely agree that most people have absolutely no understanding of what's happening. Like I was talking to a friend of mine in London and she's an accountant and she told me, oh yeah, in my lifetime, accounting is never going to be replaced by automation. I'm like, what are you talking about? It's probably one of the first things that's going to be replaced. And I think that it's funny because people talk always about creative destruction and the fact that it's the same thing as the agricultural revolution or the industrial revolution.

1:05:02And it's true that we've seen there's going to be new opportunities and new jobs. But the difference, I think, between those past periods and now is that it's the first time we're really automating cognition as opposed to just automating the physical part of a job. And I don't think that people comprehend it. And I think that, you know, in Silicon Valley, we often live in a, you know, in an amazing bubble where like, you know, we see like, we see the world as it will look 10 years from now or like, you know, as people expect it to look 10 years from now. And I think that that's, and so, yeah, I very much agree with Nick here in terms of the rate of change is just unbelievable.

1:05:40And the physical is coming, by the way, the physical. Yeah, correct, exactly. Okay, great, great. The physical is coming. I mean, I think that, you know, physical, it's a bit more, it's a bit further away. I saw, I was at an event a few days ago, and I saw a bunch of, you know, robots, like, whatever, like an event with a bunch of robots and whatever. And it was just like, it's still lagging where, you know, where we are in terms of like, you know, the, on the LLM scale, I guess. But, but yeah, I agree that, you know, whatever we do in a few years, we'll definitely get there on the physical side as well.

1:06:13So, Victor, I'll open it up to you with the additional context of Americans are scared. Generally speaking, they're in the doomer camp for whatever reason. Chinese people seem to think it's going to be awesome and it's going to make life more fun and more efficient. Americans, they think 70 % in this Quinnipiac poll from yesterday, 70 % of them think they'll have a decrease in job opportunities. Last year when they asked that question was 56%. Interestingly, only 30 % of Americans are worried in the same poll about themselves. So they all think it's happening to somebody else. But who's right here?

1:06:57Are the optimists, Nick and Jeremy, right? Like, hey, this is going to be awesome. Is the 70 % of Americans who think this is going to impact jobs correct? Is Dario correct? AGI is kind of landing this year. What are your thoughts? I tend to agree with Nick and Jeremy. I think obviously the rate of progress is insane. We've seen how it works for techs. Now we're seeing it for video. We're seeing it for voice. We're seeing it for physical intelligence. in the next couple of years, that will definitely also start to get there. And I think, as Jeremy's part, right, AGI, I think it's a word that doesn't really have any meaning.

1:07:34It's a moving goalpost. Like, if you took this 50 years back, you'd almost be burned at the stake, right? Or how many years back is burned at the stake? And people would definitely say, this is definitely like artificial general intelligence, which is what the word stands for. I tend to be more optimistic. I do think that humans will want to play status games. I think we'll find other jobs. I think we'll probably be doing less numerical and logical jobs. And I think actually maybe a lot of the value that will accrue in society is going to go more towards things we actually all of us enjoy more.

1:08:01Things like going to a great restaurant, working out, listening to live music, like all those things that most of us like to do in our free time. I think increasingly jobs are going to move more towards like that's where like the value in society accrues. Less on the like I'm really good at maths, I'm really good at like software development. And I just think that's like a positive thing that most people would want to see. but I am a bit worried about there's a book by Alvin Toffler called Future Shock which was written I think 30 or 40 years ago which talked about this idea that if we see the rate of change happening too fast we get this lag where that can create things like civil unrest huge job losses so on and so forth and I'd say I am in the camp of optimists but I don't think that's a completely non-zero scenario that something like that happens we got to keep the rope tight right you know i think you have to tell everybody that you can about what's about to happen so that everyone's in on it and it's not so shocking like i try to evangelize it everywhere i can i think also to your part right i think one thing i've also learned for the last nine years building a tool for essentially creative expression is that you cannot underestimate enough how little creativity most people have which is another version of like the same thing you said nick of like people don't know how to ask questions or like work with these things and they'll have to change.

1:09:20Right. I think that's kind of interesting because if you go, you know, far enough back in time, the philosophers were like the most well-paid people in society. Right. They were like the titans of industry. They were going to go back to a world in which actually like those kind of skills are going to be valued a lot higher than the kind of technical execution of like writing code or working in finance or those kind of jobs. Well, wasn't there a survey that said that most Americans hate AI or hate the term AI or believe that data centers is the main reason why energy prices are going up, let alone inflation or what's happening in the Middle East, people are really scared of it.

1:09:57And so to your point, Victor, about sin and unrest, how do you prevent that when the rate of change is happening so quickly? And I think also, unfortunately, the populace is not always right, right? But they'll want to find an explanation for potentially other things that's happening in the world. I think that's a different discussion, but I think in general, the West is definitely in jeopardy. AI may help or may work against it. That can be a great scapegoat also, right? That's what I mean, right? It can end up becoming kind of like a scapegoat. Yeah, well, we got to teach everybody we can. This is the most hilarious thing ever.

1:10:39We'll start from the bottom. 61 % of people feel negative about the leadership of Iran. 52 % feel terrible about the Democratic Party. 46, AI. Yeah, just below ICE and Iran is AI. It also matches Gavin Newsom almost perfectly. Yeah, exactly. Yeah, which, by the way, Gavin Newsom, I actually think is an AI. I think that's like Optimus 4 with great hair. He does not feel to me like a human. I actually think he's like a bot sent from the future by Elon to then be a Manchurian candidate. Manchurian candidate Gavin Newsom. All right, gentlemen, this has been amazing. Let me thank our guests, Nick, Victor, and Jeremy.

1:11:26Gentlemen, you guys were so great together. What a great team effort here, passing the ball around. I'm going to ask you each to come back on the same show, So we're going to try to coordinate your schedules. Hopefully you guys will, you know, have such a great reaction to this episode of This Week in AI that you'll come back in maybe four or five weeks and we'll chop it up again. All right. Awesome. Thanks, everybody. And we'll see you all next time. Bye-bye.

From the publisher

This Week in AI, JCal sits down with three CEOs building the infrastructure, intelligence, and interfaces for the next era of AI: Jeremy Fraenkel (CEO, Fundamental), Victor Riparbelli (CEO, Synthesia), and Nick Harris (CEO, Lightmatter). We break down what's actually happening beneath the AI hype: the data modality LLMs completely missed, why copper is the real bottleneck in AI data centers, OpenAI shutting down Sora, the build vs. buy debate for AI tools, and how close we really are to AGI.

  • AI's Biggest Blind Spot, Tabular Data: LLMs transformed text, images, and code, but 70-80% of enterprise data lives in rows and columns.
  • Copper Can't Keep Up: Nick explains why AI data centers are hitting a wall. GPUs compute faster than they can communicate. Lightmatter's photonic chips push 1.6 terabits per fiber and can 3x training speed.
  • Why OpenAI Killed Sora & Anthropic's Focus is Winning: Victor breaks down why even OpenAI had to learn the lesson of focus, and why Claude Code has every founder talking.
  • Vibe Coding Your Own CRM vs. Buying Salesforce: Jeremy reveals Fundamental built their own internal CRM using vibe coding. The panel debates when building beats buying and when it's a distraction.
  • The Omnipresent CEO: Jason shares how he's using AI agents for root access to Slack, Gmail, and Notion, resurrecting former employees as AI personas, automating SDR workflows, and summarizing employee inboxes while they're on vacation.
  • Are We Already at AGI?: Nick says the rate of progress is a double exponential. Jeremy argues AGI is a moving goalpost. Victor warns of "Future Shock" and societal disruption.

🔗 Learn more about Fundamental: https://fundamental.tech🔗 Learn more about Synthesia: https://www.synthesia.io🔗 Learn more about Lightmatter: https://lightmatter.coThis Week In AI is made possible by:PayPal Open - One Platform for all Business: paypalopen.comTimestamps:00:00 Welcome & intro to Jeremy Fraenkel, Victor Riparbelli, and Nick Harris01:47 What is Fundamental? Large tabular models explained07:01 Victor Riparbelli on Synthesia & why OpenAI killed Sora11:09 Claude Code dominance & the Lightspeed founder retreat12:08 Nick Harris on Lightmatter, photonics & the new Moore's Law14:38 Copper vs. fiber: why AI data centers are hitting a wall18:44 Reinventing video: interactive, real-time, personalized21:32 The economics of a custom AI movie23:55 Why Amazon, Google & Meta are building their own chips28:06 Tables have a bandwidth problem too32:27 When will compute be as cheap as storage?36:10 The future of software: every company gets a custom stack38:06 Vibe coding your own CRM vs. buying Salesforce45:57 Jason's quest for root access to Slack50:18 The omnipresent CEO: Doctor Manhattan meets Jesus CEO52:13 Resurrecting former employees as AI personas53:25 Victor's executive changelog for a 650-person company55:07 Whisper Flow & the Plaud Pin1:00:03 AGI: is it already here?1:03:37 Jeremy: we've only solved half the brain1:06:30 70% of Americans fear AI will impact jobs1:08:47 Future Shock & keeping the rope tight*Mentioned in the show:*

Wisper Flow: https://wisperflow.ai

  • Plaud Pin: https://www.plaud.ai
  • Athena Executive Assistants: https://www.athenawow.com
  • WHOOP: https://www.whoop.com
  • "Future Shock" by Alvin Toffler: https://www.amazon.com/Future-ShockAlvin-Toffler/dp/0394425863
  • Victor on TWiST, E1776: https://youtu.be/jxET4fq_2eA
  • Nick on TWiST, E1787: https://youtu.be/FPW2nnEqfMsSubscribe to This Week in AI on Apple: https://thisweekinai.ai/spotifySubscribe to This Week in AI on Spotify: https://thisweekinai.ai/appleThanks for watching!🤖 If you want to stay ahead of the curve on all things AI, make sure to join our community across all platforms:📩 Get the Weekly Newsletter: https://thisweekinai.ai/📺 Subscribe on YouTube: https://www.youtube.com/@ThisWeekinAIPodcast📸 Instagram: https://www.instagram.com/thisweekinaipodcast

More from This Week in AI

All 34 episodes
How Focus Killed Sora and Saved AnthropicThis Week in AI · 1 h 12 min
Listen in VO