In short
A March 2026 “In Case You Missed It” recap (episode 982) featuring highlights from prior Super Data Science Podcast interviews: AI for personalized education, AI agents/world models for exploration, AI coding assistants for performance, and “autonomous intelligence”/decentralized enterprise AI.
Guests and backgrounds
- Zach Kass, author of The Next Renaissance; grew up in rural Ontario (no electricity/running water); discusses education reform and writes for parents.
- Kyungyung Cho, NYU professor; researches AI agents/world models; co-authored “Planning with Latent Dynamics Models” (ICML workshop award).
- Chris Fregley, O’Reilly author and AI performance engineer; focuses on coding workflows and evals.
- Lin Xiao, CEO of Fireworks AI; builds open-source model deployment at scale.
- Rohit Chowdhury, founder/CEO of AccelData; argues for decentralized intelligent operating environments.
Key claims + examples
- AI can tailor learning; teachers shift to empathy/oversight; cites Success Academy (Eva Moskowitz), Alpha School (Mackenzie Price), and Waldorf/Rudolf Steiner.
- World understanding can rely on latent dynamics/world models rather than pixel-step imagination; sample efficiency parallels search/experiments.
- Coding assistants: stop manual coding; develop on target hardware; prioritize evals/correctness checks over line-by-line review.
- Autonomous intelligence: continuously customize models using private enterprise data; “millions of models” per app/use case.
- Enterprises should decentralize: move models closer to data; SLMs/LLMs in the stack.
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Chapters
Tap a time to open that second in VOExploring Personalized Education with Zach Kass
0:45 to 4:47
Zach Kass discusses the role of AI in customizing education for students.
“So it means that this situation that we've had historically, if I think back to my grandmother, she was in a school where all grades were in one room and a teacher is having to figure out how to teach all grades at once.”
The Legacy of Education Reformers
4:47 to 9:39
Discussion on influential educational figures and their impact on teaching.
“since, you know, the book's been out a month, we sold 37 ,000 copies in the first month.”
Advancements in AI and Education
9:39 to 14:00
Insights on how AI will shape learning and exploration in education.
“and I'm a big supporter of what she does.”
Efficient Protein Targeting with AI Algorithms
14:00 to 16:40
Explore how AI algorithms can optimize protein testing and searches.
“see if any one of them bind to this particular target protein.”
Challenges in Robotics and AI Research
17:10 to 19:50
Delve into the complexities of robotics and AI, including real-world applications.
“Definitely out of the research in general, exciting things will come out.”
Understanding World Models in AI
19:50 to 21:45
Understand the debate around world models and their implications in AI.
“So then one might say that actually what we need is a very high level picture of how the world works and then be able to jump back and forth.”
The Evolution of Coding Assistance Tools
21:45 to 24:49
Examine how AI-powered coding tools are transforming software development.
“you mentioned to me prior to us recording that you've been loving using AI coding assistance.”
Streamlining AI Development and Performance
24:49 to 28:00
Learn about optimizing AI development processes and ensuring performance.
“Like, I've literally never used any of the personal GPUs because to me, the profile is so different.”
Optimizing Model Performance with Correctness Checks
28:00 to 29:50
Learn about the challenges of optimizing AI models while ensuring correctness.
“So short answer is no, I stopped doing that.”
The Rise of Autonomous Intelligence in AI
29:50 to 33:00
Discover how autonomous intelligence is reshaping the use of AI in applications.
“At Super Data Science, we rightly predicted the hype around AI agents and how they could help us code better.”
Show all 14 chapters
Transformative Effects of AI Agents
33:00 to 36:40
Explore how AI agents are changing job roles and daily tasks in various fields.
“our application enterprise product, it keeps evolving.”
Navigating the Future of Work with AI
36:40 to 41:20
Understand the transition towards a collaborative world of humans and AI.
“So we heard a lot about AI is going to free up a lot of human labor, right?”
The Role of SLMs in AI Systems
41:20 to 42:01
Learn about the importance of small language models in enterprise applications.
“And I think, you know, that is the only way that, you know, organizations will progress further.”
The Future of Small Language Models in Enterprises
42:01 to 43:55
Explore how small language models can effectively serve specialized tasks in enterprises.
“And this is a really exciting area where you don't necessarily need to have these big, think about Claude Opus.”
Transcript
Automatic transcript. May contain errors.0:00Jon Krohn:This is episode number 982, our In Case You Missed It in March episode.
0:08Jon Krohn:Welcome back to the Super Data Science Podcast. I'm your host, Jon Krohn. This is an In Case You Missed It episode that highlights the best parts of conversations we had on the show over the past month. In episode number 975, I ask author of The Next Renaissance, a bestselling book, highly recommended. I've been reading it. I love it. And the author is named Zach Kass. In this clip, he talks about how AI might help schools tailor their education to each student. Do you think that AI tools can play a positive role as well with things like personalized learning in the classroom, helping people? So it means that this situation that we've had historically, if I think back to my grandmother, she was in a school where all grades were in one room and a teacher is having to figure out how to teach all grades at once.
1:04Jon Krohn:Grades one through eight, or I guess in the US they would say first grade through eighth grade. I'm Canadian, Zach.
1:10Zack Kass:Where did she grow up?
1:12Jon Krohn:uh, in Ontario, uh, in, in rural Ontario, uh, no electricity, no running water. Uh, yeah, in the 1930s, 1940s, uh, you know, kind of like a two hour drive out of Toronto. And, um, yeah, so, you know, so her experience of education was where a teacher has 20 kids and those kids are all different ages, you know, five to 13. Um, and, you know, we figured out over time, how to get children, for the most part, in most parts of the developed world, you'll now have kids that are around the same age, around this, you know, kind of a one-year band progressing together. But of course, even in that scenario, all these kids are learning at slightly different rates.
1:58And so the kids that are really good at math, in the math portion,
2:04Jon Krohn:They're bored. And so it seems to me like there's this opportunity with AI to be having personalized education for everyone. And maybe the teacher kind of becomes more of offering oversight and encouragement and that kind of human element, the empathy. I'll turn the floor over to you.
2:22Zack Kass:I mean, we could, and actually I do. The book, if it has a lasting legacy, it will likely be its ideas for parents. And I actually, I wrote about it this morning. I wrote in a LinkedIn post that I think that I didn't realize when I was writing the book who I was writing it for. And And in fact, I wrote the book originally as simply a place to think about my own arguments. Like it wasn't, it really wasn't for anyone else. And I never really considered that people would read it. Like I didn't really consider that anyone would read it. And this is also an aside, but it's fun. In the process of writing it, I started getting really into a bunch of other nonfiction.
3:14Zack Kass:And I was just devouring my favorite nonfiction because writing nonfiction, is uh entertaining non-fiction is quite challenging i mean especially if you're talking about a technical subject and so i went back and read a bunch of my favorite non-fiction writers one of which is hunter s thompson who's just you know all time that's
3:35Jon Krohn:fear and loathing in las vegas uh is his most famous title i think it's certainly one of them
3:40Zack Kass:yeah yeah fear and loathing in las in las vegas fear and loathing on the campaign trails is there's there's a long list but um but he uh he wrote once the worst part about writing a book of meaning is that someone smart will have to read it and he for all of his sort of uh nihilism he was quite sensitive and like didn't like didn't like the idea like didn't like critics and didn't like the idea that people would, I mean, most great artists don't. And I became paralyzed when I realized as we were wrapping up the book that people outside of my circle would have to start reading it. And was, and, and like still to this day, I'm quite nervous for people to like it.
4:25Zack Kass:But I also in the process didn't consider who would read it. Like I, I, you write with most great writers, right. With someone in mind, right. With like a reader in mind. And I wrote with like ideas in mind. I was like, I just need to, you know, I need to put these on paper and sort of stare at them. And it became very clear to me in the last probably two weeks, since, you know, the book's been out a month, we sold 37 ,000 copies in the first month. And in the last two weeks, it became very clear. I wrote the book for parents And I wrote the book for anyone responsible for another human right now who is trying to make sense of a world that is increasingly unfamiliar against a relentlessly dystopian backdrop of news and media.
5:15Zack Kass:who wants to feel like they are an active participant, who wants to have evidence in defense of their hope, who wants to be able to wake up over breakfast and say to their kids, no, you're going to be great. To say to their kids what our parents said to us, or at least what our parents would have wanted to say to us. The world is going to be a special place and you're going to make it better. And here's what I'm going to do to make it better. And here's, here's the role we all need to play. And that's the evidence we tried to give people and, and the, and the, and the conversation we tried to start.
5:55Zack Kass:The chapter about education is the best chapter in the book. I don't really, I think it's like, I'm an objective observer as much as anyone. And like, it's just, it was my favorite to write in part because my wife is a Waldorf teacher. Waldorf is the, is an alternative education school, much like Montessori. That's a little more alternative, quite frankly, in the ways of its thinking. And I feature in the education section, three luminaries, three education luminaries, two of whom are living and are very important. One is Eva Moskowitz, who has rebuilt a charter, rebuilt public education, actually.
6:30Zack Kass:Eva Moskowitz ran for education board in New York City on reform. And they shunned her, they kicked her out. She went and started this now exceptionally famous charter school in New York that everyone should look up and learn about called Success Academy. And Success Academy has, I think it's basically the largest, you know it, John.
6:50Jon Krohn:I know it, not because I know anything about it, but I work at, I have this fellowship at this really cool AI startup in New York called Lightning AI. And, and so, and what this fellowship means is that I work out of their office every day, which is pretty sweet because they're doing amazing things and next door to the lightning a office on 22nd street next to madison square is a success again and so i see i see the sign and i see the kids coming out with their uniforms on uh but i actually don't know anything about it other than there's that yeah that's kind of weird
7:24Zack Kass:connection that i see it all the time it is a remarkable so it's the largest public school system in the in the country i think now she runs now it's not technically public because it's it's charter or it's not defined as public. And the more you learn about Eva and the more you learn about Success Academy, you learn that she's sort of become an enemy to the traditional education state. But she has built a program that is guided on accountability principles. And she's doing a much better job. So I simply argue in the book, if we only hold parents, teachers, and students more accountable and treat this as a matter of life and death, right?
8:04Zack Kass:Which you can make the argument education is in many, you know, it's like the outcome of an individual who graduates college, those who don't, et cetera, or graduates high school, rather, those who don't. Like it's a critical moment that we should treat with a whole lot more importance. Then I feature Mackenzie Price and Mackenzie Price is building Alpha School, which believes that it can reinvent traditional education and take it a step further than Eva Moskowitz by building schools where the student spends two hours a day at a terminal, at a screen, doing self-guided learning, as you described, where 100 students in the same grade at the same moment can be learning different things at different rates.
8:52Zack Kass:And that terminal then feeds back to the student what they're doing well, what they're not, and their guide, what they call guides, not teachers, who support their education and their parents so that everyone can be on the same page about their development. And it works empirically for some students. It has a higher attrition rate than others. I call this out. I don't want to be sycophantic. Some students opt out immediately, but they have some really high performers academically. The rest of the five hours or six hours of the student's day spent outside in physical activity, in game theory, in life skills, and learning this idea of, you know, sort of grit, the characters and qualities of a great person.
9:34Zack Kass:It's working. I mean, parents are voting with their feet right now. And Mackenzie is a friend and I'm a big supporter of what she does. And I think even if you don't believe in alpha school, you can believe that it is on the right track. And then I spotlight Rudolf Steiner. And Rudolf Steiner founded Waldorf School 150 years ago and made the argument at the time very simply, which was that we were destroying, as he put it, it was the death of the soul and spirit of the child, the industrialization of education as we hauled kids off to the modern classroom and sat them at desks and made them learn about math so that they could eventually work in a factory, that was the destruction of the soul and spirit of the child.
10:19Zack Kass:Now, what he didn't appreciate, or maybe he did, but didn't really calculate, was how well we would do economically such that we would justify the industrialization of education, which we really do, we can, that we needed to industrialize education so that we can arrive at this moment. And my argument in the book is that if we borrow from luminaries like Eva and Mackenzie and Rudolph's original writings, what we can actually inform is a future of education that harkens somehow to a past prior to the economic optimization of a child. Where children and the purpose of childhood, I argue in the book, is to understand yourself without economic incentives, which no adult gets to do.
11:06Zack Kass:You cannot, as a rational adult, explore yourself in an open, honest way without economic incentives, but you can as a child. You can know what it means to be a human without wondering if you need to make money, ideally for most children. And the sanctity of that experience is so important. And we've lost it in industrial education. So much from a young age is about getting a good job. You need these skills in order to get a good job, but maybe that's not what we need to do anymore. And it's not because I think work goes away. We can talk about this. It's not because I think we stop working. It's because I critically think that the opportunity now to give people the tools to actually explore a world that is going to be way more explorative are abundant.
11:53Zack Kass:and to your point the role of the teacher is no longer to be the smartest person in the room it was never really to be the smartest person in the room they just had to be it's to inspire it's to create a safe space where kids can actually explore what it means to to be human in a way that that sort of only childhood can offer us at that young age and it and it and it could restore i think it could restore and in many ways lead to a spiritual awakening i mean one of the critical arguments of the book that I don't, I have to make carefully because I don't want to sound too woo-woo outright is I think that the next Renaissance is in many ways a spiritual awakening where people actually start to reconsider the rat race we have been on for a long time and what it truly means to be human and why we are here.
12:41Zack Kass:And that will start with education. That will start with redesigning the classroom to actually let the child understand why they are learning, how they learn, what it means to sort of explore versus, you know, knowing something.
12:59Jon Krohn:My interview with Zach really highlights why a rigorous and tailored education is so critical for students all the way up to those who teach them. I expect we will see plenty of AI agents emerging in this next renaissance. For Kyungyung Cho, such agents will soon help us to direct our attention to the developments that matter. In episode number 977, I speak to the renowned NYU New York University professor about how he thinks AI will come to explore the world in a similar way to humans. When you talk about actively mining data, I suppose this is like an agent searching the web for relevant information or in the not too distant future, perhaps a physical embodiment, like a robotic embodiment, being able to explore the physical space and maybe even interact with objects in its space.
13:43Absolutely. In fact, all of those included, in some sense, they are not that different from each other. Say you want to run some kind of actual experiments. You want to test whether a particular protein is going to bind to yet another protein that we want to design a drug for. Now, one way you can imagine is that, well, I'm going to try all possible proteins and then see if any one of them bind to this particular target protein. Of course, all possible proteins is, that doesn't make any sense. There are too many of them, right? We don't even know what kind of proteins exist that are stable and can be synthesized within a cell or whatnot.
14:18So we cannot simply say that we will try all possible proteins. So then what we do, we're going to use a very smart algorithm to pick only small number of the proteins at a time to test. And then based on the feedback, we're going to continue to choose the next batch of the proteins so that we can actually find a good binder way earlier than trying out all those that put all possible proteins. And then this is a sample efficiency we gain, right? And it's actually the same with the search as well. In other United, of course, we think of the search as a completely software-based, let's say, implementation or the system.
14:54At the end of the day, we use Google search. We are embodied, right? So we are a physical robot ourselves. And then the same thing. Internet has so many documents. One way to figure out which documents are relevant for my question is to read each and every one of them and then try to decide which subset matter. But again, there are too many of them. So what we want to do is that we want to interact with the search engine to find or figure out how to find the small subset of time. And then after a couple of the rounds, I'll be sure that I have found the relevant documents. So these things are all the same thing.
15:28Now, of course, when it comes to physical robots as well as physical experimentations, there are a lot of issues, not necessarily because of the AI algorithms, but because physical words are much more fragile than software words.
15:42Jon Krohn:On this podcast, I'm always going on about how Claude Code is mind-blowing, but now Claude Co-Work is making my jaw drop as well. For example, I recently wanted to quantify how healthy my sales pipeline is for my AI consulting business. I simply asked Claude to estimate my sales for the coming quarter, and it brought info from relevant Google Sheets and my Gmail to create a professional spreadsheet of clients with estimated revenue for each one. Whoa, this might have taken me a day. Instead, it was done flawlessly with Claude Cowork in minutes. Claude is the AI for minds that don't stop at good enough.
16:13Jon Krohn:It's the collaborator that actually understands your entire workflow and thinks with you. Whether you're debugging code at midnight or strategizing your next business move, Claude extends your thinking to tackle the problems that matter. Ah, and you'll appreciate that I can ask Cowork to show me data, such as my sales spreadsheet, and it provides an interactive chart right in the conversation. For problems worth solving, get started with Claude at Claude.ai slash superdata. That's Claude.ai slash superdata. And check out Claude Pro, which includes access to all of the features mentioned in today's episode.
16:43Jon Krohn:Claude.ai slash superdata. Mm-hmm, mm-hmm. You have to be careful. You can be tricky, for example, to pick grapes without shattering them for a robot to be able to do. But it's something that robots are starting to figure out more and more. It's an area that I'm personally excited about a lot. Now co-supervising this AI robotics research at the University of Auckland, and we'll see hopefully some exciting things come out of that. Definitely out of the research in general, exciting things will come out. I know Jan Lekun is bullish on world models. He's got his advanced machine intelligence startup that he has going.
17:21Jon Krohn:Even though this is a separate effort, you two co-authored a 2015 paper last year that won the best paper award at ICML in the workshop on physically plausible world models. This paper was called Planning with Latent Dynamics Models. And we'll have that in the show notes, of course, for listeners to check out. But does that tie into the conversation that we were just having, that research? Yeah. And then it actually ties into to all the things that we have talked about a bit, like the information processing and whatnot. So what does it mean for us to know about the world? Because we talked about the world model.
17:56And then it turned out that that alone is a very big question. Some people believe that if I can imagine what's going to happen in the future at a very high, let's say, quality or high fidelity, then I may be able to say that I understand about the world. Some people say that that's not true. We actually don't have a good picture or the imagination that is high fidelity. We have a very high level concepts that are extracted. We know how those concepts interact with each other. And then that's probably enough. But of course, who's to say which one is better? But nice thing about this large scale machine learning or the AI era now is that in many cases we can test them.
18:38So, you know, we all have heard about and maybe tested those OpenAI Sora models or the Google's Genie models and all those video generation models like the Runway has one. These are amazing models. And then some people who are building these models in their mind have this thought that by building this kind of video generation model or the action video generation model, maybe we can build a machine learning model or the AI system that understands the world. And then using that kind of imagination to plan out what's going to happen. But then on the other hand, some might think and then it's very natural for us to question whether that is necessary.
19:18Say I want to travel to Paris. I'm not going to plan out every single step and then trying to imagine every step I actually take from here all the way to JFK and then walking toward the gate, walking to my seat, having a seat. I don't really care about that. What I'm going to imagine is that say I already made it to Paris. What am I going to do? What is going to the first restaurant that I'm going to go into and then trying to order some wine and whatnot. But I don't really need to imagine all those steps in between. So then one might say that actually what we need is a very high level picture of how the world works and then be able to jump back and forth.
20:00And then that's what we meant by the latent dynamics. And then that's the kind of foundation on top of which what Jan has been calling as a JAPA, that is a joint embedding predictive architecture. And then also this idea, of course, goes back like decades, right? Many people in neuroscience have been thinking about it and control theory has been all about, can we find the abstraction or the small number of the knobs that actually matter in controlling any of the systems? And then we all work at that level. Then we're going to project it down eventually. So which one is the right way to go about?
20:33It's unclear in my view, because the nice thing about predicting every step of the way makes computation extremely regular. What that means is that it's very good with the current digital computers to implement and scale up. On the other hand, just intuitively saying, we don't do this kind of a step-by-step, let's say, imagination. So there is a kind of hope that maybe we really don't need to do that because we have a proof of concept here. It's that, yes, we can skip all those steps. Which one will be right? It's unclear. But something will have to be done in this latent space rather than the pixel space.
21:10Jon Krohn:As Kyung-young says, it isn't enough to replicate our reality and expect our intelligence systems to operate to their full potential. Intelligence systems will require abstract states as well as raw observations for us to see meaningful development. With this in mind, let's move on to the people who are developing the AI systems. In episode 973, I asked the AI performance engineer and famed O 'Reilly author Chris Fregley how he uses automated processes and code scripting in his work. Speaking of tips and ways that people can be getting ahead more quickly, you mentioned to me prior to us recording that you've been loving using AI coding assistance.
21:51Jon Krohn:And so, you know, tools like Cursor, Cloud Code, Codex, how has your workflow changed as a result of these kinds of tools? how does that impact in particular AI systems performance, optimization? And yeah, you know, what do our listeners need to know about where this is going? For sure. I tweeted about this a couple of weeks ago. If you're manually writing code in this year, 2026, you are way behind. And I would not have said that if I didn't spend all of last year watching this sort of evolution, because I started off in my sort of legacy ways, right, where I was writing every line of code. And I vowed for 2026 to only use these coding assistants and to see how far I could get.
Read the full transcript
22:45Now, I've done a couple of projects for some friends and for some portfolio companies. And just to make sure that, you know. So the short of it is you can fire off about 10 to 15 different things, like different aspects of either features that you're trying to build or bugs that you're trying to find. I'm personally using these tools right now to do a lot of optimizations and to look at different aspects. And so I'll say, take a look at the occupancy percentage for this particular kernel that I'm trying to optimize. At the same time, I'm having another GPU that has the same code that's analyzing a different part of it.
23:33And so think of a four GPU system and you can run separate experiments, each one running on a different GPU or even four separate GPUs, like separate nodes that have their own memory and stuff. But yeah, my personal workflow, I'm going to be a little controversial and say I prefer codecs. Yeah, I prefer the OpenAI. One thing, and again, very, very workload specific, I would say. I think if I was doing UI stuff, I would probably maybe prefer Claude right now. Claude's great with the UI. It's kind of my little dirty secret that I use codecs. And so while all the other developers are flooding, right, the anthropic GPUs and the inference stacks, I've got kind of my little group of people that just use codex and I still have really good performance until people realize that codex is actually better for other stuff.
24:31But for right now, I'm enjoying good performance and a fair amount of token. But the one thing I would recommend for AI systems, performance would be be on the machine. Don't try to do this stuff on your MacBook and hope that it works or even on a personal like NVIDIA GPU, like an RTX. Yeah, I don't know, 50. Like, I've literally never used any of the personal GPUs because to me, the profile is so different. The hardware is so different. The memory bandwidth completely different. So if you are working on an on an AI project and you are ultimately going to deploy on a blackwell or on a hopper, you have to be on that machine during development.
25:17Don't try to take any shortcuts. I recently tried the DGX Spark, which is the little mini one that got a lot of buzz, you know, the end of last year. There's so many things disabled on that, that none of my benchmarking was even working because it's just completely missing a lot of, you know, core hardware components and then, you know, software components on top. The driver isn't the same. It's, you know, a lot of different things.
25:43Jon Krohn:Nice. Really appreciate your insights on what you're doing with the coding assistants today. When you're working on those, Chris, do you still review all of the code before it goes to production? I did. I was once, yeah, yeah. I was once like you or once like the question that you're asking. In fact, I was just working with, yeah, I was just working with someone this weekend trying to get them a little bit up to speed. It's a good friend of mine. And I'm like, look, you're doing things like you're going to be outdated by St. Paddy's Day. That was the joke specifically. And I was watching their workflow and these assistants, they like to write little snippets of Python code or bash scripts to get stuff done.
26:36and this person was literally reading every single line of the bash script. It's happening during the thinking process and they would go up and they would expand it and they would be looking and they try to find the script on disk. And I'm like, dude, you have to let go. So the short answer is I did and it's exhausting and I've learned to step back. and there's like temporary scripts that these things write to write the final code. And you could do that and you could be very disciplined and like review all the lines of code. You could write tests. You can have the like LLM actually write the tests as well too.
27:25I've actually even sort of let go of unit tests. And this is very controversial for all of my test-driven friends and folks that are listening. I focus on the evals. So I clearly set up and provide examples that I know are correct. Those are sort of the collaboration set. And then I use the LLM to actually judge the quality. I have it constantly running. So I've got evals that are always running in the background in a separate tab while I'm building the software. So short answer is no, I stopped doing that. And it really slows things down. And it's hard for people to do, but I'm shipping code a lot faster.
28:15I'm, you know, with kernel optimization, you have to be very careful. These models want to hack the reward or it's called reward hacking and just get the fastest thing possible. And if that means, you know, zeroing out everything to make the, you know, computations a lot faster, it's going to do it. And so one thing I spent a lot of time on with my GitHub repo is these like correctness checks and correctness verifications. And these pop up. Yeah, every single month, someone released some small little startup, releases something that they have achieved 50x speed up. And the first thing I do is take that code and I put it into my harness and boom, I see that they're not using CUDA streams properly or that it's not their fault.
29:09It's just that they've given the LLM too much freedom. And so we have to get better about what it means to review. And I don't think even going through all the code that you would be able to catch these things, because I assume that they went through and looked at the code, but not unless you're actually running the code on the machine and you've got all of the profiling, you know, set up where it can show you how many streams are being used and, you know, all the different aspects. If you don't have correctness checks, If that's in the form of evals for your sort of end user application or, you know, performance metrics and like real, you know, correctness checks within your performance harness, then you're not doing it the right way.
29:54Jon Krohn:At Super Data Science, we rightly predicted the hype around AI agents and how they could help us code better. In episode 971, I speak to the CEO of Fireworks AI, Lin Xiao, about where she sees the crossover between AI agents and what she has termed autonomous intelligence. So we're here to talk about Fireworks AI, your business, which has done incredibly well. I mean, you've just grown so quickly. I believe you've now raised over$300 million in venture capital, including a recent$250 million Series C, if I got that correctly. Right. And so it's a platform built around open source model deployment at scale.
30:36Jon Krohn:And the Fireworks AI platform is built around open source model deployment at scale and this idea of autonomous intelligence. Tell us what that means, Lin. Yeah, sure. You're right. We raised our last round last year and we are growing really fast. So our mission is autonomous intelligence. This mission is very complementary to AGI, where the direction of AGI focuses on investing in directing a lot of intelligence into this one model and have this model be able to solve various different kinds of tasks in a great way. So the idea is you just build your application on top of the AGI model as a utility, right?
31:25So this is a great, AGI is a great interaction. It's very scalable if it's successful. But the reality is only a very small fraction of data goes into the foundation models for AGI. If you look at the worst data, majority of the data, by majority, I really mean like more than 90 % of the data is actually not in the public domain. It's not in public internet. It's not labeled by labeling companies, which goes into the foundation models. And majority of those data are private data locked inside applications and enterprises. And data, we all know data is intelligence. Data is knowledge. And those application-specific, enterprise-specific data is not accessible by the AGI labs.
32:24And we just leave a lot of intelligence on the table. My prediction, and that's where we're betting on the future, is to be able to activate those private data and let the model absorb additional application-specific intelligence and bring the model to the next level. And this kind of motion is more like customization, right? It is the model and the inference deployment were customized towards applications in their specific pattern. And this customization should not be just one time, right? our application enterprise product, it keeps evolving. So this customization should be continuous. And ideally, this continuous customization should be fully automated.
33:15That's autonomous intelligence. We are making great progress towards that direction. And we believe the future is not one model result. It's going to be millions of models, one per application per use case. All right.
33:31Jon Krohn:So the term autonomous intelligence, it sounds kind of vaguely to me like the buzzword of 2025 in our field, probably the buzzword for 2026, which is agentic AI. But it sounds like it's quite different from agentic AI, this idea of autonomous intelligence. It's heavily connected with agentic AI. So think about agent as a way to automate many of our day-to-day tasks. So we have been living the world that many expert intense tasks have been gradually automated so we can free up our time. Eventually, some of the even professions will be redefined. And so, for example, I think there are interview agents or hiring agents where you give a job listing, it will source the candidates and even do the first rounds of filtering and interview for you.
34:29And there's marketing agent, you give your ICP list and will source the right company, right stakeholders, and start to drive customized outbound emails and riches. and their customer service agent just give the human agent some really good assistance to kind of be smart. And there are so many agents who are doctors and so on. So this is happening. It's transforming our day-to-day life. But similarly, another big transformation that's happening is in my domain is software development is being disrupted. And today, a coding agent can really start to behave like a junior engineer. And I'm not kidding.
35:21This is kind of really happening. And it's actually changed our interview process. And the fundamental question we're asking ourselves, is coding interview important anymore? So coding interview in the past is going to replace by how good you are at using coding agents. So it is actually happening across our day-to-day life. Now, let's go back to this autonomous intelligence era. So without that, currently, this work of continuously adapting the model and changing the customizing inference setup is done by a very, very small set of experts. So those experts are like they have been doing AI system for a long time, they have been researchers for a long time, accumulated their knowledge over years.
36:28So only a few companies who have those strong density talent pool are able to do that. And the question is, can that part be automated? Right? And similar to others that has been disrupted and has been reshaped, and can this part of doing product model co-design and infusing more intelligence to the model and making the inference serving tier much faster and much more efficient, can that part be accessible by a wide range of application developers without them putting in a lot of work and carrying the burden of learning all the deep knowledges. So that's what that means. So we heard a lot about AI is going to free up a lot of human labor, right?
37:29So, and this wave is interesting because it will start from a different angle. So it will actually free up a human from the high intelligence level, not from the physical level, right? The robotics is going to disrupt the physical level of engagement, but AI is going to free up a lot of kind of high intelligence level of the tasks and work. So that's kind of interesting change. And we are also innovating and disrupting in that space from a baseline platform space.
38:07Jon Krohn:With AI being able to handle tasks that require expert level thinking, it is important for all of us to consider the future of work. In episode 979, Rohit Chowdhury talks to me about the transformation of job roles due to AI. Rohit, the founder and CEO of Bay Area firm AccelData, frames this as a period of transition towards a decentralized world. As speaking of things moving quickly and past paradigms no longer being relevant, while reading your blog posts and watching your presentations and interviews as we were doing research for this episode, it was apparent that your vision for AccelData transcends classic terms like IT, data platforms, infrastructure, and pipelines as passive tools.
38:50Jon Krohn:It's more about the enterprises, teams, and individuals who will be active participants in an intelligent operating environment where data, AI, human judgment converge to drive decisions and outcomes. In fact, we've got a blog post that I'll put in the show notes. It's called Convergence of Personas, How AI is Reshaping Data Management Functions. And in that, you wrote that AI is eroding clear boundaries, collapsing personas into a more fluid, dynamic model where functions blend and expertise shifts. How should organizations rethink career paths and incentives to ensure depth of expertise isn't lost, but we have that kind of flexibility anyway?
39:32I think there's a lot of value in what AI is bringing, and there's a lot of value that humans will bring to these AI systems. There's a period of transition right now. And the transition is from going from completely human-centric systems, designs that were built only for humans, to a world in which this is going to be a collaborative world where agents and humans will have to work together. It's a reality. I think people will have to wake up to that. I think OpenClaw has been a fascinating moment for all of the AI world. and I'm actually pretty excited about seeing where this world goes from here on because there's so much work that these agents are autonomously going to do and accomplish for these teams.
40:13Now, if you think of what that world means, it effectively means that if you are a person who has the capability of doing critical thinking and structured language, you can accomplish a lot. So the previous paradigm had certain restrictions that you had to be a great programmer and then on top of it, you would need the business domain and the expertise. Today, what has happened is that the level at which you can interact with these business systems, the GPUs and the agents which can do work for you depends upon the clarity of your thinking and your own curiosity. And if you are a person who has a lot of determination of being very clear in what you expect the output to be, along with the expertise that you know your industry better than the others, you're more likely and most likely to produce outcomes and systems which are way better than some of your competitors, peers will produce.
41:10In that world, I think one will have to prioritize the presence of these skills within individuals who possess both of those things, creative thinking and a lot of structure, clarity of thought. And I think, you know, that is the only way that, you know, organizations will progress further. In terms of the value of domain, like I mentioned, you know, there's this period of interim transition between human centric to agentic plus human centric world. And in that world, I think a lot of domain expertise is going to get used to train internal agents to fine tune LLMs for LLMs or SLMs to suit the purposes of your own organization.
41:49and those skills will then be required in the future.
41:53Jon Krohn:Nice. You used a term there, SLM. I'm sure all of our listeners are familiar with LLM, large language model. SLM, probably most listeners are familiar with that as well, but small language model. And this is a really exciting area where you don't necessarily need to have these big, think about Claude Opus. You don't need to have a Claude Opus size model running for every kind of task. I've had a lot of success in doing consulting for enterprises or in startups that I've been a part of, fine-tuning very small, say, open-source LLAMA models that just have a few billion parameters, they can become very, very good at a narrow task when they have a high-quality training data.
42:32Jon Krohn:You wouldn't ask them to do anything, but for that one task or this relatively narrow set of tasks that they're fine-tuned for, they can excel. 100%. I think SLMs and LLMs will be part of the enterprise stack. I think as will CPUs and GPUs and ASIC, you know, it's got to be an XPU architecture with SLMs and LLMs. And I think a lot of IP will start getting embedded in the SLMs as well, obviously, because of, you know, privacy concerns and everything else. I mean, if you were to just think and just abstract it out, I think AI is breaking the centralization model. When I think about this whole world, for the last 10, 12 years, the whole thing was about centrality of let's get all your data together into a data lake, into a warehouse, into a location, into a cloud on-premise environment, whatever's your preference.
43:23I think there isn't enough time for such large-scale migrations to take place. I think AI models will have to get closer to the data where it resides and operate on that to provide the enterprise outcome that people need. I don't think the speed of AI matches the physical realities of large scale migration and centrality. So it is going to be a decentralized world in the future. And if you just extend or extrapolate that argument, it's hard for me to see that only LLMs will win. I think LLMs plus SLMs will win.
43:57Jon Krohn:All right, that's it for today's In Case You Missed It episode. To be sure not to miss any of our exciting upcoming episodes, subscribe to this podcast if you haven't already. But most importantly, I hope you'll just keep on listening. Until next time, keep on rocking it out there. And I'm looking forward to enjoying another round of the Super Data Science Podcast with you very soon.
From the publisher
Jon Krohn rounds up March’s interviews in this ICYMI episode. Hear from AI and data science experts across the fields of education and business in this wide-ranging series of clips that take listeners from the Renaissance to the near future. Guests include Lin Quiao (Episode 971), Chris Fregly (Episode 973), Zack Kass (Episode 975), Kyunghyun Cho (Episode 977), and Rohit Choudhary (Episode 979).
Additional materials: www.superdatascience.com/982
Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information.




