In short
Big Technology Podcast Episode Summary: The Big GPT-5 Debate, Sam Altman’s AI Bubble, OnlyFans Chatbots
Episode Overview In this episode, host Alex Kantrowitz and guest Ranjan Roy from Margins engage in a thorough discussion surrounding the latest developments in AI, specifically focusing on GPT-5, its implications, and the surrounding hype within the industry. They also explore AI's potential integration into platforms like OnlyFans.
---
Key Topics Discussed
- Backlash Against GPT-5
- Disappointments with GPT-5: Kantrowitz expresses disappointment, stating that GPT-5 feels like a step back from previous iterations, especially in its capacity for "thinking."
- Critiquing the Hype: The initial excitement and promises made by Sam Altman about GPT-5 do not align with the actual output, leading to a backlash.
- Comparative Evaluation: The hosts discuss the differences between GPT-4 and GPT-5, emphasizing that GPT-5 doesn't seem to offer improvements over GPT-3.5 in practical usage.
- The State of AI and Industry Hype
- AI Bubble: Altman suggests parts of the AI industry may be in a bubble, raising concerns about the sustainability of current valuations and expectations.
- Eric Schmidt's Commentary: Schmidt advocates for a shift in focus from AGI (Artificial General Intelligence) toward practical applications of existing AI technologies, arguing this approach is crucial for the U.S. to compete globally, particularly against China.
- GPT-6 Expectations and Memory Enhancements
- Future Models: Discussion around GPT-6 and the anticipated improvements in memory and user personalization.
- Learning from Failures: The MIT study indicates a high failure rate of AI projects (95%), suggesting a need for practical implementations rather than lofty ambitions.
- AI in the Adult Industry (OnlyFans)
- Chatbots and Employment: The potential replacement of human chatters on OnlyFans with AI chatbots. The hosts discuss implications for job displacement in this sector.
- AI's Evolution in Content Creation: Companies are starting to use AI for generating content and images for OnlyFans, demonstrating practical applications of AI.
- The Philosophical Angle
- AI as a Companion: The hosts touch upon the emerging view of AI as a companion or therapist, presenting a potential shift in how AI is utilized in daily life.
- Cultural Reflections: The transformation of AI's role from a work tool to a more personal, interactive entity.
---
Key Takeaways
- Disappointment with GPT-5: The hosts agree that GPT-5 has not met expectations, with various issues around its capability and performance.
- Industry Hype: There is a growing consensus that the AI industry needs to recalibrate its focus from AGI to pragmatic, actionable AI solutions that can provide immediate value.
- Job Displacement Due to AI: The integration of AI in industries like OnlyFans highlights the broader implications of automation on jobs, particularly in low-wage sectors.
- Changing Perceptions of AI: As AI continues to evolve, its role as a companion or helper might overshadow its traditional use cases, indicating a cultural shift in human-AI interactions.
---
Conclusion This episode of the Big Technology Podcast brings to light critical discussions surrounding the present and future trajectory of AI technologies, highlighting both the hype and the reality of AI's capabilities. The conversation reflects a significant moment in tech discourse, urging a more practical approach to the deployment of AI in various sectors.
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Transcript
Automatic transcript. May contain errors.0:00Is the GPT5 backlash overdone? or a sign of the AI industry finally realizing that the party is over. Sam Altman, for one, says AI might be in a bubble, but that's probably not going to stop OnlyFans talent from outsourcing at least some of their flirting to artificial intelligence. That's coming up right after this. Welcome to Big Technology Podcast Friday Edition, where we break down the news in our traditional cool-headed and nuanced format. We have a great show for you today. Today we're going to revisit the debate about GPT-5 and whether it's actually as bad as critics say, meaning the end of AI progress, or whether it's misunderstood.
0:38We're also going to talk about these comments from Sam Altman that AI might be in a bubble, and also some from Eric Schmidt that the AI industry and the tech industry should stop focusing on AGI and focus on building. And then finally we'll round it out with a conversation about how AI might be coming basically to the back end of OnlyFans conversations if it's not there already and what that means for our lives, for our society. Joining us as always on Friday is Ranjan Roy of Margins. Ranjan, great to see you. How are you doing? Good. We took a week off and apparently all AI progress stopped. This was terrible timing for my summer break.
1:13I was out in Nepal doing some trekking. And by the way, I have to say we got one of my favorite podcast ratings that we've ever gotten. it's may the mountains treat you right their username is hedgefunk i'm a sherpa from nepal currently living in new york and i'm thrilled to hear you're heading there to trek and saying that they regularly listen to the podcast the moment it drops on itunes so thank you hedgefunk it was a great trip i was out in the mountains i was thinking about life i was thinking about agi and i was thinking about why gpt5 isn't anywhere close to it and ronjan i'm just going to use this moment too after we were probably the most optimistic podcast about GPT-5 two weeks ago to talk about how my reflection has led me to come to this point where I believe it is as disappointing as the critics point out and maybe even more if that's okay.
2:02I think that's okay. I'm already going to preface I'll take the other side even I did not have a contemplative climbing of Mount Everest or what other Nepali mountain you were on but I have a feeling I'm going to be arguing with you on this one. So not Everest this time. I wonder what the oxygen deprivation would do for my takes on this podcast, but Antipurna Basecamp was where we went. Okay. So I do think that this model is, you know, feels like at least a step back for me from 03. And this is kind of my core complaint here. And it goes towards your core belief that this is a good model. And that is that I want my AI models to think.
2:45And the one thing that was nice about O3, the model that OpenAI has deprecated and not brought back, unlike 4.0, is that this thing would think a lot. And Brett Lightcap, who was on the show, the COO of OpenAI, who was on the show as the company released GPT-5, he said, we know that if models think a lot, they're going to be more intelligent. And GPT-5 doesn't give you the option. Now there's this thinking option and there's non-thinking or fast version of it, but it seems to think a lot less than O3 did. And it doesn't give you the option to like really go hardcore on the thinking. So this idea of like it, you know, deciding when to use which tool or which model and that being the intelligence, that really, to me, after seeing O3 go away and use this like really underwhelming thinking model, I just think that we're dealing with much less capable AI when we're talking about GPT-5.
3:46And that to me is distressing. So my reaction, especially watching all the complaining and the underwhelming reactions to it, and I would put this as separate from the kind of terrifying reactions where people miss the sycophancy of GPT, of the previous iterations and were able to where it always told you that you're right and you're great. I think on this tool calling or which direction should I go? It was really interesting to me because we recorded separately from the Brad Lightcap conversation and Brad and myself kind of ended up having the exact same reasoning as to why this was a different type of intelligence.
4:30It's the idea that knowing which tool to call, knowing which direction to go actually is different than traditional reasoning models as they existed before. And I still strongly believe that is where things need to go. The idea, and we've debated this for years now, is it going to be one model to rule them all or will there be lots of specialized models? And actually, from a starting point, not even the model, the actual platform or the system or the product, knowing where to go to solve a specific problem is where this has to go. Now, GPT-5, I think there is definitely some uncertainty over how it was rolled out and what it looked like and how people are used to using ChatGPT.
5:19but I actually think this is still where it's going and I'm actually happy because it felt like removing a little bit of the overall kind of hype cycle and actually letting people take a breath to me is actually the single best thing I've been hoping for for a long time. So I'm still pro GPT-5 release. Okay, well, I'm going to spend a good chunk of the beginning of this episode trying to get you to change your stance because I have so many issues with this. And by the way, the first thing that you just said, you said that, okay, it is letting us take a breath as opposed to overhyping. I mean, in what universe?
5:57Sam Altman was, again, hyping this up, saying GPT-5 is much better than anything he's used before. It's better than most humans at almost every task on Theo Vaughn. Basically saying it was everything that we imagine AGI will be without saying the words. and then it came out and it was clearly not AGI. So, you know, let's just go right, let's go that right there right now. And then we're going to go back to this switcher thing. Is this really a break from the hype or was it just that, like is the break actually that the model just doesn't live up to it? No, I think the break from the hype is it did not live up to the hype.
6:39And I think that's good. So I agree what Sam Altman was promising on Theo Vaughn and wherever else. this definitely is not that. But why I'm saying I think that's a good thing is it's going for a moment like GBT5 has been so built up for so long. Now everyone realizes we're not going to get some magical model release that just solves everything all at once. And then AGI comes and robots take over and all white collar jobs are eliminated or whatever else. I'm saying the fact that it did not live up to the overdone hype, that's a good thing. Because now, and we'll get into the Eric Schmidt piece, we'll get into this MIT, 95 % of projects don't show ROI study.
7:26I think now everyone can get back to the real issue is how can we actually build to solve problems? And so I'm going to actually get to that issue in a moment, but I still want to talk about the disappointing nature of the model. And then I'm going to get to the things that I don't like about this agent idea, even though I was bought into it maybe a couple weeks ago when we talked about it. So look, I mean, we've talked on the show for a long time, right? It took them like, what, two years, took OpenAI two years to go from GPT-4 to GPT-5. And we said for a long time, just name the next model GPT-5 and don't put all this pressure on yourself to release a God model.
8:05And so finally, okay, so I think there is something to be said for like, all right, They got the number out there, right? So we'll get GPT-6 probably next year. We don't have to keep playing up what the next model is going to look like and anticipating that it's going to be a big one. I think Thomas Wolfe from Hugging Face in this FT article about whether AI is hitting a wall put it really well. He says, for GPT-5, people expected to discover something totally new. And here, we didn't really have that, right? So basically, here's the thing. They spent two years working on this new model. They built it up to be, you know, God level.
8:43It wasn't a new thing. I don't even know if it's better. I don't think it is better than 03. I'll just say one last thing and then turn it right back to you. Ethan Mollick, the Wharton professor who we quote here often, had a very, very good post about this right after the release that I think got left mostly overlooked. He said, the issue with GPT-5 in a nutshell is that unless you pay for a model switching and know to use GPT-5 thinking or pro, when you ask GPT-5, you sometimes get the best available AI and sometimes get one of the worst AIs available. And it might even switch within a single conversation.
9:21So he's basically saying like at the high end, you might get this GPT-5 high, which I mentioned thinks a lot, or you might get this GPT-5 minimal. and you don't really know which one you're getting. So like you're not, if you're a regular user of this technology, you might actually feel a downgrade happening when your queries get pushed off to this minimal thing versus like you knew you might have to wait a minute or two, but you're probably getting really good stuff from 03. And I think the fact that this doesn't feel like an upgrade from 03 is a very, very big problem. Okay, so on this idea of like where is the intelligence?
10:02Where's the value? I want to dig into that a little bit because to me and like for listeners two weeks ago, I was talking about how I work for a startup called Writer now, and we had launched something called Action Agent, which is very similar in scope that it's, there's a number of predefined tools just from a prompt knowing where to go and what to do with it. To me, the more I've used tools like this, the more I see that's where things need to go. And the way to think about it is, and agreed, this is a new type of intelligence, even within the ChatGPT ecosystem. So it's going to be rough at first, but it's where the world is going.
10:39Like, if you think about, you know, what did Apple promise us? Like, with a prompt, even just looking up your flight info and then going and doing like a flight status check. That, the reason they've not been able to roll that out yet, it seems simple. But the intelligence there is knowing which system to call, what to do, what tool to call next, what action to take next. That type of intelligence is where all the promise of AI is. And no one has done yet at scale. And this is the first, this is like the beginning of this new way of intelligence versus within the model itself, it's going to do a bunch of thinking, it's going to go into its own, like training data, it might do a little bit of web search and then give you a result.
11:26So this is just the beginning of this whole next phase. And so of course, it makes sense that I guess I'm going to give Sam Altman a little credit here. The fact that they actually still roll this out, knowing it's not going to be mind blowing, but it's setting the stage for where AI intelligence needs to go. And then maybe one day Siri will actually work and be able to check your flight status just by asking it. Give me a moment here to sort of try to make the case for why we don't need AI agents. So I'm going to try to blow a hole through this entire concept. This is the hottest take of all time in this.
12:06You defend and I will be on offense. I have been using GPT-5, as many people have, but my specific use case over the past two weeks has been very intensive. I've been using it all throughout this trip that I've been planning. including trying to figure out like the amount of altitude I should be increasing day by day as I went up the mountain in Nepal. And of course, like, you know, didn't spend my entire time going up this mountain hook to technology, but you want to make sure that you're not going to die on the next stop. So when you're at one of these tea houses, you can connect to wifi and say, all right how far should i go the next day and i i felt like the ai was transforming from and excuse me for using this term uh but from a thought partner to an over eager helper and not a particularly useful one either and we had talked about this idea that like gpt5 just does stuff which was the title of the ethan malik piece after he had been using it and gpt5 is just trying to do things for you.
13:19And I think that like we can see AI go in two directions from here, or maybe it does it both simultaneously. But to discard the thought partner type of use case for this over eager helper, you know, agentic use case to me really seems misguided. Like I think, you know, some of the best ways to use AI is to help you round out concepts in your head, or like to say, I'm thinking these things, what do you think about them? And then have it come back with like a pretty interesting and considered answer that you know might hallucinate sometimes, but ultimately helps you sort of expand your mental capacity because you're just able to think about these concepts with higher horsepower.
14:03And I think what GPT-5 has done is it sort of deprioritized that use case for like trying to go do stuff for you. And like there are times where I really craved having a deeper conversation about the climb or whatever it might be. And instead, what I got back was just like this bot coming back over and over and over again of like, let me make a card for you that shows your turn back times and stuff like that. I'm like, I don't need that. What I need is something to be able to really explore these concepts and thoughts. And I felt that that has been deprecated in this new model. Now, maybe that's a selfish criticism, but I'm going to just throw it out there.
14:48And I don't understand why this agentic thing, which may work really well in like the when is my flight and we want it. When's my flight coming? For that to be the direction and the route and the rule for AI moving forward, I just question whether that's the right move. Well, no. So I don't disagree with you here. I think these are two different. Actually, I think that's a good breakdown. When do I want a thought partner? When do I need to do things? And they are very different use cases. And I think OpenAI's mistake here is they're trying to jam it all into one product. And again, that intelligence of which way, how should I interpret this?
15:30And I agree, I had a bunch of those where it would let me make you a presentation when I just wanted a quick answer. I think that it should be two separate products. I want to do stuff. I want to think and have a thought partner. They're very different systems that are required for those. Or they need to nail the intelligence of which way to route it at the beginning. And I think, to me, the biggest issue here is GPT-5 is essentially like some whole new GPT-1 in this way of intelligence. So like in this mode of intelligence we're talking about around taking actions, calling tools, doing stuff versus I'm going to call my training data and maybe do a little bit of web search and I'll give you a nice text answer or an image or something like that.
16:22Like in reality, but I'll also push back that like when web search was introduced to all of these tools, that is agentic. It decides to go search the web because it doesn't have the training, anything in its training data to answer the question. And we all have become so used to that, even as you're trying not to die and asking and having ChatGP, depending on ChatGPT to keep you alive, to understand your oxygen, your VMO2 max or whatever it is. I'm not a hiker by any standard. I think like we've already, the agentic has already been happening quietly. Web search was the big one. Web scraping an operator like computer takeover hasn't really worked well yet.
17:07But web search was always agentic. And it was this exact flow that we're talking about. So we're all using it. It's just that this isn't amazing yet. This is the V1 of this new way of working. And they rushed it out, didn't explain it clearly, and conflated these two very different ways of working and thinking into the same tool. Right. And so my concern is that they are going, because these companies have a need, and this has always been the concern with raising the amount of money that they have raised, they have a need to replace and augment labor, right? And so that's where you get into these agentic use cases.
17:51My concern is maybe that's not the most useful way that we can use AI. and we might end up in service of returning the money to investors lose some of this like really useful capability that we've seen so far and let me push back on the web search part of it is it agentic yes but what is it agentic in in service of I think well maybe in some ways it is like you know I would find me the opening hours of this like you know of like restaurants in New York City, these are my criteria. So like in some ways there's that egenic stuff. But it's also like these are ultimately, they are filters of knowledge.
18:34And the cool thing about it is they have not, maybe not all, but almost all of the knowledge that's ever been written within them. And web search, it might be egenic, but it's also just like a way to update their mental models and update this filter with the most current information or stuff that's not in their training data. So yes, that's egentic, but it's also in service of, I think, this use case that I've found very valuable. Now, as I'm saying this, I'm like, maybe I am shortchanging the do stuff part of it a little bit, but I am mourning a little bit the direction of, I'm mourning a little bit the loss of the old direction and I find it especially interesting that OpenAI added back the 4.0 model which you talked about which was like very friendly and maybe a little sycophantic but not 0.3 because it thought too much or maybe not 0.3 which was the reasoning, the thinking model has now been replaced by GPT-5 thinking and I wonder if they didn't add it back because it's just too expensive to run and they can just run this version cheaper, which again gets to this big question we've been talking about of like, was this old direction just financially impossible for the industry to make work?
19:58Yeah, hold on. I think two separate issues there. I'll get into the financials of OpenAI and how much of this is done to actually meet some kind of valuation criteria, which it certainly has to be. But I think that first part, I think if we're going to break it down, it's thinking versus doing. And using it for thinking is it has been very good. And they're kind of screwing that up. Actually, from like a user interface standpoint, I mean, they really are screwing this up because like everything keeps saying thinking. Like the fact that it's maybe they should just change that word to doing and it'll start to at least be a little more realistic about what's happening.
20:38So to me, I think even more as we're talking, these are two very separate things people need to do. The doing side of it, it is going to be that's how we get to the next, like that's the way we actually realize some genuine value from all of this. And so, I mean, whether it's like the labor conversation or it's just asking Siri to find your flight info and do something with it, like contact Delta and change my flight time or look up alternative flights, whatever it is, you know, like there's really, really simple things that should be better. And I think that's the way things, like it has to go there.
21:20Otherwise the entire industry implodes, but also I think it can work. This is just the first iteration of that, but they hyped it up too much. I think on the like open AI financial side, I'll give Ed Zitron had written a good piece on like who I generally disagree with on like how this is financially driven a bit because it's going to go try to go take a cheaper route. But it should, in the end, like, 03 should not be running when you're trying to, like, rewrite this email for me. You know, like, different cases should require different models, different tools. And getting that intelligence in place, if anything is ever going to be financially viable, it has to work that way anyways.
22:08So, like, yes, is it financially driven? Sure. But it needs to be. I won't hold that against them. Do I think that this downplay of hype or this backlash could hurt them significantly? Sure. But I'll still give them the directionally, strategically correct decision. okay and i will i will say strategically incorrect decision and i think this might be a new debate that we have on the show but um there's also there has been this argument we should we should talk about this that this has been so bad that all of a sudden uh everyone's running out and saying yeah let's stop talking about agi anymore or uh you know where we are we might be in a bubble and And that is what Sam Altman did say in his dinner that he had with some reporters.
23:02He says, this is from CNBC, quoting The Verge, he said, Altman said, when bubbles happen, smart people get overexcited about a kernel of truth. Are we in a phase where investors as a whole are overexcited about AI? My opinion is yes. Is AI the most important thing to happen in a very long time? My opinion is also yes. And this is from the CNBC story. his comments add to growing concern among experts and analysts that investment in AI is moving too fast what do you make of this I mean it's kind of interesting to get reporters together in a dinner after the release of the somewhat bungled release of your most important model ever and and say that we're in a bubble now maybe the headlines made a little bit too much of it but this idea that like there's a kernel of truth even though he does say that AI is going to be the most important thing that we're seeing right now but a kernel of truth has led to you know some sort of bubble I don't know the implication is somewhat concerning what do you think about it he Sam Altman knows how to get a headline better than anybody else like Like, I don't know.
24:19I mean, will I agree with are we in a phase where investors as a whole are overexcited? Is AI the most important thing to happen in a long time? Also, yes. Like, I'll agree with that. I feel this, I don't know, this one feels like him just kind of saying stuff, knowing how to kind of get a rise out of reporters, get the headline versus there's any genuine thought put into this statement. well i think that if you take you know maybe we'll just take it as a data point right i don't think sam got reporters together to try to like let everybody know that ai is a bubble i mean he's currently i think just just raised a huge amount of money and he's probably right trying to raise again um and by the way we have another headline that anthropic is also raising they're raising uh Intox story is now$10 billion.
25:12And the last report was a$5 billion raise at$170 billion valuation. So the valuations keep going up. But now we're starting to see talk of maybe this is a bubble from Sam Altman. I think Mustafa Suleiman had a story this week saying, hey, let's not call AI conscious. And I really want to sit on this New York Times op-ed from Eric Schmidt and selena shu about why the u.s needs to stop talking about agi and um and why this is going to set the country back because it is somewhat remarkable that schmidt has gone from someone who like gave a ted talk who said we're like you know we're under appreciating how important ai is to this like now pouring cold water on agi he says this is his and jews um op-ed he says reaching artificial intelligence or AGI is now a singular aim of America's tech giants, which are investing tens of billions of dollars in a fevered race.
26:08It's uncertain how soon artificial and general intelligence can be achieved. We worry that Silicon Valley has grown so enamored with accomplishing this goal that's alienating the general public and bypassing crucial opportunities to use technology, to use the technology that already exists. It's being solely fixated on this objective. In being solely fixated on this objective, our nation risks falling behind China, which is far less concerned with creating AI powerful enough to surpass humans, and much more focused on using the technology we have now. We're going to get into this argument of like, should we just use the tech we have now or focus on building AGI?
26:48But just a very interesting data point that Schmidt and Zhu add in their story. They say in a recent survey of the Association for the Advancements of Artificial Intelligence, by the way, who's that? They call it an academic society that includes some of the most respected researchers in the field. But this is interesting. More than three quarters of the 475 respondents said our current approaches were unlikely to lead to a breakthrough. While AI has continued to improve as the models get larger and ingest more data. There's concern that the exponential growth curve might falter. I mean, it's just interesting to see Schmidt saying this in the pages of the Times and Thomas Wolfe from Hucking Face saying this to the FT and Sam Altman saying there's a bubble and Mustafa Suleiman saying, you know what, let's stop calling these things conscious.
27:38Everybody together is coming together and talking about this AI, you know, hitting a wall or reaching a curve, reaching the diminishing returns point of the curve. as opposed to the exponential. And so I'm curious, Ranjan, what you think about the context of where AI is heading overall, given that this is what we're hearing. Material security is transforming how companies protect their most critical cloud assets, like Google Workspace and Microsoft 365, with modern purpose-built security that actually works the way people do. The biggest cloud threats walk through three doors, email, identity, and data.
28:14Material was built from the ground up from day one for Google Workspace and Microsoft 365, not as a retrofit, so it closes all three. It provides continuous protection before, during, and after an attack. You detect problems early, contain them fast, and recover without chaos. Lean security teams scale through intelligent automation rather than adding headcount. Material blocks evasive phishing and impersonation. It protects sensitive content using built-in rules for personal health and financial information, or rules you define. It also spots risky applications, unsafe settings, and sketchy verification or password reset attempts, all without slowing people down.
28:57So get the overview at material.security. That's material.security. Did you know your credit card points and miles can lose value to inflation? Credit card companies often reduce the redemption value of your points and miles. Now, imagine a credit card with rewards that can grow in value. With the Gemini credit card, you can earn Bitcoin or one of over 50 other cryptos instantly with no annual fee. Every swipe at the store or gas pump earns you instant rewards deposited straight to your account. Plus, sign up now for a$200 Bitcoin bonus to kickstart your rewards. Visit Gemini.com slash card today.
29:35Check out the link in the description for more information on rates. Again, if you're looking to invest in Bitcoin but don't know where to start, the Gemini credit card makes it easy. The Gemini credit card is issued by WebBank. In order to qualify for the$200 crypto intro bonus, you must spend$3 ,000 in your first 90 days. Some exclusions apply to instant rewards in which rewards are deposited when the transaction posts. This content is not investment advice and trading crypto involves risk. The Gemini credit card may not be used to make gambling-related purchases. I mean, I could not be happier.
30:11Listeners can't see how much I'm smiling right now that Eric Schmidt's on team product, team build. It's not the model. Everyone is coming around right now saying, let's take the technology we have now and actually try to figure out how to build with it. I think, again, his whole point that in China, people are focused on actually integrating AI into hospitals and farming and other areas of life and medical diagnostics. That's what we need to be doing. That's what we have been saying for a long time. And the kind of over-focus on this one model to solve all of our problems. If it kind of feels like that's going away, and I don't know, that I'm excited by this.
Read the full transcript
30:55We can actually focus for a moment. So I read this story and I just had Ranjan in my head because this is almost making the Ranjan case. Are you saying I didn't before and now only Eric Schmidt can make my case? I'm saying I think Schmidt did a better job making the product case. I did not get my times op-ed, but maybe soon if you're listening. but but i do think that he's taking this ideological torch from you ranjan and running with it so um i mean he listens yeah obviously so he does he does well we might get him on the show might anyway so he listened but listen to this let me just read it because he's talking about it in juxtaposition with china and i think i haven't heard it made i haven't heard the case uh made made this way yet so he says let's look at what's happening in china the countries and scientists and policymakers aren't as agi-pilled as their american counterparts are talking about a deep integration of AI with the real economy.
31:57While some Silicon Valley technologists issue doomsday warnings about the grave threat of AI, Chinese companies are busy integrating it into everything from the super app WeChat to hospitals, electric cars, and even home appliances. In rural villages, competitions among Chinese farmers have been held to improve AI tools for harvest. Alibaba's Quark app recently became China's most downloaded AI assistant, in part because of its medical diagnostic capabilities. Last year's China started the AI Plus initiative, which aims to embed AI across sectors to raise productivity. This is interesting. It's basically very, you know, and there's another stat here saying how, like, the vast majority of folks in China have said that AI has had a positive impact on their lives.
32:48whereas in the United States, the vast majority have not. A recent poll said 32 % of Americans say they trust AI compared to 72 % in China. Over three-quarters of adults in China said that AI has profoundly changed their daily lives over the past three to five years. That share is the highest globally and double that of Americans. i don't know um maybe maybe it's team eric and ron john uh that have come together to sort of maybe make me believe in the product uh side of things over here but um i mean it is interesting because it's like maybe we the ai industry has reached this point where you know if agi was realistic then that would be a good strategy but if it's not you have to sort of like get going full speed as opposed to focusing on developing it.
33:40And I think that's the core message here. Yep. And I would actually add one part to that. He brings up a really interesting point because we've talked for a long time around AI has a branding problem. And like, instead of focusing on what it's actually doing, meanwhile, like everyone has, or a large percentage of the population in the US uses AI in their day-to-day life probably is deriving significant value, probably writing all their emails using ChatGPT. Like people are even, I mean, when we talk about AI, like having it alter your photo to look better, all that stuff is AI. So people are using it, but instead, I mean, the way like just the term itself, you have kind of two groups of marketing you have like when doge was going through everyone was like they're using ai to cut jobs and make decisions or just like that very negative connotation or the conversation around job displacement but then on the other hand you just have really bad marketing like remember the google gemini commercials matthew mcconaughey like it just like the industry as a whole has not communicated to people this is how your life has already changed because of ai and people aren't even processing it or realizing it.
35:00So I think that was a really telling stat. If 75 % of adults in China are saying it has a positive effect, whereas in the U.S. it's only 32%, I think that's more around how the figureheads, the industry, the marketing has just been bad. Right, and I think you're only getting this op-ed if Schmidt, who's close to this, who's what I think he was the first investor in Anthropic, he's been watching ai since he ran google uh if he didn't believe if he came to the conclusion that we're nothing close we're not close to agi then it is time to to make this pivot so i think that's important context uh and i think that's a good point if you take that along with what altman mustafa suleyman thomas wolf is saying you're like oh shoot like this this might be that wall now again i'm not again we we talked earlier like were there going to be overreactions to gpt5 yes or is the fact that like you know is that ai is done uh you know reaction to gpt5 an overreaction yes of course it is this is still very powerful technology even if it stops here only improves incrementally um but it is interesting that they're all saying it now and i think that that you're you're totally right ronjan that like there's a there's a branding problem um and i think there's a building problem right this gets again back to your argument i love it which uh I'm coming towards it because here's I think it's been under-emphasized I'll put it that way and there's a lot of truth to the position you've taken here's here's again from this op-ed it's paramount that most people outside Silicon Valley feel a beneficial impact of AI on their lives AGI isn't a finish line it's a process that involves humble gradual uneven diffusion of generations of less powerful AI across society instead of only asking are we there yet.
36:54It's time we recognize AI is already a powerful agent of change. Applying and adapting the machine intelligence that's currently available will start a flywheel of more public enthusiasm for AI. And as the frontier advances, so should our uses of the technology. But being too fixated on artificial general intelligence risks distracting us from AI's everyday impact we need to pursue both god damn it he just he wrote it a lot better than i've said it i i know but i think that the conversation here has been building and and you know what i think it's a good point and i've been on team model for a long time i've been on go build those better models and everything will take care of itself reading it in this way does lead me to believe that yeah I think this focus on GPT-5 and focus on the next model has sort of put the U.S.
37:52at a disadvantage where it hasn't been building it into everything because it's just expecting a God model to come in and fix everything. And that doesn't seem to be happening. Yeah, I think the more we're talking today, I think this is a huge inflection point. Like GPT-5 was such a big idea that hovered over the entire industry for so long. And now it's out there and it's underwhelmed everybody. And now everyone's kind of recognized this. Because I definitely, there's a study that came out from MIT this week where it said 95 % of AI projects within companies have not seen any kind of value. And I actually, I think this is near and dear to my heart now working in the enterprise AI space in all these kind of conversations.
38:40But really what I believe has been happening is over the last few years, that expectations misalignment has been a huge problem, that people are hearing everything can do these gigantic, massive things and don't even start small and just start learning how to use it and integrate into their companies and just getting AI fluent. But I think also this ties back to the Schmidt op-ed, the GPT-5 backlash. Do you think this is a moment where everyone's going to take a breath realizing the last two to three years, call it two years of actual implementing AI, we've had the wrong approach and actually become a little more sensible and start – It's well, maybe we'll get another.
39:31It's time to build a op-ed at the right time. I don't think so. This is why I don't think so. Because of the funding. Now think about the amount of money that's gone into this, right? Like the industry needs AGI. They need this AI that can build these like super powerful tasks to be able to justify the valuations that they've gotten. And you're thinking about like the biggest VC rounds ever. These models need to improve more than they are because they still get things wrong. They're still unpredictable. is part of the reason why the 95 % of projects within enterprise have failed is it part of it because of misaligned expectations yes is part of it because the technology isn't good enough yes I think so it's still it's it can't we had a reader write in so it says it's still it's too unpredictable to be useful in many corporate settings and and I guess like you could say yeah well you've been using it for sales and marketing and it's just not good for that but even in back office cases like if the if these things start like i don't know doing doing jobs uh 95 right but getting 5 wrong you're going to end up with like a very bad situation for um for the companies that have implemented it because there's gonna be errors well i i would push back that in our current human-led infrastructure, 95 % accuracy in a lot of spaces is not actually great.
41:01But I think one thing, like, actually, so I was reading, and it was the study, actually, it was by the amazingly named Nanda group at MIT. One of the other things it found, though, is it said the biggest problem the report found was not that the AI models weren't capable enough, although execs tended to think that was a problem. Instead, the researchers discovered a learning gap. People in organizations simply did not understand how to use the AI tools properly or how to design workflows that could capture the benefits of AI. So to me, this learning moment, people having misaligned expectations and approaching things the wrong way to me that has to change and now it feels like maybe in the last two weeks we're hitting an inflection point where it will but here's the thing who's which ai company is going to go to these enterprises and say so about that agi thing we've been telling you about you know what forget about that for now let's go with these much less ambitious projects even though we've been telling you that like god ai is is coming around the corner i think the advantage of china that china has uh aside from like some central planning that maybe forces companies to do this um is that the models there are are open source yes they cost money to run but there's typically uh cheap to run and so you're looking at just like basically paying the inference costs uh and that allows you to like put ai in your refrigerator or your briefcase or whatever it is, as opposed to here where like the companies are selling ambitious projects.
42:42I agree. The way the funding has been structured at the giant players is definitely kind of rubber meets the road moments going to happen where they're going to have to decide. And even what you said right there, like in your refrigerator, you know, like the promise of using computer vision to see what kind of food's in there and when it's going to spoil. Like this stuff should be happening. The technology is there. The models are there. And it hasn't yet. And it's like felt like we've just been all waiting. So again, I agree there's going to be some genuine issues from like how the funding structures of a lot of these companies.
43:29But again, it has to happen at some point. Like you can't just keep promising it unless you believe the technology. You're still team God model and GPT-6 will actually move us in that direction. So we can all just kind of wait for our refrigerators to know what food's going to spoil and not actually just build it. Well, after GPT-5. Yeah, I mean, I'm not going to say that. I predict that opening I was going to call GPT-5 AGI and clearly like that was wrong. So I'm not going to say GPT-6 is going to be it. Although OpenAI is talking about GPT-6 having a lot more memory, which I think is a really good way to take this technology to really get to know people and to remember things about their lives.
44:07That's good. But this MIT study is fairly brutal. This is from Tom's Hardware. The report said only 5 % of AI pilot programs achieve rapid revenue acceleration. The vast majority stall and deliver little to no measurable impact on profit and loss. The findings are based on 150 interviews, a survey of 350 employees, and analysis of 300 public deployments of AI. And these 95 % do not hit their target performance. But yeah, because generic AI tools like ChatGPT do not adapt to the workflows that have already been established in the corporate environment. Yeah, this is going to be an issue. No, I think for me, this one hit home hard again.
44:56Like this is my day-to-day life now, learning and talking about and working on enterprise AI. I mean, it's real. It's definitely real. The way a lot of people approach these AI pilot programs, again, was assuming everything will just work perfectly. I don't have to like fix my existing broken workflows. And I'm just going to layer ChatGPT on top of it. And everything is just going to work perfectly and it's going to take no effort. But I think that this has been another big area as people approach it as typical software deployment, where it's a very, very different thing. That's something I'm probably going to write about soon, but it's just so real that I think the way the entire industry, most organizations have been thinking and approaching it over the last two years, we are really hitting an inflection point now.
45:52and gpt5 might be that canary in the coal mine but i think uh it has to change if we're gonna let our refrigerators know when our food's gonna spoil and you're not gonna die climbing on uh the nepalese mountains well i'm still alive with the help of um mostly folks at tea houses uh and i didn't follow chad gpt's advice i went a little bit higher than i should have and things were fine a little ibuprofen goes a long way um from your altitude sickness headache but but um yeah i just to go back again to this why the product matters why the model matters yes it would be good if like um you know this sort of rhetoric around agi started going away um and and you know companies started putting this stuff into place however like one way you can solve a lot of these problems again will be better models but the question is is this technology fundamentally unable to do it i i don't know um okay but but before we end i we definitely should talk about one place that ai is making its way uh into the workflow or apparently uh might be according to this new report from rest of world and that is only fans um this is from rest of world a hidden network handles chats for only fan stars ai could soon take over that's from the story artificial chatbots are starting to take over from low-wage workers known as chatters who impersonate only fan stars in direct messaging with fans the adult website's creators rely on these remote operators to flirt with fans earn tips and sell images and videos chatters in the philippines a hub for this work told rest of world that rising sales quotas have made their work more stressful One said his company plans to replace the worst performers with AI.
47:42The chatters believe that once AI fully masters sales, their jobs could be automated. But for now, the bots cannot impersonate human quirks fully, they said. These people are using keyboard smashes and intentional misspells and Gen Z slings. Gen Z sling and AI can't do that yet. Well, Roger, maybe this is it. This is if you got to start with product, maybe it is the OnlyFans chat. By the way, wasn't it always obvious that the people on OnlyFans were definitely not speaking to the models themselves? Isn't this always like on the internet, no one knows you're a dog situation? But now it may be going to AI.
48:23So maybe there's hope for the product side. I don't know. What do you think? This is, it's the product. It's an attainable use case leveraging the technology as it stands today to deliver value in a concrete fashion. It's there. It's real. Apparently what happens is when chats come in, these groups of people often in the Philippines are directed by bosses on Discord to go out and chat and they monitor their activity. and you know one of them the story has one of them freezing because there was this like emotional message and the supervisor got mad and they know that ai will you know won't have that that issue um i mean i don't know if the technology is good enough yet uh to replace these human chatters but But I hate saying this one, if you are an OnlyFans, like Chatter, the fake chat person, it's a job that's going to get displaced by AI.
49:32Out of all of them, I disagreed with Dari Amadeus, 50 % of white collar workers or whatever it was, but I'm going to have to go with this one, probably. Now, what if it's more than the chatters? What if it's the OnlyFans models themselves? It's going to be. Because here, this is another part of the story. Automation in OnlyFans is now moving beyond chat. Using AI, management companies that represent models can generate photos of them in poses requested by subscribers without any human involvement whatsoever. AI images generated by one of these companies using a stable diffusion reviewed by Rest of world were so realistic they could not be distinguished from photographs.
50:14It's funny because the whole kind of like narrative or meme around like that was written by AI, that's an image generated by AI, and it's obvious to all of us. I'm convinced like a lot of content out there is already quietly generated by AI. Like you had those kind of big splashy PR driven efforts, but in reality, behind the scenes like because those are the companies that don't want to advertise it because like the sheans of the world or whoever else like if you look at their product pages does not look uh too natural so yeah i think it's already there let me put it this way we talked at the beginning of this episode that there's like two main uses for artificial intelligence one is this thought partner thing one is this agent thing kind of left out the other one which is this sort of therapist slash companion.
51:10I thought you were going to say thinking versus doing, and I didn't want to go there. Oh, God. Yeah. Yes. Because that's where we started. Let's move on from this idea. Let's go with the talk about, yeah, there's thinking, doing, and then there's friend or companion. And it's sort of interesting that, like, with the Asian stuff, you move away from that. And we also, like, there's this HBR article that we've talked about that's circulating out there that says, like, the number one use case for ai is um companionship and therapy and you know i don't know do you don't really need agi for that no so just need better memory and by the way that's what they're building towards with gpt6 memory this is where this is it's all just gonna head this way your agent dream is is gonna die man it's just i know i know my dream of actually your agent dream my thought partner dream both going away it's just going to be ai yeah let's let's just get ready for it it's where it's going are you excited for this future and somehow open ai will actually realize its valuation with just companionship i mean maybe that's not an unreasonable thing like getting people like the elasticity of demand and just jacking up the price i think uh if its companionship is probably a lot more valuable than what's my uh oxygen maximum on a while hiking the Nepalese mountains I I think you're right I think that's where it's going and then we'll merge we'll merge with the AI and I have a companion slash AI lover at all times in our head um and And all war will end, and peace will come in our time, and people will be kind to each other, and that will be true super intelligence is the understanding that we're all one as a species and as anything carbon-based.
53:08The real AGI was love the whole time. The whole time. Exactly. I think it's time to go to it. I'm glad we found a kumbaya moment here at the end. all right man thank you so much for coming on great great speaking with you as always all right see you next week all right everybody speaking of merging with ai we have two brain computer interfaces coming up the next brain computer interface episodes coming up the next two wednesdays uh next wednesday we'll speak with journalist sally adee about the state of the brain computer interface and the following week we have the leadership of precision neuroscience coming on to talk about their BCI.
53:50Ranjan and I, of course, will be breaking down the news each Friday. So stay tuned as we cover next week's headlines next Friday. And thank you all for listening. We'll see you next time on Big Technology Podcast.
From the publisher
Ranjan Roy from Margins is back for our weekly discussion of the latest tech news. We cover: 1) Did AI take a step back with GPT-5? 2) Is AI hype going to cool off? 3) GPT-5's switching problem 4) Do we need AI agents? 5) Thinking Vs. Doing AI 6) Sam Altman says parts of AI are a bubble 7) Eric Schmidt says the U.S. should stop overindexing on AGI and instead build it into products 8) GPT-6 is going to have much better memory 9) MIT study says 95% of AI projects fail to achieve their goals 10) AI may replace OnlyFans outsourced 'chatters' 11) Is love AI's real use case?
---
Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice.
Want a discount for Big Technology on Substack + Discord? Here’s 25% off for the first year: https://www.bigtechnology.com/subscribe?coupon=0843016b
Questions? Feedback? Write to: bigtechnologypodcast@gmail.com


