Monologue: OpenAI's Albatross

0:00This is an iHeart Podcast.

0:30They're kid-proof, pet-friendly, and built for everyday life. Plus, changeable fabric covers let you refresh your sofa whenever you want. Need flexibility? Our modular design lets you rearrange your sofa anytime to fit your space, whether it's a growing family room or a cozy apartment. Plus, they're earth-friendly and trusted by over 200 ,000 happy customers. It's time to upgrade to a stress-free, mess-proof sofa. Visit washablesofas.com today and save. That's washablesofas.com Offers are subject to change and certain restrictions may apply Call Zone Media Give me that turtleneck shirt, a tin pan apple, a German shepherd a wristband stand and a lurching red bird and more braves than the Turner Network This is your weekly Better Offline monologue and I'm your host, Ed Zitron

1:23Better Offline Now before we go any further I need your help. I, look, Better Offline is up for a webbie and I really need you to vote for best episode in the business category. It's the man who killed Google search. It's Prabagar Raghavan. Let's get him. I realize it's a huge pain in the ass to sign up for something and vote, but I've never won an award in my life and I'd really appreciate it. Link is going to be in the episode notes. And while you're there, also vote for the wonderful Molly Conger's Weird Little Guys, which I'll also have a link to. I know signing up to stuff is annoying. I'm asking a lot from you, but there you go.

1:57I'm doing it. Anyway, to the monologue. I feel like we're approaching a choke point in the whole generative AI bubble, the culmination of over a year of different narratives and pressures that I believe will lead to an ultimate collapse. Last week, OpenAI released an image generator with GPT-40, which quickly gained massive attention for its ability to create images in the style of famed Japanese animation company Studio Ghibli. And to be clear, I think these images are an abomination and everyone involved in launching this tool has committed a mortal sin. Anyway, nevertheless, creating these disgusting, disgraceful images comes at an incredibly high cost.

2:34And for the last week, OpenAI CEO Sam Altman has been complaining about their GPUs melting, leading to OpenAI having to limit free users to only three image generations a day, along with longer wait times and capacity issues with video generator Sora. To make matters worse, Altman also announced that, and I quote, by the way, that users should expect new releases from OpenAI to be delayed, stuff to break, and for services to sometimes be slow as we deal with capacity challenges. This led me to ask a very simple question that I think everybody in the tech media really should be asking. Why can't Sam Wartman ask Microsoft for more GPUs?

3:12The answer is, as you may have guessed from my last monologue, is that there may not actually be capacity for them to do so. OpenAI's relationship with Redmond has grown kind of chilly over the past year. I'd speculate that Microsoft has refused to provide additional immediate capacity or has refused to provide capacity on the chummy terms that OpenAI previously enjoyed, receiving a significant discount on the usual ticket prices in the past. We know that Microsoft has both walked away from 2 gigawatts of future compute capacity and declined the option to spend another$12 billion on CoreWeave's compute.

3:43And CoreWeave, if you don't remember, they're the publicly traded data-centered AI company. A whole dog's dinner unto itself. And analyst house TD Cohen suggested that this is a sign that Microsoft is no longer willing to shoulder the immense financial burden of supporting OpenAI. Even though OpenAI picked that option up, by which I mean they took the$12 billion of compute, it isn't clear if CoreWeave can actually build the capacity they need, and definitely don't think they're going to be able to do it in the time they need it. Microsoft allegedly walked away from CoreWeave due to its failure to deliver, and that delivered the services they asked for and indeed probably the computer as well.

4:22If that's true, it's unclear what has changed to make CoreWeave magically able to support OpenAI or even how a company that's drowning in high interest debt can finance the creation of several billion dollars worth of new data centers. Also, it's not quite as simple as OpenAI calling up a data center company with a bunch of GPUs and running chatgpt.exe. OpenAI likely has reams of different requirements, and the amount of GPUs they will need will likely vary based on demand, putting them in a problematic situation where they could be commuting to a bunch of compute that they don't need if demand slows down.

4:55I've heard that companies generally want a 6-12 month commitment for GPUs too. The cost is fixed, no matter how much they get used, or at least there's a minimum commitment. But let's assume for a second that demand for a chat GPT continues to rise. How does OpenAI actually get that compute? If Microsoft isn't handing it over, and the information reports that OpenAI still projects to spend about$13 billion on Azure Cloud in 2025, there aren't really a ton of other options, especially for a company with such gigantic requirements. Meaning that whatever infrastructure OpenAI is building is a patchwork between smaller players, and using so many smaller providers likely creates unavoidable inefficiencies and overhead.

5:36I'm naming another pale horse of the AI apocalypse, by the way. Limits to service and service degradation across ChatGPT. OpenAI is running out of compute capacity. They've talked about it since October of last year. And ChatGPT's new image generation is a significant drain on their resources, meaning that to continue providing their services, they're going to need to expand capacity or reduce access to services otherwise. The problem is that expanding is extremely difficult. Data centers take three to six years to build, and OpenAI's planned Stargate data center won't have anything ready before 2026 at the earliest, which means we're approaching a point where there simply might not be enough data centers or GPUs to burn.

6:19While OpenAI could theoretically go to Google or Amazon, both of those companies are invested in Anthropoc and have little incentive to align with OpenAI. Meta is building their own ChetGPT competitor, and Elon Musk despises Sam Altman. Real shithead versus fuckwad situation there. While I can't say for certain, I can't work out where OpenAI will get the capacity to continue. And I just don't know how they're going to expand their services if Microsoft isn't providing capacity. Yes, there's Oracle, which OpenAI has a partnership with, but they're relatively small in this space. ChatGPT's image generation has become this massive burden on the company, right at the point where it's introducing some of its most expensive models ever.

6:59And the products themselves are extremely expensive to run. Deep research is perhaps the best example. using OpenAI's extremely expensive O3 model, which can cost in some cases as much as$1 ,000 per query. Deep research is probably cheaper, but not that much cheaper. Probably, I've heard rumors, and this is a rumor, it's a rumor, I've heard like a dollar or two per query. If that's the case, that's fucking insane. Anyway, while OpenAI could absorb the remaining capacity at, say, Crusoe, Lambda, and CoreWeave, this creates a systemic risk where every GPU provider is reliant on OpenAI's money, and this assumes that they'll actually have enough to begin with.

7:36OpenAI also just closed the largest private funding round in history. 40 billion theoretical dollars valuing the company at a ridiculous 300 billion dollars raised from, you guessed it, SoftBank and other investors. That's good news, right? Not really. In truth, OpenAI really only raised 10 billion dollars, with 7.5 billion of those dollars coming from SoftBank and another 2.5 billion dollars coming from other investors, including Thrive Capital and Microsoft. The remaining$30 billion, of which SoftBank is on the hook for$20 billion of, will arrive at the end of the year. That's all we've got.

8:11But OpenAI will only get$10 billion from SoftBank, so bringing it down to a$30 billion round total, if OpenAI fails to convert from a non-profit to a for-profit company by the end of 2025. A massive acceleration there. As a reminder, OpenAI is a weirdly structured non-profit with a for-profit arm, and their last round of funding from October 2024 had another caveat, that if OpenAI failed to become a for-profit company by October 2026, all investment dollars would convert into debt. I've also read that they would have to hand the money back. I'm not sure whether that's the case. Debt is the one that's been reported the most.

8:48Furthermore, OpenAI loses money on every single prompt on ChatGPT, even from their$200 a month ChatGPT pro subscribers. The burdensome interest payments would make it even harder for OpenAI to reach breakeven, which right now it doesn't even seem like they can do anyway. As another reminder, SoftBank is a company that has now invested in two different fraudulent schemes, Wirecard and Greensill Capital, the latter of which helped put the nail in the coffin of Credit Suisse back in 2023 and put$16 billion into WeWork. It will be incredibly, some might say impossibly difficult, and I'll cover this in a future episode, to convert OpenAI into a for-profit company.

9:27And the fact that SoftBank is putting this caveat on their investment heavily suggests that they have doubts that will happen. And I must be clear, when the monopoly man is getting nervous, you should get nervous too. The fact OpenAI accepted these terms also suggests they're desperate. And I don't blame them. They've committed$18 billion to the Stargate Data Center project, will spend$13 billion on Microsoft computer loan in 2025, according to the information, and they've now created an incredibly popular product that will guarantee people come and use it like twice and then never use it again.

10:00Now keep a keen eye on any restrictions that OpenAI makes on ChatGPT in the coming months. I do not see how this company survives, nor do I see how they expand their capacity much further. Price increases, rate limits, and other ways of slowing down the pressure on their servers will likely suggest that OpenAI is up against the wall, both in their ability to support the services they provide and the costs they must bear to provide them. We are entering the hysterical era of the bubble, The time when the craziest stuff will happen as the money does everything it can to keep the dream alive. I look forward to telling you what happens next.

10:53our sofas are fully machine washable inside and out. So you can say goodbye to stains and hello to worry-free living. Made with liquid and stain-resistant fabrics, they're kid-proof, pet-friendly, and built for everyday life. Plus, changeable fabric covers let you refresh your sofa whenever you want. Need flexibility? Our modular design lets you rearrange your sofa anytime to fit your space, whether it's a growing family room or a cozy apartment. Plus, they're earth-friendly and trusted by over 200 ,000 happy customers. It's time to upgrade to a stress-free, mess-proof sofa. Visit washablesofas.com today and save.

11:32That's washablesofas.com. Offers are subject to change, and certain restrictions may apply. Parking shouldn't slow you down. ParkWiz gives every driver a shortcut. Book ahead, save up to 50%, and skip the hassle of circling the block. Park smarter, park faster. ParkWiz. Download the ParkWiz app today and save every time you park. Every day has a to-do list, but adding Enjoy Belvita to yours can help you knock out the rest of it. Belvita breakfast biscuits are a tasty and convenient breakfast option when paired with low-fat yogurt and fruit that provides steady energy all morning. While Belvita Energy snack bites give you the perfect mid-morning refuel.

12:13Best part? They both taste great. So make the most out of your morning with a bite of Belvita. Pick up a pack of Belvita at your local store today. Ah, come on. Why is this taking so long? This thing is ancient. Still using yesterday's tech? Upgrade to the ThinkPad X1 Carbon. Ultralight, ultra-powerful, and built for serious productivity. With Intel Core Ultra processors, blazing speed, and AI-powered performance. It keeps up with your business, not the other way around. Whoa, this thing moves. Stop hitting snooze on new tech. Win the tech search at Lenovo.com. Lenovo. Unlock AI experiences with the ThinkPad X1 Carbon powered by Intel Core Ultra processors so you can work, create, and boost productivity all on one device.

13:01This is an iHeart Podcast.