Gas Is Back Above $4 — And Could Keep Rising

21 Jul 2026 · 33 min · 17 chapters

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

The episode is about two market drivers: Middle East conflict pushing oil and gasoline higher, and China’s release of a major open-source AI model (Kimi K3) rattling tech stocks and intensifying the open-vs-closed AI debate.

Guests

Matt Smith, Director of Commodity Research at Kepler, and Charlie O’Neill, co-head of model training at Base 10.

Key claims

Smith says Strait of Hormuz traffic is “grinding to a halt” with only Iranian-route tankers moving, that Saudi rerouting cushioned supply but the Houthis’ threatened blockade raises bullish oil risk, and that gasoline pain is lagging crude while diesel is “ripping” (about $5+). He argues oil could plausibly stay above $100 in 4–5 months if conditions persist. O’Neill claims Kimi K3’s significance is open-source vs closed-source, explains open-weight advantages (downloadable weights, post-training), and argues pricing pressure will compress frontier-lab margins rather than kill them.

Notable examples

nine consecutive nights of US strikes on Iran, Houthis declaring a naval blockade, crude around $89/barrel, US gas at $4, and Kimi K3 described as ~3T parameters beating top closed models on some benchmarks.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Chapters

Tap a time to open that second in VO

Market Overview and Oil Prices

0:00 to 0:26

Discussion of recent market declines and oil price volatility.

“Support for the show comes from Attio, the CRM for teams who set the pace.”

Market Overview and Oil Prices

1:09 to 1:20

Discussion of recent market declines and oil price volatility.

“Carefully consider the investment material before investing, including objectives, risks, charges, and expenses.”

Market Overview and Oil Prices

2:08 to 2:55

Discussion of recent market declines and oil price volatility.

“Let's check in on yesterday's market vitals.”

Escalating Middle East Conflict

2:55 to 4:06

Analysis of the conflict in the Middle East and its impact on oil prices.

“nights in response to Tehran's attacks on oil tankers, and Iran had retaliated with strikes across the region.”

Tankers and Oil Supply Routes

4:06 to 5:32

Insights into how oil supply routes are being affected by conflict.

“Our job has become increasingly more difficult as there's been different routes to try and traverse the Strait.”

Impact of Blockades on Oil Prices

5:32 to 7:13

Exploration of how blockades are influencing global oil prices.

“away from the Strait of Hormuz or around the Strait of Hormuz.”

Current Oil Price Dynamics

7:13 to 9:18

Discussion on current oil prices and market sentiment regarding future trends.

“So the memorandum of understanding has been dissolved.”

Future Predictions for Oil Prices

9:18 to 11:34

Speculation on where oil prices may head in the coming months.

“Whereas the crude market is somewhat remains somewhat in balance because of this rerouting and because this lack of refining.”

Oil Price Predictions Amidst Uncertainty

14:01 to 15:15

Explore predictions for oil prices based on current global scenarios.

“And so perhaps I've been burned by saying that, right?”

Oil Price Predictions Amidst Uncertainty

17:36 to 18:04

Explore predictions for oil prices based on current global scenarios.

“Listening to this podcast instead of doom scrolling?”
Show all 17 chapters

The Emergence of Open Source AI Models

18:06 to 20:58

Discuss the implications of Kimi K3 and the shift towards open-source AI.

“China just gave Wall Street its second deep-seek moment.”

Comparing Open Source and Closed Source Models

20:58 to 26:27

Understand the advantages and challenges of open source versus closed source AI models.

“I never get to touch the model weights which you can think of with this big collection of numbers that do a bunch of multipliers to give me my answer.”

Cost Dynamics of AI Models

26:28 to 28:00

Explore the pricing structures of AI models from various providers and their implications.

“It seems like a big piece of the story for an enterprise, for a company that's trying to leverage AI as much as they can.”

The Impact of Open Source on AI Margins

28:00 to 30:19

Explore how open-source models affect profitability in the AI sector.

“is because they have great margins, because they were sitting at the frontier and there was no real competitor at the very frontier.”

Future of AI: Bifurcation of Open Source and Frontier Labs

30:19 to 32:09

Understand the future dynamics between open-source AI and established labs.

“I think my honest take here is that this isn't the death knell for Anthropic Kit OpenAI.”

Closing Thoughts with Charlie O'Neill

32:09 to 32:20

Reflections on the evolving AI landscape from industry expert Charlie O'Neill.

“have significant capitalistic pressure to advance the intelligence of these models and the frontier that will feel that at the very frontier.”

Closing Thoughts with Charlie O'Neill

34:31 to 34:55

Reflections on the evolving AI landscape from industry expert Charlie O'Neill.

“And let go of whatever you're carrying today.”
Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00Support for the show comes from Attio, the CRM for teams who set the pace. You know that rep who closes faster than everyone else? They're not quite who they seem. While they're walking into every call prepped, writing perfect handoff briefs and follow-ups and catching every signal in time, they've actually got Attio working for them around the clock. Atio's revenue agents qualify and work every account so they can move at scale with ease. It's how startups including Granola, Modal, and Whisper Flow win. You can go to atio.com slash profg and you'll get 15 % off your first year. That's A-T-T-I-O dot com slash profg.

0:40Support for the show comes from BCX, the public ticker for private tech. The U.S. stock market started history's greatest wave of wealth creation. from factory workers in Detroit to farmers in Omaha. Anyone can own a piece of the great American companies. But today, our most innovative companies are staying private longer, which means everyday Americans are missing out. Until now. Introducing VCX, a public ticker for private tech, now available wherever you buy stocks. Visit GetVCX.com for more info. That's GetVCX.com. Carefully consider the investment material before investing, including objectives, risks, charges, and expenses.

1:15This and other information can be found in the fund's prospectus at GetVCX.com. This is a paid sponsorship.

1:43make sense? There's no place like Chrome. Check responses set up required compatibility and availability varies 18 plus.

2:01Welcome to Prof G Markets. I'm Ed Elson. It is July 21st. Let's check in on yesterday's market vitals. The S &P 500 and the Dow declined as conflict in the Middle East escalated. The Nasdaq was flat. Oil was volatile. More on that in a moment. The yield on 10-year treasuries rose. SpaceX stock hit a new low of$120 per share. And finally, Warner Brothers shares fell nearly 4 % after a judge temporarily halted its deal to get acquired by Paramount. The judge said the sale likely violates antitrust laws and scheduled a hearing for next month. Okay, what else is happening? Conflict over the Strait of Hormuz keeps escalating, and now it is spreading to Saudi Arabia.

2:53As of Monday, the US had bombed Iran for nine consecutive nights in response to Tehran's attacks on oil tankers, and Iran had retaliated with strikes across the region. But yesterday, Iran's Houthi allies in Yemen declared a naval blockade against Saudi Arabia. This blockade stands to threaten the primary way in which oil has been able to get around the Strait of Hormuz through a Saudi pipeline to the Red Sea. These developments immediately shot the price of oil back up. Crude is now about$89 a barrel, and the national average for a gallon of gasoline has yet again hit$4 in America, up 15 % in just the past week.

3:36So, to discuss what is happening in the Middle East and also how it's affecting the price of oil, we are speaking with Matt Smith, Director of Commodity Research at Kepler. Matt, great to have you on the show. A lot happening here. If you could just give us your initial reactions and a quick rundown. What has unfolded and how is it being reflected in oil prices right now? We're tracking those tankers that are passing through the Strait of Hormuz here. Our job has become increasingly more difficult as there's been different routes to try and traverse the Strait. And so what you've essentially got is you've got the Iranian route, which is right at the top, kind of the north.

4:21And then you have the pre-conflict highway, which was straight through the middle and then at the bottom you've got the Omani route which is the kind of the southern corridor as we've seen escalations increasing here and you've seen some of the tankers being hit that were passing the Omani route all we're actually seeing now is is it's essentially traffic grinding to a halt again except for those Iranian tankers and friendlies that are passing the Iranian route so it's been undulating right over the last few months you know March, April, and even into May, the traffic was very, very slow. And then, you know, just over the last month or so, we've really seen it pick up because of the signing of the Memorandum of Understanding between the US and Iran.

5:04Now that has basically been, you know, dissolved. And we're seeing an escalation here in attacks, as you mentioned, it's been nine consecutive nights, will probably have the 10th today. And so this is causing all prices to start to kick back higher again. Just looking at what happened with Saudi Arabia and that blockade, it seems as though oil supply was figuring out a way to kind of reroute itself away from the Strait of Hormuz or around the Strait of Hormuz. I guess my question is, to what extent was that successful? and to what extent has that now been kind of blocked now that we've got this new development?

5:50It was working pretty successfully and so it was able to reroute about three and a half million barrels a day of Saudi crude across to the Red Sea and so Saudi was exporting about seven million barrels a day out of the Mideast Gulf prior so it was able to reroute half of that crude so that put them in a better situation more than most so that has definitely helped somewhat cushion the supply shock because all of that crude was then going across to the Red Sea and was heading into the likes of India, China, South Korea, these countries that were otherwise getting their crew from the Mideast Gulf and it had stopped.

6:21And so it was definitely providing some support there and helping, you know, in terms of support in terms of supply and then helping to keep prices in check somewhat. Now, the Houthis are threatening to do that blockade. they're not actually doing it yet we're not seeing tankers or anything being being hit but this essentially is the ace that iran has in its pocket because we've had this escalation that's been happening over the last few months here and some have said oh we know they could close babam and deb but they've kind of held that back until the point where the u.s would essentially start perhaps attacking infrastructure energy infrastructure bridges and and that's kind of the point that we've got to so then it's for iran to up the ante here and that's basically bringing bab al-mendeb into play and so it's really just a sign that essentially iran has is getting to the point where they've really got not nothing left to lose or you know they're they're just getting to the point where they're willing to do this kind of scorched earth tactic and so we'll have to see how this plays out but the threat of stopping these flows will definitely have a bullish impact on prices.

7:29So the memorandum of understanding has been dissolved. We are now fully at war, striking Iran on multiple consecutive nights. Now they are, as you say, playing their ace card. They are trying to block any of the other supply routes that have been resorted to over the past several months. I mean, it doesn't look good. And we're at$89 a barrel. Gas in America has gone back up to$4. Why should we believe that that number is going to come down within the next, I don't know, several weeks? Yeah, no, we shouldn't. And actually, what has developed over the last few months here, or essentially since the beginning of March when this has happened, is everyone's been watching that oil price, and you haven't felt the biggest impact on that oil price.

8:29And the reason for that has been a number of different reasons. China has really come out of the markets. China has just stopped buying oil. They dialed back on their imports by about five, five and a half million barrels per day. So that has been hugely helpful. You've also had essentially a lot of these refineries dialing back on their activity, so they haven't taken that crude. And that has largely offset the production loss we've seen from the Middle East. But what that has meant is that the pain has essentially been transferred from the oil price across to the products. And so when you talk about gasoline at$4 a gallon on the national average, we see diesel at$5, breaking above$5, And that's going to be really pushing higher because in barrel terms, it's about$170 a barrel for a barrel of diesel.

9:14And so that's where that pain is coming through is in the products because we're not seeing those produced. Whereas the crude market is somewhat remains somewhat in balance because of this rerouting and because this lack of refining. When you look at that number,$89 a barrel, to you, does that say that investors are feeling optimistic about the current state of affairs or pessimistic? I mean, does that number hold any biases inside of it? one huge bias that it holds is that even if you are bullish on oil markets you're not going to go and buy a paper barrel because you could have president trump tweet something in five minutes time and oil prices could drop by 10 15 so i'm not saying prices are manipulated per se but they are definitely under the influence here of things other than fundamentals and so because of that You've got some that are simply not getting involved in the oil trade, and that has been happening for a good number of months here.

10:22There's a lack of liquidity there. The flip side of that, that's why I point to the diesel market again, is because the US administration is fixated on the oil price, super fixated on prices at the pump. It's not necessarily paying that much attention or putting that much emphasis at all on diesel prices. And so that's perhaps the least influenced market out of all of the petroleum complex. And that's the one that we're seeing absolutely ripping here. I mean, this is essentially the most important question for the US economy right now, which is what's going to happen to the price of oil? What's going to happen to the price of fuel?

10:56As we saw in the previous inflation report, it was lower oil prices as a result of the memorandum of understanding that made the number go down more than the previous month. But now we know that whatever pricing was being priced into the market at the time was incorrect because the memorandum of understanding is over. We're now back at war. Some would argue we continue to be at war the entire time. I won't get into it. But it seems that what we have seen over the past week is going to have material impact on U.S. consumers and the U.S. economy. And perhaps that isn't being fully reflected or appreciated or priced in by investors and traders right now, how impactful and how bad do you think it will be going forward?

11:46Well, we could just continue in the status quo, right? In that there's this back and forth between the US and Iran in terms of the attacking of tankers by Iran, the attacking of infrastructure by the US. And then in the background, there is talks and whispers of diplomacy, which helps keep oil prices in check here, which in turn helps keep prices of the pump in check. But when we came into this thing, there was expectation you can't close the Strait of Hormuz for two, three weeks, it will cause like Armageddon. Yet here we are four and a half months in. And so it's really realistic to try and consider the scenario.

12:23Could this still be closed in November and December? Yes, there are workarounds. There's medium term plans here to reroute crude, but we really could be just continuing to scramble over the next four or five months here. And that's a reality. If that happens, you're not going to be in an environment where prices at the pump and diesel prices are moving lower. What kind of price do you think that that would result in if we find ourselves in the same situation that we're in today? And to be clear, I mean, it seems like a couple ships are making their way through the Strait of Hormuz. I mean, is that right?

13:02Or is it just zero? There was like a week or so ago, or even just before the weekend, where you were seeing some getting through there. But the Iranians have turned their focus to targeting those because they were going through the Armani route, they were getting like a US naval escort. And so they're trying to deter any kind of traffic. So the only traffic that we're seeing going through right now is related to Iranian or Iranian, and it's just empty tankers. And so, but to your point, we were seeing over the last month, this increase in traffic going through, increased confidence, increased risk taking, and that really helped the oil market, not necessarily on the oil price, but in the differentials, you really saw the air being let out of the tires there, the pressure taken out, as we saw the stranded cargoes in the gulf getting out of there but then again with it's one step forward two steps back here where we're back to to essentially the doors being shut again so i'll return to my question which is if we find ourselves in the same position that we are in today four or five months from now what would you estimate the price of oil uh will will look like it's got to be higher you know i'll hold up my hands here and you know in march you if you'd ask me that question you may have done absolutely I mean, like, you know, oil prices should be$120,$130,$140 if you close the strait for months and months.

14:24And so perhaps I've been burned by saying that, right? But maybe if we're going to be pushing above$100 here, that doesn't seem unrealistic at all if we're in the same scenario that we're in now in four or five months' time. If we are in the same scenario that we're in now and it isn't above$100 a barrel, what would have had to have happened to get it lower than that? What truths would need to exist in the world for oil to not be more than 100? Well, we'd be drawing down inventories absolutely everywhere that we could. You'd be having tankers sneaking out of the Strait of Hormuz, however that was possible, rerouting of crude as much as possible too.

15:07But it's just difficult to see a scenario where you're not pushing into triple digits if this is still the situation in four or five months' time. All right. Matt Smith is Director of Commodity Research at Kepler. Matt, appreciate your time. Thank you. Thanks, Ed. After the break, why investors are so worried about the latest Chinese model. And for even more markets insights, you can subscribe to my weekly newsletter, simply put at simplyput.profgmedia.com.

15:44When you need to build up your team to handle the growing chaos at work, use Indeed Sponsored Jobs. It gives your job post the boost it needs to be seen and helps reach people with the right skills, certifications and more. Spend less time searching and more time actually interviewing candidates who check all your boxes. Listeners of this show will get a$75 sponsored job credit at Indeed.com slash podcast. That's Indeed.com slash podcast. Terms and conditions apply. Need a hiring hero? This is a job for Indeed Sponsored Jobs. Support for the show comes from SoFi. One of the biggest advantages wealthy people have is the means to hire people who can help them make better financial decisions.

16:21But for most of us, there's six different financial apps that don't talk to each other. That's where SoFi Coach can help. Coach provides step-by-step chat-based guidance for all your finances, helping you pay down debt, save more, spend smarter, and invest. It doesn't just give you advice. It can actually execute the moves for you with your approval. You can also ask important questions such as, can I afford to buy a home this year? Or how can I improve my credit score? And because it's connected to your linked accounts, the answers are tailored to your specific financial situation. And if you ask SoFi Coach, what should I do with$10 ,000?

16:55If you're lucky, you might need the answer sooner than you think. You'll be entered for a chance to win$10 ,000. Learn more and enter at SoFi.com slash PropGCoach. That's sofi.com slash propgcoach. This is a paid advertisement by SoFi Technologies and is not intended to be financial advice. No purchase necessary. A purchase will not increase your chances of winning. Open only to legal residents of the 50 U.S. slash D.C. 18 plus, void where prohibited by law. Sweepstakes ends at 11.59 p.m. Eastern Standard Time on September 15, 2026.

17:33This episode is brought to you by State Farm. Listening to this podcast instead of doom scrolling? Smart move. Another smart move? Getting help from one of State Farm's 19 ,000 local agents when you choose to bundle home and auto. Bundling. Just another way to save with the personal price plan. Prices are based on rating plans that vary by state. Coverage options are selected by the customer. Availability, amount of discounts and savings, and eligibility vary by state.

18:04We're back with Profity Markets. China just gave Wall Street its second deep-seek moment. Chinese startup Moonshot AI released Kimi K3, the world's largest open-source model, on Thursday. On some benchmarks, including front-end coding, K3 beats the best models from OpenAI and Anthropik. But the biggest story may be the price tag. Running K3 costs roughly a third of what Anthropic charges for its flagship model, and businesses are starting to notice. On OpenRouter, a marketplace for AI models, Chinese open-weight models now occupy the top five spots by weekly global token usage. The Nasdaq fell about 1.5 % on Friday as US tech stocks sold off following the release of Kimi K3.

18:54So we wanted to speak with an expert who works hands-on with both open and closed models. So joining us is Charlie O 'Neill, co-head of model training at Base 10. Charlie, thank you for joining us. So this Kimi K3 model that was just released has everyone kind of with their hair on fire. We obviously saw the NASDAQ erased 1.5%. Chip stock sold off. a lot of people saying that it was a problem. David Sachs, the former AI czar, called the release, quote, concerning. What do you make of Kimi K3? Yeah, I think the big story here is not necessarily Chinese models versus American models. I think the big story here is open source versus closed source.

19:40So obviously the story we've been told for the last several years is that closed source is going to continue to dominate. The American frontier closed source labs are going to continue to pull ahead and open source will never catch up to that. And I think what we're seeing with Kimi, with other Chinese models like GLM, GLM core is a very, very big wave. It may not have done the rounds in the same way that Kimi did, but it was certainly a great model. And even like releases like Inkling from Thinking Machines, which is an American company, what we're seeing is that basically the recipe to build these things, there's no secret source.

20:13The big labs, they don't have anything that the open source labs don't have. And open source is going to continue to improve the capabilities and intelligence of the models they release as we scale up the size of these models and the amount of data and compute that goes into them. And so, yes, from one kind of aspect, it's concerning that this is like a Chinese model that is leading the charge with this sort of like open source versus closed source debate. But I think there's really promising signs for the open source ecosystem in general. And I think a lot of people are starting to realize that that's potentially a better world to end up in compared to where you have maybe a duopoly with open-air and anthropic having these models that pull away from everyone else and they dictate all the terms of access and control that intelligence.

20:53Just for the uninitiated, what is the difference between an open source model and a closed source model? Anthropic, OpenAI, Google, their flagship models are what we refer to as closed source in the sense that I can ask it a question, that question gets sent off over the internet, goes to their GPUs which run the model, they do the number crunching and then they send the answer back to me. I never get to touch the model weights which you can think of with this big collection of numbers that do a bunch of multipliers to give me my answer. Whereas with open source, I can actually download those numbers.

21:24Not only can I host that on my own GPUs, I can also do things like continue to train it myself for specific tasks. So it's really about being able to download the actual weights of the model rather than just being able to send a question to it. So you can think of this as like, you know, owning the disk for an Xbox game versus like having that Xbox game installed through the cloud on your particular Xbox. I can actually see the physical disk. What would be the pros for developing a closed source model instead of an open source model? Why would OpenAI and Anthropic pursue those methods instead?

21:59I guess there's two answers here. The first answer is the one that OpenAI and Anthropic will tell you, which is that these things, as they become increasingly intelligent, we have to think very carefully about how they're applied in society. There's obviously real safety concerns, there's cybersecurity concerns, there's biological weapons development concerns. And so we should really think about who we trust to build and control this intelligence. And Anthropic and OpenAI's argument is you should trust us. We are the best at developing this intelligence and hence we should be the ones to dictate how it's used and how it's applied basically in perpetuity.

22:31There should be a very small number of actors who can choose what we do with LMs and intelligence. And I think the real argument is that obviously this stuff is so lucrative that if you do manage to prevent anyone else from developing it you can capture insanely high margins on the tokens that you're producing so anthropics rumored to have you know margins north of 80 percent um i think like when there is a case or a world where there's only two major players and you end up in a duopoly that is a very real possibility to to continue and i think that's obviously very very lucrative to open an anthropic so open source is a threat to them in the sense that those margins aren't going to remain at 80 % for long.

23:11Of course, there are security concerns. We have to really think carefully about how these things are used. But at the moment, it doesn't seem like open source versus closed source. The intelligence ceiling that we've gotten to hasn't led to any increased concerns around, you know, can I use this model through open source or closed source? Like the risk of developing a bioweapon, for instance, is about the same in either case. It seems that there has been kind of a shift towards both Chinese models, but also open source models. Most of these Chinese models are open source or open weight. Why is that happening, do you think?

23:46What is the value proposition that developers are deciding is greater when they use these types of models as opposed to one offered by OpenAI or Anthropic? I think there's developers who have a very inelastic demand for the frontier intelligence. We'll always want to use the most intelligent models. And then there's the ecosystem and the economy in general. The way I like to think of it is that for all the economically valuable tasks that we could plausibly use an LLM for, there is some intelligence threshold at which below that it's very difficult to do the task. And above that, you're getting very diminishing returns to having more and more intelligent models.

24:22And usually intelligence is correlated with cost. So the obvious argument here is that there is margin pressure on all these startups, all these companies, even enterprise now who are doing these particular tasks with LLMs. They've hit the threshold of intelligence probably even a while ago with open source. Open source has been accelerating rapidly and you just don't need a Fable or Mythos level model in order to do some of these things. And you get exactly the same performance if you use a model that's a tenth of the size or even a fiftieth of the size. Post training is also really important here because it means you can teach a much smaller model to do one thing really, really well, as opposed to taking an off-the-shelf open source or closed source model and trying to prompt engineer your way to doing that task.

25:01So post-training really changes the economics here. And of course, you can only post-train on open source models because you can actually touch the weights as opposed to closed source. And so I think margin pressure is a big one. Another one is like Anthropic and OpenAI, I think are realizing that the recipe is the same amongst all these companies. Like there is no secret sauce. Yes, there's probably a long tail of optimization, small optimizations that Anthropic and OpenAI AI have that the rest of the ecosystem doesn't have. But their moat is no longer in them being the only ones who can train these very, very large multi-trillion parameter models.

25:32Their moat now is starting to shift towards, okay, well, if we have a little bit of a headstart, what if we try and hit particular verticals? And so Anthropic is very clearly doing this. They're going after the verticals of finance and legal, OpenAI as well. And so I think companies are really feeling this pressure. If you're a startup or a company in legal or finance and you're using LLM to do these particular things and you have previously just been an Anthropic wrapper, you've just got some logic calling Anthropic models, you don't have a distinguishing moat between you and Anthropic. And so you're starting to think about, okay, what's the one thing I have that Anthropic doesn't have?

26:05And that's a really nice feedback cycle. I have users who love and hate my product for various reasons, and they will tell me what they love and hate. And I can use that to improve the intelligence of a model. And again, you do that through training. And the only real way to do that is with open source models. And so I think it's this combination of margin pressure and companies wanting to develop their own mode to protect themselves against their vertical being eaten by these closed source frontier labs. It seems like a big piece of the story for an enterprise, for a company that's trying to leverage AI as much as they can.

26:35And Alex Kopp talked about this in his interview with CNBC that has since gone viral, is basically just the price. uh anthropic tokens are expensive open ai tokens are expensive tokens from chinese model providers are less expensive so my question is to what extent is there a relationship between price and being open source why is it that these chinese models and these other models that aren't you know frontier lab models, how is it that they can offer a product that does the job pretty well, but at literally a fraction of the cost? The answer to this used to be simply that the Chinese and open source models were much smaller.

Read the full transcript

27:19So the big labs are the only ones that have the compute to be able to train the really large models. And of course, like the scaling laws that we have predict that intelligence increases, but with diminishing returns in model size. And so, yes, of course, the big labs had better and bigger models, but you often could use a much smaller model to do the task. I think now it's more of a case of like, okay, some of these open source models are actually very large. And I think K3 was a massive shifting point because previously we'd gone into the just for it into the 1 trillion parameter model range with the previous Kimi models and DeepSeq very, very recently.

27:52But this is almost 3 trillion parameters. This is a big boy. And so now it's much more about, okay, we're really seeing under the hood that the reason that Anthropic and OpenAI models are so expensive is because they have great margins, because they were sitting at the frontier and there was no real competitor at the very frontier. And again, a lot of this stuff, it is inelastic. You do demand frontier intelligence. But now we're really seeing, okay, if we do have multi-trillion parameter open source models that any company can host on their own GPUs and can post train and then host on their own GPUs, then what that's telling us and a lot of analysis is telling us is that the frontier labs margins are just massive.

28:30And so I think that the shift that's going to happen now is if there is an alternative that is essentially the same and to 99.99 % of people doing 99.99 % of things is indistinguishable, like Kimmy is indistinguishable from a Fable or a GPT 5.6 Sol, we're just going to see those margins shift. So instead of being 80 % to the person who trained the model, they might end up being 40 % and the rest of that margin is going to be distributed, one to the consumer and then two to the rest of the ecosystem. So the compute providers and the inference providers are going to be big wins of all this competition amongst, you know, model trainers.

29:04It's no longer the case where there's only one or two players who can do this and capture those massive margins. There's going to be much lower margins for model trainers, and the rest is going to kind of be spread out amongst the ecosystem. It seems to me that these models, Kimi K3 and plenty of others that seem to be released practically every month, and then we see all these benchmarks where they're performing either in line with open-eyes models or outperforming them. It seems like that, combined with the pricing pressure, could literally bring the frontier labs to their knees. If we know that they're already struggling to generate more revenue than they spend, if we know that they're also stacking up billions of dollars in losses, and they essentially need to develop more pricing power if they want to get profitable and get cash flow positive over the next few years, and that's been OpenAI's objective.

29:59It seems like this is exactly the kind of thing that will get in the way of that. Is this dire to the AI ecosystem? How does this actually play out for the largest names in AI? I've obviously been a big advocate and proponent of open source for a long time and want open source to win in some reasonably significant capacity. I think my honest take here is that this isn't the death knell for Anthropic Kit OpenAI. I think ideally and probably most likely now we're going to live in a world where there are a few key core frontier players and then a large diverse ecosystem of open source model providers.

30:35The reason I think that is because of kind of the distribution of tasks in the economy that we're currently trying to tackle with LLMs and the distribution of tasks in the economy that we should be tackling with LLMs in the next 10 years. I think what we're going to see is a little bit of a bifurcation. I think tasks that we can currently conceive of as being economically useful and all the jobs that we currently do, we are going to rely more and more on open source to be able to do those things. I think very, very frontier things, for instance, science and maths discovery, which have a longer, they have a lagging period.

31:07There's a bunch of labs, like periodic labs, who are really looking forward to tackling science over multi-decade horizons with LLMs and this new intelligence. I think the frontier labs are going to gain a lot of economic benefit from tackling those tasks. I just don't think we're going to live in a world where the labs subsume everything. I think we're going to see this rising tide of intelligence. Open source is probably going to continue to lag behind a little bit to some extent. I think those are going to be fairly parallel lines that go up together. But if you're doing frontier science and you are planning these very, very long scientific endeavors in order to extract economic value from whatever it is you're doing, you are going to be wanting to using the best intelligence.

31:47And I think Anthropic and OpenAI and other players like them will make significant profits and contribute significant value on those fronts. It's just that it's not the world we thought it was going to be two years ago where they would also get all the value underneath that of current GDP and the things that we currently conceive of as economically valuable. And I think that's a good outcome for everybody. No one player wins. I think we still have significant capitalistic pressure to advance the intelligence of these models and the frontier that will feel that at the very frontier. And then that's going to diffuse throughout the rest of the ecosystem as well.

32:19All right. Charlie O 'Neill, co-head of model training at Base 10. Charlie, we appreciate your time. Thank you. Thanks for having me, Ed.

32:30Okay, that's it for today. If you're catching this episode on Tuesday morning, I hope you'll take the opportunity to join our live stream later today at 1.30 Eastern time. Scott and I are going live on Substack with economist Noah Smith. We'll be unpacking the biggest question marks about the economy with him, and we'll also be exploring China's role in the AI ecosystem further. Head to ProfGmedia.com to subscribe. If you haven't already, the live stream is free and open to all subscribers.

33:03This episode was produced by Claire Miller and Alison Weiss and engineered by Benjamin Spencer. Our video editor is Brad Williams. Our research team is Dan Chalon, Kristen O'Donoghue, and Mia Silverio. And our social producer is Jake McPherson. Thank you for listening to Prof G Markets from Prof G Media. If you liked what you heard, give us a follow. I'm Ed Elson. I will see you tomorrow.

33:30Most of us are one good deal away from finally replacing that worn out rug, fixing up the backyard, or getting the bedroom we actually want. Good news. That deal's almost here. Wayfair's Black Friday in July sale. Get up to 80 % off area rugs and up to 60 % off outdoor and bedroom furniture. Shop Wayfair's huge selection of styles and find the piece to fit your style, budget, and space. Plus, free shipping. Black Friday in July ends July 27th. Shop today at Wayfair.com. Wayfair, every style, every home. Hi, Ryan Reynolds here for Mint Mobile. Are you looking for a beach read this summer? May I suggest your big wireless bill?

34:06It's got suspense, mystery, a slightly flat emotional arc, and a shocking twist where you realize you've been overpaying the entire time. Fortunately, though, Mint's story is better. Every plan,$15 a month, even unlimited. That's it. Happy ending. Zero tears. Give it a try at mintmobile.com slash switch. Upfront payment of$45 for three months,$90 for six months, or$180 for 12-month plan required. $15 per month equivalent. Taxes and fees extra. Initial plan term only greater than 50 gigabytes may slow when network is busy. See terms. Close your eyes. Exhale. Feel your body relax. And let go of whatever you're carrying today.

34:38Well, I'm letting go of the worry that I wouldn't get my new contacts in time for this class. I got them delivered free from 1-800-CONTACTS. Oh my gosh, they're so fast. And breathe. Oh, sorry. I almost couldn't breathe when I saw the discount they gave me on my first order. Oh, sorry. Namaste. Visit 1-800-CONTACTS.com today to save on your first order. 1-800-CONTACTS.

From the publisher

Ed Elson is joined by Matt Smith to break down how the latest developments in the war with Iran are affecting oil prices and where he thinks gas prices could be headed next. Then, Charlie O'Neill joins the show to discuss China's new AI model, Kimi K3, why open-source models are gaining momentum, and what that shift could mean for the broader AI race.

Matt Smith is the Director of Commodity Research at Kpler. Charlie O’Neill is the Co-Head of Model Training at Baseten. 

Subscribe to the Prof G Markets Youtube Channel 

Check out our latest Prof G Markets newsletter

Follow Prof G Markets on Instagram

Follow Ed on Instagram, X and Substack

Follow Scott on Instagram

Send us your questions or comments by emailing Markets@profgmedia.com

Learn more about your ad choices. Visit podcastchoices.com/adchoices

More from Prof G Markets

All 416 episodes
Gas Is Back Above $4 — And Could Keep RisingProf G Markets · 33 min
Listen in VO