Anthropic Joins AI Energy Alliance, Apple Launching Servers

0:00Welcome to the podcast today, I want to talk about a bunch of breakthroughs AI news and buildouts when it comes to AI hardware. I think we've had a lot of talk lately about should we slow down AI. Should we not slow down AI pacing the frontier with Dario Amadei? But the one thing that I think nobody is debating is the fact that this AI is going to need a lot of a lot of power generation, a lot of data centers, a lot of chips and a lot of memory. And all of those things aren't something you could say, let's pace the development of because a data center might take 10 years to get a proper electrical hookup to it.

0:35These things, this infrastructure takes a very long time to get built out. The manufacturing facilities take a very long time, the planning that goes into it. So today I want to talk about some of the areas that we're accelerating on and some of the big advancements we're seeing in the hardware side. The first one I want to talk about is that Apple is going to is basically bringing back their server market. They're coming back into the server market. They're going to do this in 2029 with their M8 Ultra, and they're going to use NVIDIA Lynx. This is a market that they left, and I'll talk a little bit about that.

1:05I also want to talk about the fact that SK Hynix out of South Korea is in talks with Intel to make memory chips in the United States. If you have been following what's going on with AI, you know that memory is one of the massive biggest bottlenecks. And there are only three companies that are currently doing this specific type of memory. At the same time, we have NVIDIA, Google, Emerald AI, which are all launching something called the Alliance for Grid Flexible AI Data Centers. It's the AI Energy Management Alliance. And there's actually 18 members. So Anthropic is part of it. National Grid is part of it.

1:41AES, NRG, all of them are coming together to create an interconnected grid. There's some interesting statistics that go along with all of that. Now, if you're the kind of person that hates paying for subscriptions to all of those companies I just mentioned, like Google and Anthropic and ChatGPT and everyone else, I'd love for you to check out my startup, AIbox.ai. I give you access to over 90 of the top AI models. So you get Anthropic, you get Gemini, you get Claude, you get Grok, you get DeepSeek, you get Perplexa, you get all of the top models, image, audio, video, every top model and modality that you could want.

2:15There's 90 of them. It is$8.99 to get started and you use it by the token. So if you have a massive project, there's higher subscription tiers. But if you just want to test stuff out, you can chat with all of these different models in the same chat thread. And you can also connect them inside. So if you use Claude a lot and you want Claude to generate images, you use our MCP connector. And inside of Claude, images can be generated by ChatGPT or video by Google VO3 or whatever model you're working with. It is something that saves me so much time, and I hope it's a super useful product. It is AIbox.ai.

2:46I'll leave a link in the description. Let's talk about what's going on with Apple first. So this is 15 years after they killed X server. If you'll remember, Apple is looking to get back into servers. and how they'll essentially put this together is they will have four M8 Ultra chips and NVIDIA's NVLink Fusion. And all of this is how they're gonna be building out their new server, basically their new server offering. I think what's interesting here is we've seen a lot of, Apple is basically one of the people that, one of the companies that people have criticized heavily. They're like, oh my gosh, Apple's missing the AI boom.

3:18They're so slow. There's their new Siri, the Apple intelligence, everything was so slow. And yet, if you look at the stock price of Apple, it has not declined over this. They have actually made some incredible progress and it doesn't seem like the stock is declining. And one of the big reasons is because Apple, I don't know if it was accidentally or however you want to say it, but the hardware of Apple has been greatly used. And I think one of the big examples a lot of people will point to is when OpenClaw came out, basically everyone was running out to go buy a whole stack of Mac minis that they were running OpenClaw agents on.

3:51Now, I think that Mac mini craze was kind of short lived. It was kind of a quick moment. Obviously, the Mac mini is just a great, a great product. And so I think a lot of people would just use it as a as a good computer. But I think they Apple did see a very real very large explosion in sales because of that. And they've realized, hey, look, I mean, you're basically a little server on someone's desk. Why don't we make actual servers for companies that are paying, you know, crazy amounts of money? Is this something that's growing up? Scaling up as companies are looking to have their own virtual machines.

4:24They want their own agents in the cloud. I think Apple caught the vision, but they are probably a little taste of that. And so this is kind of the direction that they're they're moving towards. Again, this isn't going to happen till 2029. We know this because they said that this is going to be the they're going to have four M8 ultra chips. They just announced the M6 generation of chips in August. So the M8 line is at least two silicone cycles out. And so we know that the, you know, announcing it on the M8, it's going to probably be 2029. These servers are also going to probably incorporate NVIDIA's NVLink Fusion.

4:58This is the same technology that NVIDIA uses to stitch multiple chips into one logical unit. So, you know, they have their chips, but they're going to probably using NVIDIA to stitch them all together. This is interesting because Apple is already kind of, they had a pretty rocky relationship with Nvidia for a while, but they've turned back to Nvidia and turned back to their chips to help power the revamped Siri servers. So their relationship has been on the rocks for a while. It looks like they're defying that and getting back into it. And this is going to be a big part of what powers their new server offering.

5:29We have some big news out of South Korea. SK Hynix is in talks with Intel to make memory chips in the United States. The South Korean memory giant would use Intel's US fabs for the first time. This is probably a big shift in where HBM is going for AI accelerators and where they're going to get built. The reason why this isn't interesting to me is because there's only three major companies that are building this specific type of memory. And by the way, SK Hynix is what's making the memory that powers a lot of Nvidia's tech. So this is a major company. We have them, we have Samsung, and then we have one other company out of Idaho that is building these specific memory chips.

6:06And so this is really kind of a global bottleneck. But I think they're seeing that there's, you know, most of the demand is coming inside of the United States. Obviously, China is going to have a lot of demand, but there's probably could be sanctions or I'm not sure what South Korea's situation is there. I think they see the demand coming out of the United States and they want to move closer to it. They're also making this the interesting part is the relationship they have with Intel right now. Intel right now and Intel Foundry has basically been searching for an anchor customer to justify a massive US manufacturing build out.

6:37They've been talking about this for a long time. We know that Intel stock was sliding and, you know, kind of, I don't want to say cratering, but Intel has struggled for a long time. It really should be one of the big companies we're talking about all the time. And we have the old CEO lead, we brought in a new CEO and Intel's been on kind of a generational run for the last little bit. They made a lot of partnerships with the United States government. And so it feels like Intel is kind of getting its mojo back and they're making a lot of moves. They recently announced a massive build out, US manufacturing build out.

7:06And with that, they need customers. And so it looks like SK Hynix might be one of the big customers that's going to start building in their US fabrication facilities. This is all according to some reports by routers. This particular deal would be the first time SK Hynix produces memory in the United States. Traditionally, it's all been done in South Korea. SK Hynix is also basically the dominant supplier of high bandwidth memory to NVIDIA's AI accelerators. So it's, you know, just kind of speeding up the supply chain on a lot of that. We also have NVIDIA, Google and Emerald AI, which are launching a alliance for what they're calling grid flexible AI data centers.

7:44This is called the AI Energy Management Alliance. There's about 18 different companies that are inside of this. What's interesting with this, it was just launched this month and founders emerald ai google and nvidia are all estimating that flexible flexible data centers could unlock 100 gigawatts in the existing u.s grid so what they're saying is that essentially the united states the u.s power grid is only running at about 50 utilization on average and i mean you could imagine there's peak hours and sometimes when that happens in california or texas you hear about like blackouts or brownouts or you know when there's a big storm and their parts of the grid go down, like there's all sorts of issues.

8:23But generally speaking, on the average day, we're sitting at about 50 % utilization is probably like peak hours in the evening time when everyone gets home and is charging their electric cars or and you know, in the middle of the day, when people are at work, it's lower in the middle of the night, it's off, right. So there's ups and downs in this, but it's on average about 50 % utilization, their thesis on this, there's actually something called brattle group, and they're estimating that each 10 % gain in grid utilization is going to lower electrical rates by about 3.4%. So they're saying, look, we have the capacity to generate double the electricity.

8:57If we went from 50 % to 60%, everyone's electrical costs would drop 3.4 % because there'd be more abundance in electricity. And so it would just, I mean, I think it's, a lot of it gets down to like at peak usage times, you're not going to be paying peak prices. And so if there's just more electricity, there's more surplus the peak i guess would be smaller and so you'd save money so that's their estimation nvidia digital reality and emerald ai are going to switch on and they're about to switch on about 100 megawatt power flexible ai factory in virginia later this year so this is obviously something they're looking at getting power for these data centers and for a lot of these projects is an absolute nightmare it's it's very tricky apparently u.s data centers currently wait up to 10 years or more for a grid connection under some of the existing interconnection processes.

9:45And this is why you had Elon Musk when he stood up his Memphis facility, he literally went and just, you know, purchased every portable diesel generator he could get and shipped it over to the facility. And instead of plugging into the grid, just powered the whole thing off of diesel generators, you know, much to the chagrin and a whole bunch of lawsuits about like pollution and that kind of stuff. But this is how he got the data center up and spinning. And lest you think it's kind of random. I mean, that data center in particular, he's building much bigger projects. But that particular data center is making a billion dollars a month, about 900 million, a billion dollars a month, roughly renting their their extra space, their extra compute to Anthropics.

10:25So Anthropics paying them a billion dollars a month. The only reason they can make that much money, though, is because they kind of threw this together in a, you know, in a sort of not traditional way. And so a lot of these data centers aren't looking to go and rent every portable generator. I think SpaceX or I guess it's SpaceX now it was XAI at the time when they built this thing. I'm sure they've kind of they built in some more sustainable. I'm hoping they've built in some some more sustainable power generation methods. But at the end of the day, these things are very hard, very tricky. So the goal of this new alliance is to figure out how to plug into the grid and just increase the grid's utilization.

11:00The costs should come down for everyone, but they are also gonna be able to plug in a lot of these big data center projects. It's a problem we're gonna have to wrestle with. China is absolutely out accelerating us to an insane degree when it comes to power generation. And if we wanna power all of the projects that are currently under construction, we need to solve this. So this appears to be the solution that is being looked at by many people. Guys, thank you so much for tuning into the podcast today. If you enjoyed this episode, make sure to go check out AIbox.ai. Leave a rating and review on the show wherever you get your podcasts.

11:30It helps the show out a ton. if you wouldn't mind. And make sure to go check out AIbox.ai if you want to get all of the different AI models plugged into ChatGPT or Cloud or wherever you do your work, cursor, et cetera. You can get 90 different AI models plugged into that so you can do audio, video, image generation all inside of the same workspace. Thanks so much for tuning into the podcast and I'll catch you guys all in the next episode.