

Whether AI’s growing power demand can be met by shifting from massive “gigawatt-scale” data centers to smaller, distributed data centers (25 MW and below, often behind-the-meter), and how that intersects with grid constraints, power quality, and politics/regulation. The episode also discusses how NVIDIA’s leadership turmoil could affect AI infrastructure investment and data-center buildouts.
Written by AI. May contain mistakes.
The hosts introduce themselves and discuss recent news, including NVIDIA's CEO resignation.
“I'm the executive editor of Latitude Media.”
Discussion on the implications of Jensen Huang's resignation for NVIDIA and the market.
“Other affair allegations have come out in the last day or so.”
Analyzing the strategic decisions of NVIDIA and their impact on the AI infrastructure buildout.
“Yes, and has reportedly pushed back on some of the deals that Jensen has pushed through, again, to support data centers and chip sales.”
Explore the corporate dynamics and stability challenges faced by major tech companies.
“Also, everyone is so watched, and it is so corporate.”
Delve into the concept of distributed data centers and their potential to solve AI infrastructure issues.
“Jigar has been beating the drum on smaller distributed data centers on this show for a while now.”
Discussion on the current state of power distribution and potential concerns regarding outages and power quality due to spiky demand.
“when they saw the load curves beginning to shift.”
Exploration of the benefits and implications of distributed computing on the power grid and infrastructure capacity.
“So my definition of distributed compute is generally these data centers being put onto the distribution grid.”
Examination of how utilities are addressing load growth and utilizing modern technology for better grid management.
“I'll be a little a bit of a contrarian on Jigar on this.”
Discussion on the feasibility of smaller data centers and their strategic placement in relation to existing power plants.
“I think we need to, this is actually a really fascinating part of the conversation, but I want to take a step back and talk about how viable is this compute model.”
Analysis of the potential for EV charging infrastructure to incorporate data centers and the regulatory challenges that accompany it.
“And the bulk power system's already there.”
Discussion on co-location data centers, residential models, and the challenges of integrating GPUs.
“But there seems like there's, you know, I think there are many gigawatts available of capacity and only growing as we build out more and more L3 chargers.”
Analysis of election results and their implications for data center regulations and energy policies.
“I think by now everyone is really sick of the phrase blue tsunami.”
Discussion on the importance of innovation in the industry for sustainable change.
“no, let's be the company that innovates on the commercial offering and integrate something that speaks to all parts of the problem here.”

Get the gist, explore an idea or ask about something said.
On Open Circuit, what are the key points of this episode?
Automatic transcript. May contain errors.
0:02Latitude Media, covering the new frontiers of the energy transition. You got around your corporate firewall. Yes. I think we're just being extra cautious. You know, all those Chinese spies out there. The power of being an executive. You too can jump the corporate firewall if you need. Which makes you question the firewall to begin with.
0:26In 2017, Anthropics CEO Dario Amadei, who was then a researcher at OpenAI, wrote a memo that set today's infrastructure boom in motion. Called Big Blob of Compute, it argued that the only way to build general-purpose AI was to make the models bigger. Clever, narrow models were not the answer, he argued. Rather, it was more compute, more data, and longer training runs. That research hypothesis turned into the operating philosophy of leading AI companies, and that blob grew into something physical. Gigawatt-scale campuses, nuclear restarts, gas plants, big batteries, and a build-out now measured in the trillions of dollars.
1:02We've been sold a very specific story about the direction of AI infrastructure. Bigger is always better. But is it? There's no question that we need way more computing to push the frontier of general-purpose models. But large data centers face so much opposition and so many constraints, there's a debate over how that computing gets built. Should it be, can it be, far more distributed? Rather than taking up thousands of acres, could the computing live in smaller warehouses, empty office space, or even homes? This week, we'll look at emerging models for distributed computing and how they're becoming a distributed energy play.
1:35Plus, we'll dip back into some post-midterm commentary and talk about the fallout from Jensen Wang's departure from NVIDIA. That is coming right up on Open Circuit.
1:48Open Circuit is brought to you by Everyday Electric, formerly known as Renew Home. Utilities are investing$1.5 trillion in the grid over the next three years to meet soaring demand. and Americans are asking, how will it benefit me? Growth and demand can be a great thing for actually reducing rates for everyone, but only if the system becomes more efficient. Ben Brown is the CEO of Everyday Electric. With six gigawatts of flexible capacity, Everyday Electric empowers customers to take part in that transition and helps the grid grow responsibly. So yes, you need to build infrastructure, but you have to increase utilization of the system we have.
2:25We have to find ways in which to drive savings, both to households that are part of virtual power plants, because if you do that at scale, it actually drives savings for everyone. From batteries to thermostats to electric vehicles, homes around the country already have the energy products that could save them money while providing more capacity to the grid. Since its founding, Everyday Electric has been working toward a more affordable, more reliable system for everyone. Now that we are reaching scale, there's just these amazing moments in time that we can unlock 50 megawatts or 100 megawatts of resource across every major climate region, every major utility.
3:00Later in the show, Ben explains how VPPs can meet utility growth while driving down rates for everyone. To learn more, visit everydayelectric.com. Giving Tuesday is December 1st. Time to put climate giving on your year-end checklist and apply the same due diligence you would with any investment. That's what Giving Green does. Giving Green researches the strategies and nonprofits best positioned to unlock the next big climate breakthrough and sends 100 % of every dollar donated to the Giving Green Fund directly to them. Maximize your impact per dollar. No cuts or guesswork. Make your first gift before 2027, and it's matched up to$1 ,000.
3:38Go to givinggreen.earth. Open Circuit is brought to you by Energy Hub. Energy Hub's DERMS platform gives utilities flexible capacity. they can stake their grid planning on, coordinating batteries, EVs, thermostats, and commercial and industrial sites through a single system. Utilities unlock a partner ecosystem that covers more than 90 % of connected DERs in the market and integrates seamlessly into existing infrastructure. The scale is proven. More than 230 utilities across North America trust Energy Hub to manage over 3.5 gigawatts of flexible capacity. Learn more at energyhub.com.
4:20Welcome to the show. I'm Stephen Lacey. I'm the executive editor of Latitude Media. We have another full roster today. Jigar, Shah, and Caroline Golan are with me as always. Jigar is the co-managing partner of Multiplier. Jigar, small data centers, distributed data centers, is this the episode you've been waiting for? No, but I will take it. I will take it. What is the episode you were waiting for, just out of curiosity? I mean, I still am obsessed with vehicle-to-grid. I know, yeah. You have talked about that a lot. I was hoping you were going to say when we're in Barbados or something like that, but no.
4:57Well, I mean, did Elon say that every Tesla was going to become a distributed data center? Yeah. I mean, he says a lot of things, though. Well, that relates to the episode that we're having. I don't know, Jigar. I'm a little disappointed because I thought we're hanging out at Climate Week, and you were so excited about talking about this topic. I was a game for this. I'm excited about a lot of things, especially when it comes to you and AdHoc. I think the world will be best. Oh, thanks, Jigar. Appreciate you. That voice you hear is Jim Capsis. He's the founder and CEO of the AdHoc Group. He also authors the GIST newsletter, and he has been spending some time thinking about distributed data centers lately as well.
5:32Hey, Jim. Good to see you. Thanks for having me, guys. Yeah, great to have you on. And of course, Caroline Golan is the Chief Growth and Policy Officer at NRG. You had your work cut out for you after the election. Did this week and last week just lead together into one? Cool. Figure it all out. Rate freeze. Rate freeze. Move on. We're good. All right. Before we get into the big questions about distributed data centers, let's just focus on the biggest story in the news right now. CEO Jensen Huang has resigned after revelations of an affair with a direct report and a woman suspected of being a Chinese spy.
6:10Other affair allegations have come out in the last day or so. NVIDIA is seen as Jensen Wong. Jensen's been personally responsible for many of the deals with other AI companies that help finance chip purchases and data center buildouts to the tune of around$530 billion. So if NVIDIA's stock continues to take a hit, or if it starts to pull back on those deals, what are the possible downstream consequences? And I think those consequences connect to the topic today. Caroline, do you think this is going to eventually lead to some meaningful shift in the infrastructure buildout? Well, I do think NVIDIA has been a strong investor in what they believe is the right way to build infrastructure.
6:56And, you know, and that is to Jensen's credit and I think to the people that he surrounded himself with. Apparently, they didn't give him advice in other points of his life. But I do think they have been that. And, you know, and I think both, I've met him before, and he's an incredibly charismatic man. And he's very committed to the concept that AI is inevitably what is best for everyone and the entire community. And he did push NVIDIA oftentimes to make investments that would never pencil. but his view was if it made the infrastructure of AI better, then in the long run, it was better for the overall narrative.
7:41And that really came from him. And there are many people, I think, of NVIDIA, some of which I've worked with and some of which have been there since employee number five or six who have carried this mantle. So with new leadership, he really ran that company like command and control, right? So it's going to be interesting what the board does with this and what new leadership does and how they redirect. I will also tell you, I mean, anyone who was looking at that knows that Jensen, to his credit or to his own, you know, political risk, has been hand in hand with Trump and the administration. And NVIDIA is on the list that Dems are going to go after.
8:26and there are tons of questions about, you know, what NVIDIA's relationship has been and Trump's, you know, profiteering with that relationship. And someone's going to take the fall for that at a lot of companies. So it's not actually surprising to me, both for his poor judgment in his personal life, but also what's probably facing the company that they made this decision when they made it. Everybody on that board is lawyering up right now. Yeah, absolutely. As a former national security professional, I'm just horrified on that level alone as to how this was allowed to happen. And also, who knew what and when did they know it on the government side?
9:11And I think we'll see what happens with hearings next year or whatnot. But still, a lot of questions. Maybe there's not as much there as there may seem to be. But I've got to think this is a story that's going to keep unraveling over time. And so there's a lot more that we're going to learn. I absolutely agree. Yeah, particularly on the government side. I think that's where the set of questions are targeted now. Jigar, what do you think? The interim CEO, the former CFO is someone who has reportedly – Is female. Yes, and has reportedly pushed back on some of the deals that Jensen has pushed through, again, to support data centers and chip sales.
9:50What do you think this does to NVIDIA strategically, and what effects would that have on the build-out itself? I mean, the problem I have with Jensen, but also other people as well, and I certainly didn't know anything about the national security stuff or anything else, is that I think there is a feeling that they can take this global commons that we've created, like the grid, and manipulate it to their will so that they can become wealthier without any collateral damage to the other people using those global commons. and that's the thing that I always viscerally reacted to. And I don't think that he thinks any differently today than he did when I told him he was a dumbass in 2023.
10:37I don't know if you've seen all the investments they've made in energy. They're the most harebrained ideas I have ever heard of. Like some of these concentrating solar projects and long-duration energy storage projects and all these technologies that you and I both know don't work and have not worked. But like they were supposed to magically solve all these energy problems. I just, the level of selfishness just never ceases to amaze me. I've said this before. None of the hyperscalers or the big chip companies thought that it was their job to fix the grid. It was their job to win the AI race. Fixing the grid became a barrier.
11:15And poor people on the grid be damned. Poor people on the grid be damned. Now, okay, but like they didn't, that's not their mindset, right? Their mindset is, I have to win this AI race or China is going to. Totally. And that's what they were going after. Fixing the grid became a hump in the Everest that they were climbing to win this race. And I think what the approach that Jensen took was, well, there's a lot of stable capital out there to fund the things like natural gas and solar and wind. and he wanted to fund the stuff that he thought no one was funding. And it didn't make sense as an investment thesis, but I think he invested in some great shops and some great ideas.
12:06And I don't know how much of it was actually Jensen, but I do know that, you know, very famously, there were people on his team who said, we try to pay as much as we can to our supplier partners because we want them to succeed. And I do think he brought a different perspective to it. You know, was it calculated and was it informed by excellent modeling of what is best needed to lower rates and increase the resilience of the grid? Obviously not. Obviously not. But it was informed by people who thought that they like had a vision and were very hungry and, you know, could raise millions of dollars off a slide deck.
12:43But we should let him off the hook because he clearly didn't have the resources necessary to get smart people around him. I'm just saying, like, I'm just saying let's not negate the good that he did just because he can't keep his pants zipped up. That's all I'm saying. Go ahead. I was going to say, I'm hopeful. I have this sort of, maybe it's overly optimistic, but I think we may be in this sort of both cultural and market moment after the election. Now, with what's happened with Jensen, I'm like a little bit of a reset of like, you know what? But this is like an explanation point of this is as usual is over on data centers.
13:20And it's already true by heading into the election. It's very true on the other side of the election. And I think this exit and how big a deal it is means that is he key man risk not just for NVIDIA, but for the market. And I've got to hope that it's not for the market, because if that's the truth, then we really have built this market on a bunch of sand. It's really about one guy. I do think they are somewhat outliers in the market. Like, I was talking to a friend about this last night. Let's say the same story ran at Google. There's succession plan. There's transition plan, right? Also, everyone is so watched, and it is so corporate.
14:07at Google, I don't see how all of this could have happened, right? There are so many internal checks and balances. And that is the difference between a company that was 15 years ago making, you know, video game parts, and now is the biggest company in the world, right? And so, like, as hard as it is, as someone who has been in that corporate bureaucracy for quite some time, it does produce a level of stability when shit hits the fan like this, you know? And, like, NVIDIA didn't have that. It was ruled like a monarchy. Yeah. And I'm also preoccupied with a set of really practical questions, which is what happens?
14:45NVIDIA is taking all these equity stakes in NeoClouds. What happens if they draw back on that support? Are they going to continue supporting that massive SB Energy Ohio site for open AI? There's a lot of large load tariffs that require collateral? And so if NVIDIA support weekends, will customers have to post more collateral? The CFO has already answered those questions. Like I think in general, she basically said what we've all been saying, right? Is it the thing with Jensen Huang, which I love and Elon Musk, which I also love. Wait a second. Steven, don't look for the logic. Right. Is that they create their own distortion field, All of it is just one big distortion field.
15:32And what Jensen understood about CoreWeave and everything else was that once you start to break the distortion field, it all comes crashing down. People have to believe in something they can't see to continue to invest this money, whether it's with SpaceX or whether it's with CoreWeave and the neoclounds. What the CFO basically said was that she is not comfortable with any of these financial positions that they've taken, and she's going to be reevaluating all of them. And my sense is that if this distortion field breaks, then you will have the correction that Jim was suggesting. And it's not because AI is not a real thing.
16:15I think it is a real thing. But it is very clear that people are front-running their investments before you see the level of revenue growth necessary to justify those investments. And Jensen wanted that to continue. And now we'll see whether it continues. The erosion of institutional trust in this country is going to get even worse. And so I think what is particularly interesting about this timing is that it's happening on the heels of a major populist movement in politics, a change in the guard in electeds, who ran on the sentiment of these oligarchs have ruined your country, right? And here falls the first.
16:57But if the Chinese spy and the sending of scrub servers to China, all of that proves out, I think the flame that's already been lit on the political regulatory clampdown on data centers becomes a bonfire. I think this is that moment of maybe the trust rebuilding. It's like the folks that people have not been trusting, that might get worse for them. Yeah. And I think Chigurh, leading up to this, we were talking about the election and some of the different new governors and what's happening in these states. And I said this to some of the hyperscaler folks before the election. I'm like, you guys don't have a lot of time to figure things out.
17:44Like, there's a presidential race that's starting. Oh, the presidential race starts in two weeks ago. But the minute folks put out their positions on data centers, which are being written by Jigga right now, then, you know, then it's sort of game over. So I think that the governors are going to have to stand up, which they're going to do, and they're going to say, here's the way forward. and they're going to have to be viewed as, whether this is how real it is and how much it's manufactured behind the scenes, the hyperscalers are going to have to be viewed to be being dragged to the table, like with the finger being waved at them and saying like, if we're going to build, this is the way we're going to do it and you're going to do it this way or you're not going to do it at all in our state.
18:34And even if they were willing to do it in the first place, it has to... Yeah, you said the optics of punishment over proactive, yeah. And I think that, like, I know, Jigar, you end up talking to a lot of the hyperscaler folks, too. And I think that they're, you know, they're people, they're emotional about this stuff. They're like, well, we think we're doing some of them. We think we're doing the right thing. We think we're doing all these great things. We're not getting any credit for it. I'm like, I don't care what you think. Because the voter doesn't think you are. And the people in power now need to show the people who elected them that there's a new way.
19:07And that's your only hope. And so you better get on board. And if it means that you're going to look like the bad guy, you're going to have to accept that in the short run. And I just think that's the reality of the political situation they find themselves in. And then we can talk about distributed data centers, which I think is a whole other opportunity. Yeah, let's get there. Which is also what we're going to force ourselves into. Well, and I think the utilities are in the same place, Jim. In terms of what? Yeah, I think by those of you, you're going to respond. They're going to have to look like they are taking it on the chin from the governor to earn the respect of the voter back.
19:39I think you're right. Yeah, again, and the same thing for them. I spent a lot of time with utilities. They believe they're doing the right thing most of the time for their customers. I mean, I was at EEI in June, and it was all, oh, why doesn't everyone understand how great we are? I'm like, that's the wrong message, guys. I mean, it's like, read the room. Read the room. Right, it's like, read the room. 100 % read the room. And again, we can debate, you know, how much is true or not true. But it's the perception, and therefore you've got to figure out a way forward that, like, is going to be acceptable so you don't lose your social license to do the things you want to do.
20:19I was wondering how long it would take us to get from Jensen Wang's affair to utilities. Here we are. I was just wondering how long it would... Jim, you're going to be on every week because when you keep saying, Jigar, I agree with you. Jigar, I agree with you. I mean, it is a masterstroke. Those might be the three times I've ever said that, Karan. Don't worry.
20:45Earlier, we introduced you to Ben Brown, CEO of Everyday Electric. Ben has been pioneering smart home technologies and virtual power plants for 20 years. With electricity prices rising fast, those flexible resources, solar, batteries, EV chargers, smart thermostats, are more important than ever before. It's really important to understand that, yes, we are in an energy affordability crisis, but I also think that because of that, we have so much energy and so much focus going into how we can dig ourselves out of this. And a new study from the Brattle Group backs this up. It finds that residential VPPs could cut expected electricity bill increases in half over five years.
21:22There's just a massive amount of value that can be brought to homes when you increase the efficiency of the system, the utilization of the resources on the system, and not just for people that are part of those virtual power plants, but their neighbors, the communities around them. That can mean$4 to$7 billion of savings per year for Americans. Everyday Electric already coordinates the largest residential VPP in the country, and it's working with device manufacturers to make participation effortless, unlocking more savings and more flexibility for the grid. It's really important to think about that cross-orchestration and think about that whole home energy fabric.
21:56Being able to think about unlocking savings across every component of our home. Making electricity more affordable isn't just about what we build next. It's about getting more from what we've already built. Learn more at everydayelectric.com. Giving Tuesday is December 1st. Time to put climate giving on your year-end checklist and apply the same due diligence you would with any investment. That's what Giving Green does. Giving Green researches the strategies and non-profits best positioned to unlock the next climate breakthrough. Climate impact is difficult to quantify, but Giving Green's research suggests a donation to one of their top climate non-profits is roughly 10 times more effective than a high-quality carbon offset.
22:36And the Giving Green fund sends 100 % of every dollar straight to them. Maximized impact per dollar. No cuts or guesswork. Make your first gift before 2027, and it's matched up to$1 ,000. Go to givinggreen.earth slash circuit to claim it. Utilities don't just hope flexible capacity performs. They need to be able to stake grid planning on it day in, day out. Energy Hub's DERM's platform is trained on over a decade of real event data from 2.6 million connected DERs. That means utilities can forecast available capacity with accuracy, optimize dispatch across any DER type or ownership model, and maintain visibility across their entire system.
23:18The platform integrates across more than 80 OEM and aggregator partners, giving utilities the reach they need as markets and regulations change. Consistent, verifiable, affordable, Energy Hub is the flexibility platform for the modern grid. Learn more at energyhub.com.
23:40Let's talk about distributed data centers now. Jigar has been beating the drum on smaller distributed data centers on this show for a while now. And in the last year, they've gained attention as a possible solution to AI infrastructure bottlenecks, a way to perhaps avoid costly grid upgrades, reduce opposition, even give homeowners a financial stake in AI, use empty offices after COVID. And this is morphing into a distributed energy story as well. This spring SPAN unveiled Exfra, this 16 GPU compute node that sits inside a house and pairs with a smart panel and batteries. SPAN CEO, Arch Rao, made some big claims about the cost here, saying that it would be$3 million per megawatt and take six months to build versus three to five years and$15 million per megawatt for a 100 megawatt data center.
24:36And then we've seen a bunch of commercial activity. So Sunrun launched a pilot that pairs with AI compute nodes in the home. SPAN and Sunrun have partnered up on this. On the commercial building side, Perimeter came out of stealth with plans to put GPUs in office buildings. Telecom companies like Comcast and Spectrum have been doing this for a little while, putting GPUs at their network facilities. And then, of course, we've been talking about NVIDIA, which has pursued partnerships on different forms of distributed computing. So added together, maybe not that much capacity right now, but there's a lot of excitement in this space.
25:10Jim, you have been thinking about this and writing about this as well. How are you defining a distributed data center? What caught your eye about this market? Yeah, well, I mean, distributed at its simplest basis is small. Small data centers, you know, tens of megawatts or even smaller versus the hundreds of megawatts or gigawatts campuses that we're seeing. I think most people when they're talking about distributed compute, especially when you start talking about edge computing, which means that the computing is really close to where the device is or on the device itself that is doing the calculations.
25:47That means you're really talking about inference, which are like you're calling your AI, you're asking it a question in a moment, and it's doing a calculation as opposed to training all of the time. So I think there are different flavors, but I think those are the ways that I'm thinking about it. In terms of what's interesting to me, I had a conversation this summer with a utility executive in a major urban, major city. And I asked this executive, hey, what's the latest with you in data centers? Because given your territory, I doubt there are big data centers being built because you don't have a lot of land.
26:24I said, what about distributed data centers? and his response was, you know, I'm hearing a lot of rumors about people doing behind-the-meter data centers, but I wouldn't know what they're doing. And I was like, what do you mean? He's like, well, if it's behind the meter, and there are a bunch of negotiations going on, like, I wouldn't know. And that struck me as like, oh, shit.
26:52And I've been part of the number of conversations starting this summer, and you guys have reported a latitude, There are a lot of companies, developers, other companies knocking on doors at big commercial real estate buildings downtown in the suburbs saying, hey, you got some capacity that I could use? I'll give you a check, right? And I'm going to come in and develop something at your site. And so my first instinct was like, wait a second, are we going to repeat the same mistakes that we've made with the big data centers and go really fast and go make a buck? Because, of course, I mean, capital is going to flow where there's opportunity.
27:33And we're going to have a problem when we get too much behind the meter we weren't expecting and the power is going to go out. So that was my original concern. Yeah, and you compared that to the cannabis industry, right? It's probably the same salespeople, too. Sure, right. Grow houses came out of nowhere, and suddenly utilities are saying, it's true, it's a great analogy on many levels. And, yeah, the same salespeople, let me tell you something. And they found out later when they saw the load curves beginning to shift. And so I definitely spent some time talking to the utility folks about this.
28:06I'm a little less worried now about that problem. I mean, I do think it's important that the utilities and the regulators and the developers of any site, as much as possible, this is happening out in the open and not behind closed doors because I do think that there's some real potential risks. But I'm less concerned that you're going to have actual outages as a result because the way that my understanding of the distribution system and how it actually operates is that a building, in terms of its capacity, if you get to the point where you're hitting that threshold, the power building's going to go out but it's not going to cause an issue on the feeder so I'm a little less worried about that but there are concerns about power quality especially with inference and so I've talked to a few utility distribution people who have said that like if you have too much inference happening all at once in a given area you could definitely have issues with power quality that could lead to like something going wrong on the distribution feeder.
29:13But these, by the way... Because it's so spiky, right? Because it's so spiky. Exactly. It's like, search, boom! And then it comes back down. Search, boom! It's not just constant, right? Like a big data center. And those spikes can be problematic if you don't have the right power conditioning. The voltage and harmonics. The voltage and harmonics and all of that. But these are, I'm told, and you guys have heard, these are solvable problems and not like showstoppers, which is what I was originally worried about. I will tell you what Jigar will say. Storage. That is the solvable problem. He's not wrong.
29:49Storage, right? I got it. I mean, he's not wrong. He's part of the solution. Well, Jigar, there's a lot to unpack there on how this computing interfaces with the grid. Maybe you step back and make the case as you see it for distributed computing. Like when you think about this space, What size data centers are you talking about? What workloads are they serving? And why does it matter? So my definition of distributed compute is generally these data centers being put onto the distribution grid. So they're not connected at transmission voltage. They're being connected on distribution. And so generally that's 25 megawatts and below, but I mean, it could be higher, I guess.
30:34I think that the reason why this topic fascinates me so much is because of what Jim just said, right? When you think about just how much capacity is in the existing infrastructure that we have that goes underutilized. I was talking to Prologis the other day, and they were saying the number of customers that we have that requested 5 megawatt, 10 megawatt, 20 megawatt interconnections, but they're only running at 25 % of their total connection size because they haven't gotten Elon's robots yet, or they haven't gotten full automation yet, or they haven't put in all of the EV charging infrastructure for their heavy trucks yet.
31:19So now they're looking to put data centers in that extra capacity. So when you think about just how low our asset utilization is of the wires that we paid for, it is abysmal. And now we are forcing the electric utilities to come to the table to just admit how low that number is and what their plan is to do something about it. And so I love this conversation because it lays everyone naked and they're now going, oh, yeah, we were pulling the wool over your eyes before. And we do have the ability to actually figure out a way to accommodate double the load growth on some of these feeders by reducing peak.
32:06And we do have the ability to put in some tourist flywheels in strategic places like Rocky Mountain Power is doing, etc. And I'm like, oh, you're admitting that modern American technology works and you were piloting it to death for no reason? Fascinating. Tell me more about how this load growth could get accommodated faster and how you could use modern American technology to integrate it now. Tell me more about how adding more kilowatt hours to the distribution grid would reduce rates for everybody, Patty Poppy, when you're on stage talking about how data centers are the only way that you can make electricity more affordable in California.
32:48I love it, and the popcorn is popped. I'll be a little a bit of a contrarian on Jigar on this. I think he likes to take his swings against the utilities, but I think the utilities are already looking at how to actually use their grid more efficiently for the reason that you just stated. I mean, literally, I think the joke in the utility industry about the whole idea of grid utilization is like we're utilities. Like literally utilization is what we're supposed to be doing. And so a lot of the ones I'm talking to, they welcome this conversation. They don't feel as if it's being imposed upon them.
33:26There may be sure of some. You guys had Todd Conner on the show. Well, we're passing laws in 30 states, so let me know whether they're for it or against it. I think what is definitely true is that utilities have been largely blind on their own distribution systems for a long time. I mean, up until recently. And in fact, many of them are still pretty blind because maybe this is making one of your points, Jigar, I don't know. But there are companies that have technology that they can avail themselves of, and some are, that can actually help them understand what is happening almost in real time, if not real time, down to the transformer level.
34:08Instead of just using heuristics, engineering assumptions about what the distribution system can handle. And I think the fact that they have that data, and that's being used, I mean, Excel as an example, through how they're looking at and trying to find places to put batteries, right, for the filing that they made in Minnesota and the work with SparkFun that you guys, I think, talked about before on the show. Like, that was like software that they availed themselves for, you know, working with a company called Britsight that we work with out of Australia that is able to do that. And that was not true two, three years ago.
34:44It is true now. So they have the tools. So I think that where I will agree is that the tools are now there for utilities to know what is happening on the distribution system. They now need to deploy those tools at scale, and then they can actually find where that capacity is. I think we need to, this is actually a really fascinating part of the conversation, but I want to take a step back and talk about how viable is this compute model. And Caroline, I'm wondering if you, when you were at Google, I mean, obviously a lot of workloads are shifted across geography and data centers. But if someone came to you and said like, we are going to compile however many 20 megawatt data centers or 10 megawatt data centers, like, is that even viable for a company like Google?
35:28When I was there, it wasn't something we were looking into. And I don't want to speak for Google. I don't believe it's still a primary agenda. I think that the lens by which the hyperscalers were looking were economies of scale at the time. And this was based on having a land bank strategy and the belief that there was more capacity in the system than there probably was, right? And so that hadn't really hit. And the other reason why I don't think that it hit is because we had already a cloud market infrastructure, right? And so a lot of the edge compute and neocloud world has evolved as the more micro version of what cloud was.
36:13But cloud was inference. It needed to be a certain radial proximity, largely Virginia, Ohio, to where network was and where end use was, right? So that wasn't a novel idea. I think we've focused on the C &I side of this, but I do think where the hyperscalers are interested more so is behind power plants that actually aren't being fully utilized because prices are soft or because it's areas where there isn't as much demand. And so going behind, you can fit 50 megawatts behind a, you know, a gigawatt, two gigawatt power plant, right? And so I see more of a movement there right now. And the reason is because it's a single contract, right?
37:08You're only signing a contract with that supplier as opposed to also having to sign a contract between the supplier and the CNI or the CNI customer and the NU's. And the bulk power system's already there. So, you know, in terms of their harmonics constraint, you have a much more headroom. So I've seen that from the hyperscaler community. It's just the world they know. I think they get a little nervous when it's their brand. And when, you know, a Walmart or a big office building is like, we have a contract with Google. That means that they have to manage their brand with that endpoint customer.
37:49as opposed to saying we have a contract with no name edge provider. It's not as big of a risk. So I think it's also about brand management. However, what I'll tell you is that everything that just happened in Ohio and what we expect will continue to happen across the country is going to force, I think, more edge compute or smaller compute in this way because people are going to be doing, companies are going to be doing the trade-off between do I just let these chips depreciate and lose my X billion dollars I've invested here or take a risk on what might be spotty, but at least potential compute or training?
38:29And so I do think you'll see a shift in that. What I think is interesting is that that headroom, as Jigar sort of alluded to, that headroom is sort of the headroom that many analysts have seen as the potential for EV charging. If that gets eaten up by, you know, edge compute, what are we doing to accommodate for, you know, potential electrification, continued electrification of the grid and continued electrification of transport? Can I break down, Stephen, where I see like a few of these different opportunities in the world? I think Caroline definitely touched on a few. So like one, to be very explicit, like the co-location with existing generation, which you mentioned, and there are definitely some companies focused on the renewable side, right, that are doing this.
39:17There's a startup called Rune. There's a startup out of Australia, Windy Sea, that's going to have, they claim, 250 megawatts deployed next year and have big ambitions beyond that. And so I think that's one. There's placing them at substations where there is headroom. So utility-owned substations. I think EPRI has done some studies there and is piloting something at one or more substations. So that's interesting. there's the actual, like, the commercial buildings themselves. I'm a little less optimistic that there's many opportunities inside buildings because it turns out retrofitting a building to make it work for, like, a data center that, like, can actually handle, like, the most sophisticated chips.
40:00Fire codes, the weight of the servers, yeah. Fire codes, cooling, like, fiber, all these things that you need, it seems really hard. There might be some edge cases where it works, but I think really hard. I think if you can find maybe in suburban, ex-urban parks, like buildings that have parking lots and have large interconnects and have headroom, you could stick a modular data center, like a prefab data center, right? Like there are companies like Armada or Flexnone and others that are like in that market, Crusoe, et cetera, and those can get deployed. And I'm kind of interested in going, you mentioned EV charging.
40:37We are seeing a good amount of money going into, despite where we are in EVs at this exact moment in this country. Although, as a friend of mine just said, the Iran war might have been the best thing for climate that Trump ever did. But if we start moving in the right direction on EVs, we are building a good amount of level three chargers in this country. But the utilization rates aren't particularly good. I mean, I think on average, it's like 15%. In the most used areas, it's like 30%. I mean, that's a lot of opportunity. Those are really big interconnects, and there's a lot of capacity there.
41:14And so I've been talking to folks in that space, and they're looking at it. But where it's going to get really interesting is, well, I think it's a big potential opportunity. the way that those were set up is that with regulators and utilities is that there are special EV rates that those facilities are on. And the way that those rates were written, you can't actually add something like a major additional load and still be on the EV rate. So either they're going to have to make changes to the rate structure, which the good news about that is that will be out in the public, it'll be transparent, there'll be a conversation, it may take a little while, or I was talking to my team about this having looked into it it may be possible to switch to opt out of the EV tariff just go on to a normal CNI tariff and co-locate a data center and now you're no longer on the special tariff you're just on your normal tariff but you don't care because you're using so much power you're getting so much revenue that everyone's ending up better off in the end so I think I'm really intrigued about that space we'll see how it evolves but there's going to be some regulatory work that has to happen potentially.
42:24But there seems like there's, you know, I think there are many gigawatts available of capacity and only growing as we build out more and more L3 chargers. And those L3 chargers are getting bigger, right? It's not like 250 kilowatt hours in Europe. I think now they're deploying 1 ,000 kilowatt chargers. We're going to see bigger chargers with larger capacity, which might be a good opportunity for co-location and more utilization, Jager. What do you guys think about the residential model led by Span and Sunrun? The home battery provides backup, grid services, and also keeps the GPUs online. So it seems like you have multiple use cases that could come into conflict.
43:07What do you think about the actual use of GPUs as part of a solar and battery system? And is it a model that will actually tie enough to compute together? Anybody have strong opinions on it? I think that there is a certain percentage of the residential population that will buy in. But I still think that the vast majority homeowners are skeptical and just want their energy bills to be simple and be left alone. So I don't think it's for everyone. I don't. And I would like to be proven wrong on that. But I think my gut is that the vast majority of people will not buy into that. But I think the ones that do is substantial, maybe like 10%, you know?
43:56and that's a substantial amount and you could do something with it. I question whether the interoperability of the grid is strong enough to make that work at the distribution level and what additional, you know, as Jigar likes to say, these idiots out there didn't know how hard it was to build a power plant. They didn't know what they were doing at the hyperscale level. I question whether people know what they're doing at the aggregate distribution level. I think that's exactly right. I think so much agreement. It's disgusting. I mean, so my client's the largest deployer of distributed data centers in the country and called Available Infrastructure.
44:37And the bigger challenge for me as a project finance guy is that what you find is for the five megawatt data centers and up, you can get three to five-year offtakes really easily. So there's a ton of banks, others who want to buy that compute. When you start going towards the 250-kilowatt data centers, so we're rolling out 5 ,000 data centers at Crown Castle Towers right now, for instance, across the country, those data centers get their contracts from smart cities players. So think LG and IBM who control traffic lights or are providing services to Waymo or other things, right? But those are not ubiquitous.
45:24So those have very high returns because they're selling their tokens merchant. But for folks who want long-term contracts, you have to wait for those smart city folks to win the local contract for controlling traffic lights or whatever it is before you get your long-term contract. And so part of the problem with residential is that you can certainly do it, and it's a lot of money. it's like$150 ,000 to put this thing in your garage or outside. But you're getting merchant tokens, right? So it's not a long-term fixed price offtake. And so part of the challenge I think we're going to have with these distributed data centers is the CTOs who are buying this compute have not gotten comfortable with data centers below 5 megawatts yet.
46:18Full disclosure, we work with Span. And my sense of the residential market, at least in their experience, is that new construction is a lot easier. And being able to sell across multiple homes all at once. New cul-de-sacs. And also, it's part of the community. It's part of the deal. And I think what's interesting, at least what they're putting forward, and there are some other players that have not announced that they're doing this too, by the way, that I think is coming soon. They're going to provide free power to customers. Yeah. And so, like, you're never going to have to pay your power bill ever again.
46:54Now, again, at the big data center level, we know that hyperscalers have offered a lot of money to communities, and they're like, we don't want it. But I don't know. I think this is an opportunity, particularly in new construction. But in the short run, for retrofit, they're mostly going to CNI locations like telecommunications deployments, which is kind of, Caroline, what you've said. Okay, let's wrap up with some post-election analysis. I think by now everyone is really sick of the phrase blue tsunami. Maybe we should be talking about, I don't know, the green undertow, something like that. No, Stephen.
47:29We saw a couple of big shifts on the state level. You know, people are waking up to the importance of local electricity regulation. We saw PUCs move in a clean energy friendly direction in certain states. New crop of governors were elected with a more expansive view on leveraging DERs and influencing utility regulation. Jager has said he's working with many of those incoming governors. So I'm just curious from your, like, now that we've had some time to digest the election, any storylines emerging for you as ones to watch? Jim, what are the most consequential ones for you right now? I mean, certainly, everyone's eyes seem to be on Texas, which you guys have talked about before.
48:12And I think Governor, you know, so Lacta is still putting her team together. And they're being pretty tight-lipped, from what I understand, in terms of what their intentions are. So I think there's a little bit of wait and see. There's some indications that, Jacob, I'm curious to your perspective, and Carolyn, given where you are, that it may not be as negative on the data center front as may have appeared and talked about during the election. I think that to me is a big question. In some of these moderate states, or not even moderate states, well, until a few weeks ago we thought of as not moderate at all, where you have governors that are going to have to govern to the middle, it's true that people don't like data centers, But it's also true that unions and trades and others like to build things and understand the economic development benefits of building data centers.
49:08So to me, it's can you change the compact? We talked about this earlier. What's the new way forward? And can the governors in some of these states like Texas, because it's such an important one, can they say, we're going to do it differently and here's how we're going to do it? but then keep moving forward, you know, with a certain amount of development. Because as Carolyn mentioned too earlier, if the alternative is the big campuses go overseas and all we're doing is distributed, like I'm for distributed, that's the subject of the episode, but there's some limitations on what we can do, right, on the distributed side.
49:44So we still, I think, want to build those bigger data centers, but we just need to build them in a different way and take a deep breath and figure out what is going to be socially acceptable. So I think that, you know, Texas is interesting. I'm actually maybe the most interested in places that where you've got the trifectas on the Democratic side. I think six states. Yeah, like out of Wisconsin or Michigan, like how, where do they actually go? Like how anti-whatever, utilities, anti-data centers, pro-clean energy, which again, I would like not to see all those things kind of framed in that way.
50:25I think that's a big question for me. So I'm kind of looking at what's going to... And also, can they get beyond 100 % clean energy mandates, right? How creative will they get on the clean energy side rather than going back to... Yeah, but I also think affordability is so important everywhere that everyone's going to have to look at it in that context. I think the Arizona election, by the way, the last commission undid their energy efficiency resource standard, right? Just killed all efficiency funding in Arizona. I would like to think that this new commission's going to go in a slightly different direction.
51:01Some of my eyes are on Arizona in that case as well. Jigar, what do you think? So I think that when you think about where the election went, a lot of the voters who voted for the 457 new state legislators around the country were Steve Bannon and Tucker Carlson followers. and so I think that when you think about how broad this coalition is, it's not really a clean energy coalition. It's more of a, goddammit, we kept telling you to focus on cost of living, now freaking do it, right? And that's why I think utilities are in the crosshairs because they have not proposed anything that will get rates to inflation or lower and so it will be imposed on them.
51:49I think a lot of it's going to be grid utilization. A lot of it's going to be demand flexibility, load flexibility, a lot of the things that we've talked about. I think on the data center side, almost every one of these governors ran on a moratorium. So there's almost nothing they can do except to provide some sort of safe harbor number. but it is impossible for governor-elect Acton in Ohio to come out when there's, I think it was, 40 out of 41 county ballot initiatives basically are banning data centers above 25 megawatts. And so there's no way that she can now say, psych, here's another gigawatt data center.
52:30And so I just think that there's a level of understanding that everyone needs. I just think most people have not sat down, I think, with the election results and realized that we're in a whole new world, right? This is not modify your previous position slightly for this moment. It's, you know, you have to show in visible ways that you care deeply about the affordability crisis that we sit in today. And that's not solar wind. That's not this and that. That's just people, like, they don't care about AI versus China. Nobody cares about AI versus China, especially after all of, like, Black October and the AI, the Anthropic S1.
53:20Like, let them all burn to the ground. No one cares. Well, judging from the debate over the permitting bill, I don't think progressive environmentalists have internalized that new world. All right, Caroline, you've had a week and a half, almost two weeks to really think about the election. You run policy for a major corporation. What questions do you still have? What have you figured out? I don't know that I have any more questions than have already been articulated. I think that where I am focused is actually less on the policies and the regulations and more on what are the commercial structures that solve the political moment, right?
54:02And so I think that we, as an industry, have a tendency to go shop and lobby and defend our own book, whether your book is renewables or your book is thermal or your book is storage or whatever it is. And you can have a few trade groups that present a bridge against, you know, renewable general or clean general, left general versus, you know, thermal on the left or thermal on the other side and stuff. And I don't think that's going to work anymore. So what I'm focused on and what my team is focused on right now and is being informed by the policy team is like, what are the integrated commercial solutions that are going to work?
54:45How do you look at up rates in the natural gas space? But, you know, combine that with virtual power at the residential space. How do you make it easier to solve all governors' problems at once as opposed to going and, you know, arguing your piece of the political pie? And I think the companies that go and argue their piece of the political pie, and I will say that it's 99 % of all companies in this space, whether you are a supplier, you know, third party or utility, we all just sort of go and argue our book. are, I think if we do that, it's going to be very unproductive and we'll end up with some very aggressive and potentially populist limiting legislation.
55:30And what I don't want to see is the energy community be tone deaf, not present innovative commercial opportunities, and we end up getting very short-term fixes that look politically astute, but don't fix the market in the long run, right? And I think that's a big risk overall. And so where I'm focused mentally and where I've sort of focused the growth team and focused everyone over here is like, no, let's be the company that innovates on the commercial offering and integrate something that speaks to all parts of the problem here. And, you know, if we can do that as an industry, I think we could get some really great long-term change.
56:14If we can't, we're going to be fighting each other and we're going to get some pretty short-term aggressive and potentially even regressive shifts in the market. Absolutely. Urgent moment of creative thinking. I think we're going to have to close it out there. Caroline Golan is the Chief Growth and Policy Officer of NRG. Thank you. Good to see you. Thank you, Stephen. Jigar Shah is the co-managing partner of Multiplier. Great to see you, my friend. Of course. And Jim Capsis is the founder and CEO of the AdHoc Group. Great to see you, Jim. Thanks for joining us. Good to be here. Always fun to be with you guys.
56:55That's it for the show. Open Circuit is produced by Latitude Media. The show is edited by me, Sean Marquand, and Anne Bailey. You can find all of our episodes on Apple, Spotify, or wherever you get your podcasts. And you can get transcripts at latitudemedia.com. Check out all of our coverage there and sign up for our newsletter. And of course, you can get all of our episodes on Latitude Media's YouTube channel. So if you like the show, make sure you hit subscribe. Thanks so much for being here. I'm Stephen Lacey. We'll catch you next week.
We’ve been sold a very specific story about AI data centers: bigger is always better. But is that true?
There’s no question that we need a lot more computation to push the limits of large language models. But there’s a new debate emerging around how it should get built.
Over the last year, distributed computing has gained attention as a possible solution to the challenges facing data centers. They’re being framed as a way to avoid costly grid upgrades, reduce local opposition, use empty office buildings, and even give homeowners a financial stake in AI.
It’s turning into a distributed energy story. Companies like Span, Sunrun, Arcadia, and Generate Capital are exploring residential and commercial compute nodes paired with solar and batteries. Others, like Perimeter, are turning old office buildings into data centers.
So far, the market is very small. But what would it take to scale these models? And are there hidden impacts on the grid that we need to consider?
This week, Jim Kapsis, CEO of the Ad Hoc Group, joins us to explore the concept. He recently wrote about distributed data centers for The Gist newsletter.
Plus, we talk about the fallout from Jensen Huang’s departure from NVIDIA, and explore some storylines in the wake of the U.S. midterm elections.
Open Circuit is brought to you by EnergyHub. EnergyHub works with more than 230 utilities to coordinate over 2.6 million DERs and more than 3.6 gigawatts of dispatchable flexibility through a single platform designed to perform when it counts most. See what that looks like at EnergyHub.com.
Open Circuit is brought to you by Giving Green. Giving Green researches the climate nonprofits best positioned for the next big climate win, and sends 100% of every dollar donated to the Giving Green Fund to them. Make your first gift before 2027, and it’s matched up to $500. Go to GivingGreen.earth/Circuit or select Open Circuit at checkout.
Open Circuit is brought to you by Everyday Electric. Everyday Electric simplifies savings at home, helping support a more reliable, affordable grid. Operating the country’s largest residential VPP, it coordinates 6+ GW of capacity across connected products. Learn more at everydayelectric.com.