Sign In or Create an Account.

By continuing, you agree to the Terms of Service and acknowledge our Privacy Policy

Climate Tech

The Software That Could Save the Grid

Or at least the team at Emerald AI is going to try.

Technology and power.
Heatmap Illustration/Getty Images, Emerald AI

Everyone’s worried about the ravenous energy needs of AI data centers, which the International Energy Agency projects will help catalyze nearly 4% growth in global electricity demand this year and next, hitting the U.S. power sector particularly hard. On Monday, the Department of Energy released a report adding fuel to that fire, warning that blackouts in the U.S. could become 100 times more common by 2030 in large part due to data centers for AI.

The report stirred controversy among clean energy advocates, who cast doubt on that topline number and thus the paper’s justification for a significant fossil fuel buildout. But no matter how the AI revolution is powered, there’s widespread agreement that it’s going to require major infrastructure development of some form or another.

Not so fast, says Emerald AI, which emerged from stealth last week with $24.5 million in seed funding led by Radical Ventures along with a slew of other big name backers, including Nvidia’s venture arm as well as former Secretary of State John Kerry, Google’s chief scientist Jeff Dean, and Kleiner Perkins chair John Doerr. The startup, founded and led by Orsted’s former chief strategy and innovation officer Varun Sivaram, was built to turn data centers from “grid liabilities into flexible assets” by slowing, pausing, or redirecting AI workloads during times of peak energy demand.

Research shows this type of data center load flexibility could unleash nearly 100 gigawatts of grid capacity — the equivalent of four or five Project Stargates and enough to power about 83 million U.S. homes for a year. Such adjustments, Sivaram told me, would be necessary for only about 0.5% of a data center’s total operating time, a fragment so tiny that he says it renders any resulting training or operating performance dips for AI models essentially negligible.

As impressive as that hypothetical potential is, whether a software product can actually reduce the pressures facing the grid is a high stakes question. The U.S. urgently needs enough energy to serve that data center growth, both to ensure its economic competitiveness and to keep electricity bills affordable for Americans. If an algorithm could help alleviate even some of the urgency of an unprecedented buildout of power plants and transmission infrastructure, well, that’d be a big deal.

While Emerald AI will by no means negate the need to expand and upgrade our energy system, Sivaram told me, the software alone “materially changes the build out needs to meet massive demand expansion,” he said. “It unleashes energy abundance using our existing system.”

Grand as that sounds, the fundamental idea is nothing new. It’s the same concept as a virtual power plant, which coordinates distributed energy resources such as rooftop solar panels, smart thermostats, and electric vehicles to ramp energy supply either up or down in accordance with the grid’s needs.

Adoption of VPPs has lagged far behind their technical potential, however. That’s due to a whole host of policy, regulatory, and market barriers such as a lack of state and utility-level rules around payment structures, insufficient participation incentives for customers and utilities, and limited access to wholesale electricity markets. These programs also depend on widespread customer opt-in to make a real impact on the grid.

“It’s really hard to aggregate enough Nest thermostats to make any kind of dent,”” Sivaram told me. Data centers are different, he said, simply because “they’re enormous, they’re a small city.” They’re also, by nature, virtually controllable and often already interconnected if they’re owned by the same company. Sivaram thinks the potential of flexible data center loads is so promising and the assets themselves so valuable that governments and utilities will opt to organize “bespoke arrangements for data centers to provide their services.”

Sivaram told me he’s also optimistic that utilities will offer data center operators with flexible loads the option to skip the ever-growing interconnection queue, helping hyperscalers get online and turn a profit more quickly.

The potential to jump the queue is not something that utilities have formally advertised as an option, however, although there appears to be growing interest in the idea. An incentive like this will be core to making Emerald AI’s business case work, transmission advocate and president of Grid Strategies Rob Gramlich told me.

Data center developers are spending billions every year on the semiconductor chips powering their AI models, so the typical demand response value proposition — earn a small sum by turning off appliances when the grid is strained — doesn’t apply here. “There’s just not anywhere near enough money in that for a hyperscaler to say, Oh yeah, I’m gonna not run my Nvidia chips for a while to make $200 a megawatt hour. That’s peanuts compared to the bazillions [they] just spent,” Gramlich explained.

For Emerald AI to make a real dent in energy supply and blunt the need for an immediate and enormous grid buildout, a significant number of data center operators will have to adopt the platform. That’s where the partnership with Nvidia comes in handy, Sivaram told me, as the startup is “working with them on the reference architecture” for future AI data centers. “The goal is for all [data centers] to be potentially flexible in the future because there will be a standard reference design,” Sivaram said.

Whether or not data centers will go all in on Nvidia’s design remains to be seen, of course. Hyperscalers have not typically thought of data centers as a flexible asset. Right now, Gramlich said, most are still in the mindset that they need to be operating all 8,760 hours of the year to reach their performance targets.

“Two or three years ago, when we first noticed the surge in AI-driven demand, I talked to every hyperscaler about how flexible they thought they could be, because it seemed intuitive that machine learning might be more flexible than search and streaming,” Gramlich told me. By and large, the response was that while these companies might be interested in exploring flexibility “potentially, maybe, someday,” they were mostly focused on their mandate to get huge amounts of gigawatts online, with little time to explore new data center models.

“Even the ones that are talking about flexibility now, in terms of what they’re actually doing in the market today, they all are demanding 8,760 [hours of operation per year],” Gramlich told me.

Emerald AI is well aware that its business depends on proving to hyperscalers that a degree of flexibility won’t materially impact their operations. Last week, the startup released the results of a pilot demonstration that it ran at an Oracle data center in Phoenix, which proved it was able to reduce power consumption by 25% for three hours during a period of grid stress while still “assuring acceptable customer performance for AI workloads.”

It achieved this by categorizing specific AI tasks — think everything from model training and fine tuning to conversations with chatbots — from high to low priority, indicating the degree to which operations could be slowed while still meeting Oracle’s performance targets. Now, Emerald AI is planning additional, larger-scale demonstrations to showcase its capacity to handle more complex scenarios, such as responding to unexpected grid emergencies.

As transmission planners and hyperscalers alike wait to see more proof validating Emerald AI’s vision of the future, Sivaram is careful to note that his company is not advocating for a halt to energy system expansion. In an increasingly electrified economy, expanding and upgrading the grid will be essential — even if every data center in the world has a flexible load profile.

’We should be building a nationwide transmission system. We should be building out generation. We should be doing grid modernization with grid enhancing technologies,” Sivaram told me. “We just don’t need to overdo it. We don’t need the particularly massive projections that you’re seeing that are going to cause your grandmother’s electricity rates to spike. We can avoid that.”

You’re out of free articles.

Use code: LABORDAY to save 20%.
Subscribe to access Heatmap’s exclusive polling and expert analysis of energy, climate change, and sustainability, now just $99/year $79.20/year.
To continue reading
Create a free account or sign in to unlock more free articles.
or
Please enter an email address
By continuing, you agree to the Terms of Service and acknowledge our Privacy Policy
Climate Tech

Perovskite Solar Is Having Another Moment

The industry has gotten excited before, to no avail. Will it stick this time?

Perovskite solar.
Heatmap Illustration/Getty Images

Over a decade ago, when the global price of silicon-based photovoltaic modules was roughly five times what it is today, the solar industry and media were already hyping up the next big thing: perovskites, a class of materials defined by their specific cube-like crystal structure. The technology promised to boost photovoltaic efficiency while driving down costs, and the industry was atwitter.

All the cool solar-cell scientists are working on perovskites photovoltaics,” IEEE Spectrum proclaimed in a 2014 article. In the same piece, Oxford Photovoltaics predicted that it would have commercially available cells within four years. The Wall Street Journal profiled the tech that same year, and in 2015, The Guardian declared that perovskites could be “game changing.” The excitement centered around the potential for higher output at lower costs: Perovskite cells were seeing rapid efficiency gains, could be made from cheap materials, and were remarkably thin and lightweight. When the question of durability came up, it was often as an afterthought. But that has turned out to be the technology’s biggest obstacle.

Keep reading...Show less
Blue
AM Briefing

The Worst Labor Day Deal

On Duane Arnold, Germany’s far-right win, and Israel’s Falklands play

Gas prices.
Heatmap Illustration/Getty Images

Current conditions: After decades without a major storm, Hawaii is set to be brushed by its second hurricane this season as Hurricane Lowell comes within 100 miles of the state’s western islands • Typhoon Krovanh is stalling over Okinawa, Japan, and weakening back into a tropical depression • Eastward in the Pacific, Hurricane Marie battered Southern California with 10-foot waves.


THE TOP FIVE

1. Oil prices surge near $100 per barrel as Labor Day gas prices soar

On Labor Day, I took a long drive through southern New England and filled the tank of my typically very efficient Honda Accord. The price at the pump made me grateful for work. Gas prices hit a record high for America’s end-of-summer holiday, reaching an average of $4.14, according to the AAA motor club. The national average has never been above $4 for Labor Day weekend, and the new figure easily bested the previous peak of $3.82, set on September 3, 2012. I was too irritated to write down the exact price I paid on Interstate 95 in Connecticut, but it was somewhere closer to $4.30.

Keep reading...Show less
Blue
Q&A

How Building Transmission Could Lower Electricity Costs

Talking with National Grid’s Matthew Satterwhite about his new report with S&P Global.

The Q&A subject.
Heatmap Illustration

This week’s conversation is with Matthew Satterwhite, head of U.S. policy for National Grid. This week National Grid released a report in collaboration with S&P Global I found noteworthy amidst the data center backlash, asserting that building new transmission lines can potentially reduce consumer costs. I reached out asking if we could chat about how this argument leans into the fight over hyperscale infrastructure. I found our conversation illuminating and educational.

The following Q&A was lightly edited for clarity.

Keep reading...Show less
Yellow