Sign In or Create an Account.

By continuing, you agree to the Terms of Service and acknowledge our Privacy Policy

Climate Tech

The Software That Could Save the Grid

Or at least the team at Emerald AI is going to try.

Technology and power.
Heatmap Illustration/Getty Images, Emerald AI

Everyone’s worried about the ravenous energy needs of AI data centers, which the International Energy Agency projects will help catalyze nearly 4% growth in global electricity demand this year and next, hitting the U.S. power sector particularly hard. On Monday, the Department of Energy released a report adding fuel to that fire, warning that blackouts in the U.S. could become 100 times more common by 2030 in large part due to data centers for AI.

The report stirred controversy among clean energy advocates, who cast doubt on that topline number and thus the paper’s justification for a significant fossil fuel buildout. But no matter how the AI revolution is powered, there’s widespread agreement that it’s going to require major infrastructure development of some form or another.

Not so fast, says Emerald AI, which emerged from stealth last week with $24.5 million in seed funding led by Radical Ventures along with a slew of other big name backers, including Nvidia’s venture arm as well as former Secretary of State John Kerry, Google’s chief scientist Jeff Dean, and Kleiner Perkins chair John Doerr. The startup, founded and led by Orsted’s former chief strategy and innovation officer Varun Sivaram, was built to turn data centers from “grid liabilities into flexible assets” by slowing, pausing, or redirecting AI workloads during times of peak energy demand.

Research shows this type of data center load flexibility could unleash nearly 100 gigawatts of grid capacity — the equivalent of four or five Project Stargates and enough to power about 83 million U.S. homes for a year. Such adjustments, Sivaram told me, would be necessary for only about 0.5% of a data center’s total operating time, a fragment so tiny that he says it renders any resulting training or operating performance dips for AI models essentially negligible.

As impressive as that hypothetical potential is, whether a software product can actually reduce the pressures facing the grid is a high stakes question. The U.S. urgently needs enough energy to serve that data center growth, both to ensure its economic competitiveness and to keep electricity bills affordable for Americans. If an algorithm could help alleviate even some of the urgency of an unprecedented buildout of power plants and transmission infrastructure, well, that’d be a big deal.

While Emerald AI will by no means negate the need to expand and upgrade our energy system, Sivaram told me, the software alone “materially changes the build out needs to meet massive demand expansion,” he said. “It unleashes energy abundance using our existing system.”

Grand as that sounds, the fundamental idea is nothing new. It’s the same concept as a virtual power plant, which coordinates distributed energy resources such as rooftop solar panels, smart thermostats, and electric vehicles to ramp energy supply either up or down in accordance with the grid’s needs.

Adoption of VPPs has lagged far behind their technical potential, however. That’s due to a whole host of policy, regulatory, and market barriers such as a lack of state and utility-level rules around payment structures, insufficient participation incentives for customers and utilities, and limited access to wholesale electricity markets. These programs also depend on widespread customer opt-in to make a real impact on the grid.

“It’s really hard to aggregate enough Nest thermostats to make any kind of dent,”” Sivaram told me. Data centers are different, he said, simply because “they’re enormous, they’re a small city.” They’re also, by nature, virtually controllable and often already interconnected if they’re owned by the same company. Sivaram thinks the potential of flexible data center loads is so promising and the assets themselves so valuable that governments and utilities will opt to organize “bespoke arrangements for data centers to provide their services.”

Sivaram told me he’s also optimistic that utilities will offer data center operators with flexible loads the option to skip the ever-growing interconnection queue, helping hyperscalers get online and turn a profit more quickly.

The potential to jump the queue is not something that utilities have formally advertised as an option, however, although there appears to be growing interest in the idea. An incentive like this will be core to making Emerald AI’s business case work, transmission advocate and president of Grid Strategies Rob Gramlich told me.

Data center developers are spending billions every year on the semiconductor chips powering their AI models, so the typical demand response value proposition — earn a small sum by turning off appliances when the grid is strained — doesn’t apply here. “There’s just not anywhere near enough money in that for a hyperscaler to say, Oh yeah, I’m gonna not run my Nvidia chips for a while to make $200 a megawatt hour. That’s peanuts compared to the bazillions [they] just spent,” Gramlich explained.

For Emerald AI to make a real dent in energy supply and blunt the need for an immediate and enormous grid buildout, a significant number of data center operators will have to adopt the platform. That’s where the partnership with Nvidia comes in handy, Sivaram told me, as the startup is “working with them on the reference architecture” for future AI data centers. “The goal is for all [data centers] to be potentially flexible in the future because there will be a standard reference design,” Sivaram said.

Whether or not data centers will go all in on Nvidia’s design remains to be seen, of course. Hyperscalers have not typically thought of data centers as a flexible asset. Right now, Gramlich said, most are still in the mindset that they need to be operating all 8,760 hours of the year to reach their performance targets.

“Two or three years ago, when we first noticed the surge in AI-driven demand, I talked to every hyperscaler about how flexible they thought they could be, because it seemed intuitive that machine learning might be more flexible than search and streaming,” Gramlich told me. By and large, the response was that while these companies might be interested in exploring flexibility “potentially, maybe, someday,” they were mostly focused on their mandate to get huge amounts of gigawatts online, with little time to explore new data center models.

“Even the ones that are talking about flexibility now, in terms of what they’re actually doing in the market today, they all are demanding 8,760 [hours of operation per year],” Gramlich told me.

Emerald AI is well aware that its business depends on proving to hyperscalers that a degree of flexibility won’t materially impact their operations. Last week, the startup released the results of a pilot demonstration that it ran at an Oracle data center in Phoenix, which proved it was able to reduce power consumption by 25% for three hours during a period of grid stress while still “assuring acceptable customer performance for AI workloads.”

It achieved this by categorizing specific AI tasks — think everything from model training and fine tuning to conversations with chatbots — from high to low priority, indicating the degree to which operations could be slowed while still meeting Oracle’s performance targets. Now, Emerald AI is planning additional, larger-scale demonstrations to showcase its capacity to handle more complex scenarios, such as responding to unexpected grid emergencies.

As transmission planners and hyperscalers alike wait to see more proof validating Emerald AI’s vision of the future, Sivaram is careful to note that his company is not advocating for a halt to energy system expansion. In an increasingly electrified economy, expanding and upgrading the grid will be essential — even if every data center in the world has a flexible load profile.

’We should be building a nationwide transmission system. We should be building out generation. We should be doing grid modernization with grid enhancing technologies,” Sivaram told me. “We just don’t need to overdo it. We don’t need the particularly massive projections that you’re seeing that are going to cause your grandmother’s electricity rates to spike. We can avoid that.”

You’re out of free articles.

Subscribe today to experience Heatmap’s expert analysis 
of climate change, clean energy, and sustainability.
To continue reading
Create a free account or sign in to unlock more free articles.
or
Please enter an email address
By continuing, you agree to the Terms of Service and acknowledge our Privacy Policy
Carbon Removal

The DAC Hub Dream Is Alive in Canada. I Went to See It.

Deep Sky is running a carbon removal bake-off on the plains of Alberta.

Deep Sky.
Heatmap Illustration/Emily Pontecorvo, Getty Images

Four years ago, Congress hatched an ambitious, bipartisan plan for the United States to become the epicenter of a new climate change-fighting industry. Like an idea ripped from science fiction, the government committed $3.5 billion to develop hulking steel complexes equipped with industrial fans that would filter planet-warming carbon dioxide out of the air.

That vision — to build regional hubs for “direct air capture” — is now languishing under the Trump administration. But a similar, albeit privately-funded initiative in Canada has raced ahead. In the span of about 12 months, a startup called Deep Sky transformed a vacant five-acre lot in Central Alberta into an operational testing ground for five different prototypes of the technology, with more on the way.

Keep reading...Show less
Blue
AM Briefing

A Rare Earths Deal

On permitting reform optimism, GM layoffs, and LA’s H2 conversion

Xi Jinping.
Heatmap Illustration/Getty Images

Hurricane Melissa made landfall over Cuba with winds raging up to 120 miles per hour | If the Category 5 storm veers westward as it heads north, Melissa will bring roiling seas to Atlantic Canada; if it veers eastward, it will bring rain to the United Kingdom | Heavy snowfall in Tibet forced Chinese authorities to shut down access to Mount Everest.

THE TOP FIVE

1. China suspends some rare earth export controls for a year

The rare earths will flow, for now. Cheng Xin/Getty Images

Keep reading...Show less
Blue
Energy

What an ‘Elegant’ Notice of Proposed Rulemaking Looks Like, According to Neil Chatterjee

The former FERC chair explains why Chris Wright is likely to succeed where Rick Perry failed.

Neil Chatterjee and Chris Wright.
Heatmap Illustration/Getty Images

Neil Chatterjee thinks it’s going to go better this time.

Eight years ago, Chatterjee was the chairman of the Federal Energy Regulatory Commission, and Trump was the president. When Trump’s then-Secretary of Energy, Rick Perry, asked the commission to ensure that generators able to store fuel on site — which in the U.S. largely means coal and nuclear — get extra payments for doing so, thus keeping struggling power plants in business, it rejected the proposal by a unanimous vote.

Keep reading...Show less