Sign In or Create an Account.

By continuing, you agree to the Terms of Service and acknowledge our Privacy Policy

Energy

Which AI Models Use the Most Energy?

A new dashboard from the Sustainable AI Group, founded by artificial intelligence alums, estimates the relative energy intensity of proprietary tools.

•
A Claude Pac-Man.
Heatmap Illustration/Getty Images

The rise of artificial intelligence is driving an historic surge in electricity demand that’s boosting fossil fuel use and threatening climate progress. All this electricity doesn’t power AI in some generalized, always-on way, though. Data centers’ energy consumption is a function of the millions of individual queries users submit to AI programs such as Claude and ChatGPT.

When it comes to how efficiently models process those queries and generate responses, AI models are not interchangeable. Some are more like gas guzzlers, others more like Priuses. When a user engages an AI chatbot or AI agent, however, there’s essentially no way for them to know which kind of vehicle they are stepping into. They may know which company built it, and even the precise model name and number, but no AI company has published information about how much energy one model uses compared to another.

In the absence of corporate disclosure from the big three proprietary AI developers — Anthropic, OpenAI, and Google — researchers with the Sustainable AI Group, a research and advisory company, developed a backdoor method to estimate and compare the amount of energy these developers’ models consume. They published their findings on Tuesday in an interactive dashboard that ranks AI programs by energy intensity.

“We think this is an important next step to get some science-based information out there to help folks start making better decisions,” Boris Gamazaychikov, the CEO of the Sustainable AI Group, told me. “We also hope that if the model providers think that this is really wrong, that they can come out and prove it with some actual data.”

In general, the researchers found that larger, higher-capability models, such as Anthropic’s Opus and OpenAI’s Sol, used nearly four times as much energy on average as smaller, nimbler models from those companies, Haiku and Terra. Newer iterations of each model also weren’t necessarily more efficient than their predecessors.

While the group has yet to evaluate the latest models that hit the market during the research period, so far the researchers found that for the same task, the least efficient models can consume more than 30 times the energy of the most efficient models. They also found a significant difference between “chat” sessions, where a user asks an AI chatbot a question, and “agentic” sessions,” where a user asks the AI to perform a series of tasks. A typical agentic session used 27 times more energy, on average, than a typical chat session conducted using the same AI model.

The Sustainable AI Group was founded by Sasha Luccioni, the former AI and climate lead at the open source AI platform Hugging Face, and Gamazaychikov, who previously led AI sustainability at Salesforce. In their earlier roles, the two collaborated on a project called AI Energy Score, which is similar in spirit to the Environmental Protection Agency’s EnergyStar program for home appliances. They developed a method to directly measure the energy efficiency of “open-weight” AI models, or those that fully disclose their inner workings, and published the results in a public leaderboard.

Luccioni and Gamazaychikov founded the Sustainable AI Group because they wanted to give AI users, particularly large corporate users, the tools to understand the relative emissions impacts of proprietary AI models. Gamazaychikov told me that Salesforce had tried to get energy-use data from its AI providers for years to no avail.

Their first hire was Nidhal Jegham, a graduate student at the University of Rhode Island who published a landmark paper last year called “How Hungry is AI?” Jegham and his co-authors developed a method to estimate the energy, water, and carbon effects of proprietary models at the level of a single prompt or query. The paper was accepted by the journal Communications of the Association for Computing Machinery, and the peer-reviewed version will come out in January.

The approach the Sustainable AI Group developed builds on both Jegham’s paper and the AI Energy Score project. The work began with testing open-weight models to see how they perform in realistic deployment configurations and directly measuring their energy consumption. From there the researchers identified mathematical relationships between various open models’ energy use and other measurable statistics, such as their size.

The next step was to take those statistical relationships from the open-weight models and apply them to similarly-sized proprietary models. The problem is, no one knows how “big” proprietary models are. The size of an AI model usually refers to the number of parameters it contains, i.e. the quantity of numerical representations of what the model has learned that it uses to produce a response.

“When we have a closed model, we don't have the model size. We don't have the deployment conditions. We don't have anything, so we need to find things we can observe from this closed model that can reflect its size,” Jegham explained to me. One key discovery, he said, was that “knowledge retention,” or how well the model can remember factual information, is a strong predictor of model size. A company called Artificial Analysis tests models for knowledge retention, so the researchers compared those results to model size for open models and applied the same statistical relationship to estimate the size of closed models.

This is a simplified explanation — there were many other variables and data points that went into the Sustainable AI Group’s estimates. The researchers also had to develop a separate methodology to evaluate Google’s models, since those mostly run on the company’s proprietary “tensor processing units,” rather than the Nvidia chips the researchers’ initial measurements were based on.

The group’s main findings are based on a per-token estimate of each model’s energy use, i.e. the energy required to process the smallest units of data that an AI deals with. Every time you type a question into a chatbot, the model breaks down the words into smaller bits — i.e. tokens — each just a few characters long, usually. The model also first formulates its response in tokens before translating it to text, an image, or whatever you’re requesting; input tokens are less energy-intensive than the tokens the models spit out. The Sustainable AI Group reports each of its per-token estimates as a range to reflect uncertainty.

For now, the firm is keeping its per-token estimates behind a paywall, but it has already started to use them to advise corporate clients in estimating their AI-related emissions, Gamazaychikov said. For example, he mentioned working with Etsy to help the online retailer develop a “model router,” essentially some software that routes a given query to the most appropriate model for the task, taking into account carbon and cost. It’s also partnering with the corporate emissions accounting platform Watershed to explore how to integrate its model-specific energy numbers into Watershed’s system.

Instead of displaying per-token energy use, the Sustainable AI Group’s public dashboard ranks models’ energy intensity per “typical” session, whether chat or agentic. It defines a typical chat session as “a short back-and-forth” with “a question, an answer, and a follow-up or two to refine or clarify it,” whereas a typical agentic session is “an hour or two of the assistant reading files, making changes and checking its own work across a project.” There are also results for a “heavier” or “lighter” session — generally tasks that take more or less time or require greater or fewer back-and-forths with the AI.

The least efficient AI model for both a typical chat and agentic session, per the dashboard, is Anthropic’s Claude Fable 5. A typical agentic session uses 76 watt-hours, according to the Sustainable AI Group’s estimate, or about the amount of electricity it would take to charge four smartphones, per Department of Energy estimates. The most efficient model for a typical chat session was Claude Haiku 4.5, while the most efficient model for a typical agentic session was Open AI’s GPT-5 nano.

Jegham said the point of the dashboard is not to villainize particular companies or models or to argue that more efficient models are superior. He acknowledged that a more complex task may require a larger model, and a larger model is likely going to be more energy intensive than a smaller one.

The ranking is also flawed in that it assumes every model delivers responses with the same amount of verbosity. In reality, some models may use more words, and therefore more tokens, to answer the same question. Jegham gave the example of Anthropic’s Sonnet and Opus models: Sonnet is less energy intensive per token, but it typically requires more tokens for the same task, so sometimes it’s more energy intensive than Opus. The dashboard doesn’t reflect these differences.

While energy intensity is the core of the dashboard’s function, it also includes estimates of each model’s carbon emissions per session. That calculation opens up many more cans of worms, since actual emissions depend on where in the country the hardware that’s processing the AI session is located and what’s powering it. There’s no easy way to know which data center is processing a given AI request. Instead, the dashboard offers users the option to toggle between different emissions intensities to reflect different scenarios — a data center powered by behind-the-meter natural gas plants, for example, versus one located on a relatively clean grid.

A typical agentic session with Claude Fable 5 powered by a behind-the-meter gas plant emits roughly 52 grams of CO2, it says, while a heavy session emits just over 200 grams — equivalent to driving about half a mile in a gasoline-powered vehicle.

I reached out to OpenAI and Anthropic to ask why they don’t publish energy intensity data, whether there are barriers to doing so, and whether they have plans to do so in the future. A spokesperson from OpenAI told me the company relies “on infrastructure partners to operate the data centers that run our models, so we don’t directly collect the underlying energy data. That’s an important consideration in how we assess and provide this information.” Anthropic declined to comment.

Google, on the other hand, has published an energy use estimate for “the median Gemini Apps text prompt in May 2025,” but has not provided an update for subsequent model versions. In response to my request for comment, the company reiterated statements from Cooper Elsworth, a senior technical manager for AI energy, which Google shared with me for a previous story on Watershed’s efforts to calculate AI-related emissions. He said there is no industry consensus for how to measure and disclose the environmental footprint of frontier AI models. He also echoed OpenAI’s comments, noting that gathering accurate energy use data requires “highly advanced measurement infrastructure,” which not all AI providers have access to.

“We believe there is immense value in aligning the industry on comparable metrics to fairly compare and incentivize action,” he said.

Yellow
🔒

You’ve reached your free article limit

Subscribe to Heatmap News for unlimited access to daily energy and climate coverage.
To continue reading
Create a free account or sign in to unlock more free articles.
or
Please enter an email address
By continuing, you agree to the Terms of Service and acknowledge our Privacy Policy
AM Briefing

‘Starting to Fray’

On Greenland’s deepsea mining ban, Indonesia floating nuclear, and a solar boom

Data center construction.
Heatmap Illustration/Getty Images

Current conditions: Hurricane Trudy has weakened from its peak as a Category 2 storm but still threatens up to 8 inches of rain as it swirls off Baja California • A nor’easter is howling through the Mid-Atlantic this week, hammering the coast with winds of up to 70 miles per hour • A humid overcast has settled over Paris this week as French authorities struggle to regain control after protests over living costs gave way to anarchic riots.


THE TOP FIVE

1. America’s AI infrastructure boom ‘is starting to fray’

At least 47 major data center projects have been delayed, withdrawn, or blocked so far this year, according to data the regulatory intelligence service RegLayer shared with the Financial Times — and that may be a “conservative estimate.” Just 35% of planned data centers are “credible,” analysts told the newspaper, as more than 1,000 communities across the United States now have restrictions on artificial intelligence infrastructure. The data comes as investors look increasingly jittery about AI following ChatGPT-maker OpenAI’s missing a key revenue metric this year.

Keep reading...Show less
Blue
Spotlight

A Giant Data Center Offers a Permitting Reform Test Case

What would happen to Project Jupiter if the Bipartisan American Affordability and Jobs Act is passed?

Project Jupiter.
Heatmap Illustration/Project Jupiter, Library of Congress

One of the nation’s largest data centers is struggling under permitting woes. So let’s play a game: would the bipartisan permitting bill in Congress make the path easier, or might the federal legislation be irrelevant to large hyperscalers under development today?

Meet Project Jupiter, a mega project in southern New Mexico in Dona Ana County under development by Oracle and OpenAI, with financial backing from SoftBank and political support from the Trump administration for being a part of Stargate, a major Trump administration public-private initiative boosting AI development. Project Jupiter would be one of the largest data centers in the country if completed and currently is expected to run on a microgrid powered by fuel cells converting gas to electricity, which the developers claim will burn much cleaner than a typical off-grid gas turbine power plant.

Keep reading...Show less
Yellow
Hotspots

The Trump Administration Is Still Messing with Offshore Wind Farms

And more of the week’s top news around project fights.

The United States.
Heatmap Illustration/Getty Images

1. New England (and Maryland) – The Trump administration is still messing with offshore wind farms, even while trying to pass a permitting reform deal. Examining the court filings reveals why they may feel empowered to do it — and I’m not sure how this ends.

  • Last Friday, in a legal case brought by anti-wind activists, the Justice Department submitted a motion in federal court to send the construction and operations plan for Orsted’s Revolution Wind project in New England back to the Interior Department for more analysis. On Wednesday, the DOJ entered a similar motion in another case challenging the construction and operations plan for U.S. Wind’s MarWin project off the coast of Maryland in a lawsuit brought by the state’s coastal community of Ocean City.
  • Trump’s actions led some to question whether the president was sabotaging the deal, and others to claim the media coverage itself was an attempt to kill it. Going further, supporters of the bipartisan bill claimed the DOJ's motions were precisely why the bill should become law, implying it would guard offshore wind farms against this sort of maneuver.
  • However, for the bill’s backers, it’s worth considering why the Trump administration believes it has the legal authority to do this. It’s also time to ask whether the bill would actually protect these wind farms against this tactic.
  • To answer those questions, you have to rewind. On May 1, 2025, the Interior Department withdrew a Biden solicitor’s opinion instructing the agency to “strike a rational balance” between wind power and fishing interests. This revocation document is technically not in effect at the moment; one year later, a federal court ruled the opinion was potentially illegal as a part of a preliminary injunction on five anti-renewables actions requested by solar and wind trade groups. The Trump administration is contesting that ruling, and the administration has filed a notice of appeal.
  • In August, despite that opinion being in doubt, a federal judge granted Trump permission under the Outer Continental Shelf Lands Act to remand the construction and operations plan for the now-defunct Atlantic Shores offshore wind farm in the waters of New Jersey. U.S. District Judge Jia Cobb specifically wrote that Atlantic Shores failed to demonstrate the federal government had limitations under OSCLA on revisiting these plans and that the injunction from the litigation on appeal “did not prohibit all reevaluation of agency action.”
  • In the recent Revolution and MarWin filings, Trump’s Justice Department argues the construction and operations plans should be remanded under OSCLA without being vacated. The DOJ motions include claims that previous decision documents did not adequately explain impacts to commercial fishing and other industries that use OSCLA waters. It’s not clear if the administration will win these motions.
  • The bipartisan permitting bill would bar the Interior Department and other federal agencies from taking “any new action that would revoke, rescind, withdraw, terminate, suspend, amend, or alter a federal authorization or permit in effect on or after September 16, 2026,” or “any other action to interfere with or prevent the construction or operation at full capacity of a project that has secured all necessary federal authorizations and permits.” The restriction exempts cases where “the agency is required to take such action by order of a court.” As I wrote in our lengthy piece explaining the bill, this provision has a damages component that allows companies impacted by violations to pursue financial compensation.
  • Here’s the billion-dollar question I expect we won’t have answered unless the bill language is enacted and then litigated: Would the court order exception apply to rulings that grant these motions? Or would the developers be able to sue for damages?

2. Columbia County, N.Y. – New York’s renewable energy permitting office has rejected an upstate solar farm on farmland as a House Democrat representing the area joined hands with the Trump administration in publicly railing against the project.

Keep reading...Show less
Yellow