Sign In or Create an Account.

By continuing, you agree to the Terms of Service and acknowledge our Privacy Policy

Climate Tech

Even the Best AI Weather Forecasters Still Need NOAA

While they’re getting more accurate all the time, they still rely on data from traditional models — and possibly always will.

A robot forecaster.
Heatmap Illustration/Getty Images

The National Oceanic and Atmospheric Administration has had a bruising few weeks. Deep staffing cuts at the hands of Elon Musk’s efficiency crusaders have led to concerns regarding the potential closure of facilities critical to data-gathering and weather-forecasting operations. Meteorologists have warned that this could put lives at risk, while industries that rely on trustworthy, publicly available weather data — from insurance to fishing, shipping, and agriculture — are bracing for impact. While reliable numbers are difficult to come by, the agency appears to have lost on the order of 7% to 10% of its workforce, or more than 1,000 employees. NOAA’s former deputy director, Andrew Rosenberg, wrote that Musk plans to lay off 50% of the agency, while slashing its budget by 30%.

Will that actually happen? Who the heck knows. But what we can look at are the small cracks that are already emerging, and who could step in to fill that void.

One thing that’s certain is that the National Weather Service, a division of NOAA, announced last week that it is suspending operations at a weather balloon launch site in Alaska, due to staffing shortages. The data gathered at this remote outpost helped inform the agency’s weather forecasts, which are relied upon by hundreds of millions of people, as well as many of the world’s largest companies and public agencies.

Perhaps to Musk’s department, this looks like a prime opportunity for the private sector to step up and demonstrate some nimble data gathering prowess — and indeed a startup that I’ve covered before, WindBorne, has already offered its services. The company, which makes advanced weather balloons, has offered to provide NOAA with data from its own Alaska launches for six months, at no cost. WindBorne is also one of a number of private companies creating AI-based weather models that have outperformed NOAA’s traditional, physics-based models on key metrics such as temperature, wind speed and direction, precipitation, humidity, and pressure.

All this raises the question, though, of what kind of role the private sector could and should play in the weather forecasting space overall. If the architects of Project 2025 have their way, NOAA would be “broken up and downsized,” and its National Weather Service division would “fully commercialize its forecasting operations.” If the Trump administration achieves these goals, “the Weather Service would cease to function in a way that it could meet its mandate to protect American life and property,” Daniel Swain, a climate scientist at University of California Agriculture and Natural Resources, told me.

But given that heavyweights like Google, Huawei, and Nvidia are already in the AI-based weather prediction game, along with startups such as WindBorne and Brightband, which is making weather predictions tailored to the needs of specific industries such as insurance, agriculture, or transportation, it wasn’t clear to me whether, if NOAA were to crumble, the accuracy of weather forecasts necessarily would, too. I thought that perhaps Musk, the White House’s most notorious AI enthusiast, might be thinking the same thing. So I asked around.

“There’s actually a very good argument that I think would be very uncontroversial to expand the role of the private sector, even to offload certain parts of the workflow to the private sector,” Swain told me, with regards to NOAA and its adoption — or lack thereof — of AI-based weather forecasting. But what nobody wanted was to get rid of free, publicly available government forecasts completely.

“I don’t want to have to figure out what company to trust. I just want to be able to go and open the National Weather Service and know what’s going on,” John Dean, the CEO and co-founder of WindBorne, told me.

Julian Green, the CEO and co-founder of Brightband, agreed. “The government doesn’t just forecast the weather, but it gives people alerts. And there’s regulation around whether [it tells you that] you should evacuate, or shut your factory down, or so on.” It’s not hard to imagine the ethical quandaries that could arise from a private company with a profit motive deciding who can access potentially life-saving forecasts, and for how much.

WindBorne’s and Brightband’s AI models, as well as those from tech giants such as Google, are significantly less computationally intensive to operate than those from NOAA or the other leading weather forecasting agency, the European Center for Medium-Range Weather Forecasts. These traditional models rely on supercomputers crunching complicated atmospheric equations based on the laws of physics to make their predictions.

But this doesn’t mean the physics-based models are getting replaced by AI now, or potentially ever. Government data and traditional forecasts still make up the backbone of advanced AIs, which are trained on decades of data largely gathered by NOAA satellites, weather balloons, and radar systems, and then interpreted through the lens of standard physics-based models. After training is complete, the AI models can predict what weather patterns will develop, much like ChatGPT predicts the next word in a sequence, but only after being fed a snapshot of initial weather conditions — also pulled from traditional physics-based models.

Essentially, these AI forecasts are built on the backs of the giants, and while their outcomes are hugely promising, they could not exist without that solid foundation. While one day, it might be possible to operate AI forecasting models without relying on traditional models, Dean and Green told me that physics-based models might always be critical for training the AI. So while their companies’ respective models have yielded impressive results, both Dean and Green nixed the idea that their companies could wholly replace the predictions made by the National Weather Service.

All of this is in flux of course, but as Green put it to me in an email, “a good mechanic doesn't throw away good older tools just because you get new tools.” Plus, as Dean explained, there are still conditions under which physics-based models tend to outperform AI, such as “really small-scale and high-res phenomena — let’s say convective events, let’s say severe thunderstorms in the Plains, or tornado formation.”

Even Project 2025’s authors point out that private industry forecasters rely on publicly available NOAA data, though it doesn’t make any reference to AI models or physics models. The document simply says that the agency “should focus on its data-gathering services” and the “efficient delivery of accurate, timely, and unbiased data to the public and to the private sector.”

There are also questions around whether AI models, trained on data from the past, will be able to predict the types of unusual and extreme weather events that are becoming more and more common in a warming world, Swain told me. “Does it fully capture those?” he asked. “There’s a lot of evidence that the answer is no.”

Lastly, NOAA’s weather model, the Global Forecast System, is simply measuring much more than the AI models do today. “It predicts so many different phenomena, like different types of snow, hail, mixing ratios, turbulence,” Dean said. “We’re building up over time to add more and more variables. But for both WindBorne and other models, it’s not the same currently as what GFS does.”

So while the Heritage Foundation might want to delegate all forecasting responsibilities to private companies, the vision I heard from the startups I talked to looked more like a mutually beneficial arrangement than the full commercialization of weather prediction, or even a clean division of labor. “It’s not privatized weather, it’s a public-private partnership,” Dean said of his ideal future, “where you get freely available forecasts from a public institution like NOAA, but they work with our industry to iterate faster and to drive more innovation.”

What everyone seems to want is simply for the government to forecast better, and today that means moving quickly to build AI-based models. NOAA has taken some steps forward, prototyping some models, bolstering its computing capabilities, and even recently partnering with Brightband to optimize its observational data to train AI models. But it remains behind other agencies in this regard. “The Chinese government and the European Center for Medium Range Weather Forecasts have done a far better job at adopting AI-based weather forecasts than NOAA has,” Dean told me. “So something does need to change at NOAA to get them to move faster.”

Indiscriminately laying off hundreds of the agency’s employees may not be the best place to start. But if there’s anything we know Musk loves, it’s AI and private sector ingenuity. So maybe, just maybe, this administration will be able to forge the kind of partnerships that can supercharge federal forecasting, while keeping NOAA’s weather predictions free and open for all. Or maybe we’ll all just be paying the big bucks to figure out when a hurricane is going to hit.

Yellow

You’re out of free articles.

Subscribe to access Heatmap’s expert analysis of energy, climate change, and sustainability, including coverage of our regular survey research. Save $57 on an annual subscription, just $156 $99/year.
To continue reading
Create a free account or sign in to unlock more free articles.
or
Please enter an email address
By continuing, you agree to the Terms of Service and acknowledge our Privacy Policy
Climate Tech

Perovskite Solar Is Having Another Moment

The industry has gotten excited before, to no avail. Will it stick this time?

Perovskite solar.
Heatmap Illustration/Getty Images

Over a decade ago, when the global price of silicon-based photovoltaic modules was roughly five times what it is today, the solar industry and media were already hyping up the next big thing: perovskites, a class of materials defined by their specific cube-like crystal structure. The technology promised to boost photovoltaic efficiency while driving down costs, and the industry was atwitter.

All the cool solar-cell scientists are working on perovskites photovoltaics,” IEEE Spectrum proclaimed in a 2014 article. In the same piece, Oxford Photovoltaics predicted that it would have commercially available cells within four years. The Wall Street Journal profiled the tech that same year, and in 2015, The Guardian declared that perovskites could be “game changing.” The excitement centered around the potential for higher output at lower costs: Perovskite cells were seeing rapid efficiency gains, could be made from cheap materials, and were remarkably thin and lightweight. When the question of durability came up, it was often as an afterthought. But that has turned out to be the technology’s biggest obstacle.

Keep reading...Show less
Blue
AM Briefing

The Worst Labor Day Deal

On Duane Arnold, Germany’s far-right win, and Israel’s Falklands play

Gas prices.
Heatmap Illustration/Getty Images

Current conditions: After decades without a major storm, Hawaii is set to be brushed by its second hurricane this season as Hurricane Lowell comes within 100 miles of the state’s western islands • Typhoon Krovanh is stalling over Okinawa, Japan, and weakening back into a tropical depression • Eastward in the Pacific, Hurricane Marie battered Southern California with 10-foot waves.


THE TOP FIVE

1. Oil prices surge near $100 per barrel as Labor Day gas prices soar

On Labor Day, I took a long drive through southern New England and filled the tank of my typically very efficient Honda Accord. The price at the pump made me grateful for work. Gas prices hit a record high for America’s end-of-summer holiday, reaching an average of $4.14, according to the AAA motor club. The national average has never been above $4 for Labor Day weekend, and the new figure easily bested the previous peak of $3.82, set on September 3, 2012. I was too irritated to write down the exact price I paid on Interstate 95 in Connecticut, but it was somewhere closer to $4.30.

Keep reading...Show less
Blue
Q&A

How Building Transmission Could Lower Electricity Costs

Talking with National Grid’s Matthew Satterwhite about his new report with S&P Global.

The Q&A subject.
Heatmap Illustration

This week’s conversation is with Matthew Satterwhite, head of U.S. policy for National Grid. This week National Grid released a report in collaboration with S&P Global I found noteworthy amidst the data center backlash, asserting that building new transmission lines can potentially reduce consumer costs. I reached out asking if we could chat about how this argument leans into the fight over hyperscale infrastructure. I found our conversation illuminating and educational.

The following Q&A was lightly edited for clarity.

Keep reading...Show less
Yellow