Sign In or Create an Account.

By continuing, you agree to the Terms of Service and acknowledge our Privacy Policy

Climate Tech

Even the Best AI Weather Forecasters Still Need NOAA

While they’re getting more accurate all the time, they still rely on data from traditional models — and possibly always will.

A robot forecaster.
Heatmap Illustration/Getty Images

The National Oceanic and Atmospheric Administration has had a bruising few weeks. Deep staffing cuts at the hands of Elon Musk’s efficiency crusaders have led to concerns regarding the potential closure of facilities critical to data-gathering and weather-forecasting operations. Meteorologists have warned that this could put lives at risk, while industries that rely on trustworthy, publicly available weather data — from insurance to fishing, shipping, and agriculture — are bracing for impact. While reliable numbers are difficult to come by, the agency appears to have lost on the order of 7% to 10% of its workforce, or more than 1,000 employees. NOAA’s former deputy director, Andrew Rosenberg, wrote that Musk plans to lay off 50% of the agency, while slashing its budget by 30%.

Will that actually happen? Who the heck knows. But what we can look at are the small cracks that are already emerging, and who could step in to fill that void.

One thing that’s certain is that the National Weather Service, a division of NOAA, announced last week that it is suspending operations at a weather balloon launch site in Alaska, due to staffing shortages. The data gathered at this remote outpost helped inform the agency’s weather forecasts, which are relied upon by hundreds of millions of people, as well as many of the world’s largest companies and public agencies.

Perhaps to Musk’s department, this looks like a prime opportunity for the private sector to step up and demonstrate some nimble data gathering prowess — and indeed a startup that I’ve covered before, WindBorne, has already offered its services. The company, which makes advanced weather balloons, has offered to provide NOAA with data from its own Alaska launches for six months, at no cost. WindBorne is also one of a number of private companies creating AI-based weather models that have outperformed NOAA’s traditional, physics-based models on key metrics such as temperature, wind speed and direction, precipitation, humidity, and pressure.

All this raises the question, though, of what kind of role the private sector could and should play in the weather forecasting space overall. If the architects of Project 2025 have their way, NOAA would be “broken up and downsized,” and its National Weather Service division would “fully commercialize its forecasting operations.” If the Trump administration achieves these goals, “the Weather Service would cease to function in a way that it could meet its mandate to protect American life and property,” Daniel Swain, a climate scientist at University of California Agriculture and Natural Resources, told me.

But given that heavyweights like Google, Huawei, and Nvidia are already in the AI-based weather prediction game, along with startups such as WindBorne and Brightband, which is making weather predictions tailored to the needs of specific industries such as insurance, agriculture, or transportation, it wasn’t clear to me whether, if NOAA were to crumble, the accuracy of weather forecasts necessarily would, too. I thought that perhaps Musk, the White House’s most notorious AI enthusiast, might be thinking the same thing. So I asked around.

“There’s actually a very good argument that I think would be very uncontroversial to expand the role of the private sector, even to offload certain parts of the workflow to the private sector,” Swain told me, with regards to NOAA and its adoption — or lack thereof — of AI-based weather forecasting. But what nobody wanted was to get rid of free, publicly available government forecasts completely.

“I don’t want to have to figure out what company to trust. I just want to be able to go and open the National Weather Service and know what’s going on,” John Dean, the CEO and co-founder of WindBorne, told me.

Julian Green, the CEO and co-founder of Brightband, agreed. “The government doesn’t just forecast the weather, but it gives people alerts. And there’s regulation around whether [it tells you that] you should evacuate, or shut your factory down, or so on.” It’s not hard to imagine the ethical quandaries that could arise from a private company with a profit motive deciding who can access potentially life-saving forecasts, and for how much.

WindBorne’s and Brightband’s AI models, as well as those from tech giants such as Google, are significantly less computationally intensive to operate than those from NOAA or the other leading weather forecasting agency, the European Center for Medium-Range Weather Forecasts. These traditional models rely on supercomputers crunching complicated atmospheric equations based on the laws of physics to make their predictions.

But this doesn’t mean the physics-based models are getting replaced by AI now, or potentially ever. Government data and traditional forecasts still make up the backbone of advanced AIs, which are trained on decades of data largely gathered by NOAA satellites, weather balloons, and radar systems, and then interpreted through the lens of standard physics-based models. After training is complete, the AI models can predict what weather patterns will develop, much like ChatGPT predicts the next word in a sequence, but only after being fed a snapshot of initial weather conditions — also pulled from traditional physics-based models.

Essentially, these AI forecasts are built on the backs of the giants, and while their outcomes are hugely promising, they could not exist without that solid foundation. While one day, it might be possible to operate AI forecasting models without relying on traditional models, Dean and Green told me that physics-based models might always be critical for training the AI. So while their companies’ respective models have yielded impressive results, both Dean and Green nixed the idea that their companies could wholly replace the predictions made by the National Weather Service.

All of this is in flux of course, but as Green put it to me in an email, “a good mechanic doesn't throw away good older tools just because you get new tools.” Plus, as Dean explained, there are still conditions under which physics-based models tend to outperform AI, such as “really small-scale and high-res phenomena — let’s say convective events, let’s say severe thunderstorms in the Plains, or tornado formation.”

Even Project 2025’s authors point out that private industry forecasters rely on publicly available NOAA data, though it doesn’t make any reference to AI models or physics models. The document simply says that the agency “should focus on its data-gathering services” and the “efficient delivery of accurate, timely, and unbiased data to the public and to the private sector.”

There are also questions around whether AI models, trained on data from the past, will be able to predict the types of unusual and extreme weather events that are becoming more and more common in a warming world, Swain told me. “Does it fully capture those?” he asked. “There’s a lot of evidence that the answer is no.”

Lastly, NOAA’s weather model, the Global Forecast System, is simply measuring much more than the AI models do today. “It predicts so many different phenomena, like different types of snow, hail, mixing ratios, turbulence,” Dean said. “We’re building up over time to add more and more variables. But for both WindBorne and other models, it’s not the same currently as what GFS does.”

So while the Heritage Foundation might want to delegate all forecasting responsibilities to private companies, the vision I heard from the startups I talked to looked more like a mutually beneficial arrangement than the full commercialization of weather prediction, or even a clean division of labor. “It’s not privatized weather, it’s a public-private partnership,” Dean said of his ideal future, “where you get freely available forecasts from a public institution like NOAA, but they work with our industry to iterate faster and to drive more innovation.”

What everyone seems to want is simply for the government to forecast better, and today that means moving quickly to build AI-based models. NOAA has taken some steps forward, prototyping some models, bolstering its computing capabilities, and even recently partnering with Brightband to optimize its observational data to train AI models. But it remains behind other agencies in this regard. “The Chinese government and the European Center for Medium Range Weather Forecasts have done a far better job at adopting AI-based weather forecasts than NOAA has,” Dean told me. “So something does need to change at NOAA to get them to move faster.”

Indiscriminately laying off hundreds of the agency’s employees may not be the best place to start. But if there’s anything we know Musk loves, it’s AI and private sector ingenuity. So maybe, just maybe, this administration will be able to forge the kind of partnerships that can supercharge federal forecasting, while keeping NOAA’s weather predictions free and open for all. Or maybe we’ll all just be paying the big bucks to figure out when a hurricane is going to hit.

Yellow

You’re out of free articles.

Subscribe today to experience Heatmap’s expert analysis 
of climate change, clean energy, and sustainability.
To continue reading
Create a free account or sign in to unlock more free articles.
or
Please enter an email address
By continuing, you agree to the Terms of Service and acknowledge our Privacy Policy
Spotlight

Birds Could Be the Anti-Wind Trump Card

How the Migratory Bird Treaty Act could become the administration’s ultimate weapon against wind farms.

A golden eagle and wind turbines.
Heatmap Illustration/Getty Images

The Trump administration has quietly opened the door to strictly enforcing a migratory bird protection law in a way that could cast a legal cloud over wind farms across the country.

As I’ve chronicled for Heatmap, the Interior Department over the past month expanded its ongoing investigation of the wind industry’s wildlife impacts to go after turbines for killing imperiled bald and golden eagles, sending voluminous records requests to developers. We’ve discussed here how avian conservation activists and even some former government wildlife staff are reporting spikes in golden eagle mortality in areas with operating wind projects. Whether these eagle deaths were allowable under the law – the Bald and Golden Eagle Protection Act – is going to wind up being a question for regulators and courts if Interior progresses further against specific facilities. Irrespective of what one thinks about the merits of wind energy, it’s extremely likely that a federal government already hostile to wind power will use the law to apply even more pressure on developers.

Keep reading...Show less
Yellow
Hotspots

New Mexico’s NIMBYs Vow to Fight Again in Santa Fe

And more on the week’s most important conflicts around renewable energy projects.

The United States.
Heatmap Illustration/Getty Images

1. Santa Fe County, New Mexico – County commissioners approved the controversial AES Rancho Viejo solar project after months of local debate, which was rendered more intense by battery fire concerns.

  • Opposition to the nearly 100-megawatt solar project in the Santa Fe area was entirely predictable, per Heatmap Pro data, which shows overwhelming support for renewable energy in theory, yet an above average chance of NIMBYism arising. That genuine NIMBY quotient appears resilient, prompting even climate activist Bill McKibben to weigh in on the loud volume of the opposition.
  • The commission approved the project’s necessary permit on Tuesday after local fire officials cleared it on safety grounds. Opponents, however, led by an organization named Clean Energy Coalition for Santa Fe County, reportedly plan to sue over the approval, anyway.

2. Nantucket, Massachusetts – The latest episode of the Vineyard Wind debacle has dropped, and it appears the offshore wind project’s team is now playing ball with the vacation town.

Keep reading...Show less
Yellow
Q&A

Trump’s Take on Environmental Review Has Some Silver Linings

Talking NEPA implementation and permitting reform with Pamela Goodwin, an environmental lawyer at Saul Ewing LLP.

Pamela Goodwin.
Heatmap Illustration/Getty Images

This week’s conversation is with Pamela Goodwin, an environmental lawyer with Saul Ewing LLP. I reached out to her to chat about permitting because, well, when is that not on all of our minds these days. I was curious, though, whether Trump’s reforms to National Environmental Policy Act regulations and recent court rulings on the law’s implementation would help renewables in any way, given how much attention has been paid to “permitting reform” over the years. To my surprise, there are some silver linings here – though you’ll have to squint to see them.

The following chat was lightly edited for clarity.

Keep reading...Show less
Yellow