Sign In or Create an Account.

By continuing, you agree to the Terms of Service and acknowledge our Privacy Policy

Daily Briefing

Climate Is Looming Over the AI Existential Risk Conversation

One of the largest companies in the world says its products pose catastrophic peril. Sound familiar?

•
Dario Amodei.
Heatmap Illustration/Getty Images

This is an edition of Heatmap Daily, an evening review of the day’s news written by our executive editor. Sign up for it here.

Imagine, for a moment, a vast and growing firm — a conglomerate that could be said to define its era of American capitalism. Over the past several years, this firm’s products have become the biggest story in the U.S. economy. Its products are so mindbogglingly expensive to produce that they have driven new types of financial and infrastructural innovation, yet nevertheless the company seems to be quite profitable.

And little wonder: Everyone wants what they have. Investors, policymakers, and economists believe that America’s ongoing economic growth and competitiveness depend on ample access to this company’s products. The sitting Republican president has staked his administration on making sure Americans can get as much of it as they want — regulations be damned.

But there is a problem. One of the company’s researchers has become convinced that the company’s products are dangerous — so harmful, in fact, that their continued use and growth trajectory portends catastrophic risk for humanity. He attempts to alert the company’s executives to this fact. What happens next?

Perhaps you know the story. In the late 1970s and early 1980s, Exxon’s internal scientists concluded that the ongoing growth of fossil fuels would raise global temperatures and have “potentially catastrophic” effects on the planet’s climate. They presented these results to Exxon’s executives. A senior scientist warned that humanity had a brief window — “five to 10 years” — before “the need for hard choices regarding changes in energy strategies might become critical.”

Exxon led a large research effort into climate change, affirming its scientific validity. But then in the late 1980s, its CEO decided to go in the other direction. Its executives chose not to warn the public about climate change — and instead began a successful disinformation campaign meant to convince the public that climate change was not settled science.

But what if things had gone differently? We’re getting a taste of that pathway now. Last week, Sam Coxon, a researcher at the artificial intelligence company Anthropic, resigned because he feared the AI industry was too close to building an “out of control” intelligence. He quit his job just a few months before his corporate equity would have vested, giving up what would have likely been life-changing wealth to warn about what he believes to be existential risks. Humanity only had a brief period of time — perhaps a year — to steer the technology to a better path, he said.

Anthropic researchers who remain at the company affirmed his analysis. “We really do earnestly believe AI could kill all humans,” a senior scientist at the company posted on the social network X.

But this time, Anthropic’s CEO, Dario Amodei, did not respond as Exxon’s leadership did three decades ago. Instead, Amodei basically agreed with Coxon: He asked for the government to regulate artificial intelligence and “pace the frontier,” meaning that it should enforce a slower rate of cutting-edge artificial intelligence development.

I’ve thought of these two examples over the past few days as I’ve tried to make sense of the surge in public concern about AI and existential risk.

It seems to me that climate change is looming over the AI conversation and shaping the assumptions, outlook, and behavior of many key players and observers. President Trump, of course, is reading from the old playbook and has deemed AI fears to be a “hoax”; Coxon, appearing on Fox News, has downplayed climate change’s existential risk as compared to runaway AI. Yet even beyond those reruns and revisions, the analogy goes deeper: Just as nuclear non-proliferation agreements structured early attempts to regulate global greenhouse emissions, climate policy is now shaping how people understand AI risk.

And not for lack of cause. In some important ways, the problems — or alleged problems, depending on your perspective on AI — resemble each other. For instance, because technology exists in a global commons, any successful AI diplomacy must involve the United States and China. And since China’s AI development currently lags the United States, American politicians must persuade China that their proposals to regulate AI are not just concealed attempts to restrain China’s development.

This dynamic has long bedeviled climate negotiations, too. Since economic growth has (until very recently) required fossil fuels, China and other middle-income countries have long feared that any global climate treaty would constrain their future economic development. The Kyoto Protocol tried to finesse this problem by splitting countries into two groups, rich and not-rich; the Paris Agreement did it by imposing no collective restrictions on fossil fuel consumption at all.

Neither approach has worked, exactly, but each offer examples, counterexamples, and tools for thought. Perhaps the Montreal Protocol, which has successfully limited global production of the pollutants destroying stratospheric ozone — and has shown how to stop the growth of a dangerous but hard-to-manufacture technology that presents near-term existential risk — is a superior model.

There is at least one big way the two risks differ. Climate change is a chemical problem that arises from the size and scale of global fossil fuel consumption. Scientists have known that the greenhouse effect is real since the early 20th century. Climate change’s physics are rudimentary enough that Exxon’s in-house scientists could predict the path of future warming with some accuracy. It is a verifiable risk.

AI’s alleged existential risks, on the other hand, emerge from a lab pushing the technological frontier too far and drilling, like Tolkien’s dwarves, too deep. AI concern relies not on empirical observations, but on a story about exponential change and runaway growth. In this way, it’s a harder risk to predict, and a harder one to accept.

Climate advocates have long wondered what would have happened if Exxon’s leaders had embraced reality and warned the public in the 1980s that global warming is real and caused by fossil fuels. Inside Climate News once called it a “road not taken.” I can’t help but wonder if we’re watching it.

Blue

You’re out of free articles.

Subscribe to access Heatmap's exclusive climate and energy polling, award-winning journalism, and subscriber-only events. Save $57 on an annual subscription, just $156 $99/year.
To continue reading
Create a free account or sign in to unlock more free articles.
or
Please enter an email address
By continuing, you agree to the Terms of Service and acknowledge our Privacy Policy
AM Briefing

Seventh Heaven

On a Darlington update, BAAJA myopia, and a shale megadeal

The J.H. Campbell power plant.
Heatmap Illustration/Getty Images

Current conditions: A storm is brewing over the Pacific Ocean that could dump 2 to 3 feet of snow on California’s Donner Pass later this week • Cyclone Akvan is intensifying in the Bay of Bengal, putting the storm on track to make landfall over India’s Andhra Pradesh by Friday • The Northern Cook Islands, one of the two chains of atolls that comprise the eponymous South Pacific nation, are bracing for Tropical Cyclone Xavier to hit this week as a Category 2 storm with damaging winds.


THE TOP FIVE

1. Trump issues seventh order to keep Michigan coal plant operating

The Department of Energy has issued its seventh emergency order to keep the coal-fired J.H. Campbell plant in West Olive, Michigan, running past its planned retirement. Late on Friday, the agency reupped its directive under Section 202 of the Federal Power Act mandating that the facility, owned primarily by the utility Consumers Energy, stay open to prevent blackouts on the Midcontinent Independent System Operator, the nation’s largest grid. The move, Utility Dive noted Monday, follows a September federal appeals court decision vacating a previous emergency order to keep Campbell running, which it said cut against state authority over what kinds of resources generate electricity within their borders.

Keep reading...Show less
Yellow
Podcast

How Tribes Became Power Players on Permitting Reform

Rob welcomes back Julian Brave NoiseCat to talk about the National Historic Preservation Act and why it’s so central to these negotiations.

Julian Brave NoiseCat.
Heatmap Illustration/Getty Images

One big sticking point that’s emerged in negotiations over the Bipartisan American Affordability and Jobs Act are the changes it would make to the National Historic Preservation Act. The bill would rewrite Section 106 of that law, which requires the federal government to consult with tribal nations before it permits a major project on or adjacent to land of Native cultural value. Crucially, the protections in Section 106 of the NHPA don’t end at the borders of a reservation. They extend to public and private property, as well.

The initial version of the legislation would have shrunk the scope and shortened the deadlines of reviews under the NHPA, and imposed punitive new rules on the officials in charge of overseeing those processes. It would have also allowed the federal government to step in and take over a local official’s office if officials thought they weren’t moving quickly enough. A subsequent amendment would soften many of those revisions, but not all of them.

Keep reading...Show less
Green
Julian Brave NoiseCat.
Heatmap Illustration/Getty Images

This transcript has been automatically generated.

Subscribe to “Shift Key” and find this episode on Apple Podcasts, Spotify, Amazon, YouTube, or wherever you get your podcasts.

Keep reading...Show less
Green