You’re out of free articles.
Log in
To continue reading, log in to your account.
Create a Free Account
To unlock more free articles, please create a free account.
Sign In or Create an Account.
By continuing, you agree to the Terms of Service and acknowledge our Privacy Policy
Welcome to Heatmap
Thank you for registering with Heatmap. Climate change is one of the greatest challenges of our lives, a force reshaping our economy, our politics, and our culture. We hope to be your trusted, friendly, and insightful guide to that transformation. Please enjoy your free articles. You can check your profile here .
subscribe to get Unlimited access
Offer for a Heatmap News Unlimited Access subscription; please note that your subscription will renew automatically unless you cancel prior to renewal. Cancellation takes effect at the end of your current billing period. We will let you know in advance of any price changes. Taxes may apply. Offer terms are subject to change.
Subscribe to get unlimited Access
Hey, you are out of free articles but you are only a few clicks away from full access. Subscribe below and take advantage of our introductory offer.
subscribe to get Unlimited access
Offer for a Heatmap News Unlimited Access subscription; please note that your subscription will renew automatically unless you cancel prior to renewal. Cancellation takes effect at the end of your current billing period. We will let you know in advance of any price changes. Taxes may apply. Offer terms are subject to change.
Create Your Account
Please Enter Your Password
Forgot your password?
Please enter the email address you use for your account so we can send you a link to reset your password:
A personal account of the final act in the fight to pass the United States’ first comprehensive climate law
One year ago, the Inflation Reduction Act became law, throwing the full financial might of the federal government behind the clean energy transition and forever changing the fight against climate change.
Recent polling finds that too few recognize the historical significance of the hundreds of billions of dollars the law invests to make clean energy cheaper for American households, businesses, and industries.
Even fewer people appreciate just how close we came to losing it all.
This is a personal account of the final days of the fight to pass the nation’s first comprehensive climate law, and of how the Inflation Reduction Act remarkably arose from the ashes of near-defeat.
On July 14, 2022, just over a month before eventually becoming law, the budget bill that would eventually become known as the Inflation Reduction Act died. Again.
That evening, Senator Joe Manchin, the coal-state Democrat from West Virginia, called Senate Majority Leader Chuck Schumer to tell him he was done with the long-simmering inter-party negotiations striving to craft a budget bill that could unite all 50 Democratic senators and pass the evenly divided Senate. The stubborn hold-out had already dashed progressive dreams multiple times in the year and a half since the 117th Congress gaveled into session, including dealing the killing blow to the House-passed Build Back Better Act in December 2021.
The news was a shock. Less than two weeks earlier, over the Fourth of July weekend, I was told by Senate staffers party to the budget negotiations that a deal was imminent. They told me to prepare the REPEAT Project, a Princeton University team that I lead and that assesses the impacts of federal energy and climate policies as they are debated, to stand by to run the numbers on a new bill.
But in July 2022, inflation was running at nearly 9% and gasoline prices were over $5 per gallon in many parts of the U.S. Then we got one bad report on the rate of inflation after another, prompting Manchin to say he could no longer support any additional government spending that might further fuel inflation.
Manchin called Schumer on July 14 to say he could no longer continue negotiations, and that he would not support legislation that included any clean energy or climate spending — leaving only a slimmed-down bill focused on health care left in play.
"DEVASTATING... utterly SENSELESS!" I tweeted at the time, using REPEAT Project modeling to illustrate the massive climate gap we would have faced, had that been the end of the story.
Courtesy of the REPEAT Project at Princeton University's Zero Lab
And it really did seem like the end.
The tone I heard from Senate staffers that day was very different from the several prior ‘false demises’ of the budget negotiations we had all endured. They were despondent. “I feel like I just wasted the last six years of my life,” one staffer texted me on July 14. So did I.
The next day, Manchin issued an ultimatum: Either Democrats could quickly pass a “skinny” budget bill focused only on health care or they could wait a few weeks to see if inflation improved and try negotiating a larger package in August.
The problem: Basically no one thought inflation would meaningfully cool that quickly, and there was only a few weeks left to pass a law before the August recess, after which Congress would go into full campaign season and nothing would pass.
The game clock was winding down.
Then President Biden threw in the towel. He issued an official statement vowing to keep the climate fight up via executive action but urged the Senate to quickly pass a bill focused only on health care.
Schumer appeared poised to do just that, and a caucus meeting for Senate Democrats was set for the following Tuesday to discuss how to move forward. Since Congress only gets one shot at a budget reconciliation law per fiscal year, if they ended up passing a bill without any climate package, it was game over.
I had been working to advance federal climate policy since 2008. I lived through the demise of the last serious effort to pass a federal climate law in 2009 and 2010. I knew how rare these windows of opportunity to pass meaningful legislation are. And we’d just blown a once-in-a-decade chance. Would we have to wait until the 2030s for our next shot? Could we even survive another decade with the United States standing on the sidelines of the global climate fight?
By July 16, I had apparently had enough time to go through the various stages of grief, arriving at bargaining (or perhaps denial). “It’s just not okay to end like this, with Manchin walking away from the deal and the rest of the caucus just quietly accepting that!” I wrote in a text to a key Senate staffer. “There’s got to be at least a dozen [Senate] members who are furious and could be unwilling to accept that in the end, right?”
“Working on it 😄,” the staffer replied.
And just like that, while many gave up and others fumed, staff from just a handful of Senate offices and a rag-tag group of allied individuals and advocacy groups got back to what we’d been doing since the start: doggedly working the problem to find some way to passage.
Even then, I had very little faith our efforts would succeed. I just knew that the game clock had a few seconds left on it, time enough to run a couple more Hail Mary plays, and I wanted to be able to look my kids in the eye some day and say, “We failed, but we truly tried everything we could.”
So we got back to work.
So how did we get Manchin back to the negotiating table?
From my limited perspective, three things worked.
First, the concern that climate spending would stoke inflation was bogus. The budget deal under negotiation was doubly paid for, raising twice as much new revenue as it spent. What’s more, the spending plan was estimated to be in the ballpark to $30 to $50 billion per year spread over a decade, or less than 1% of our roughly six trillion dollar federal budget.
The climate spending was peanuts, and any honest macroeconomist would say that the budget deal would have a mild, fiscally contractionary effect at best or no effect on inflation at worst. Plus, the proposals specifically took aim at two key drivers of inflation: health care costs and energy costs.
Either Manchin was honest in his inflation fears but misappreciating the issues, or he was trying to give himself cover to scuttle the bill.
Our so-called “Never Give Up Caucus” took him at face value. To address his inflation concerns, allies succeeded in getting inflation-hawk-in-chief Larry Summers, the conservative leaning Penn-Wharton Budget Model team, and the deficit hawkish head of the Committee for a Responsible Federal Budget to tell Manchin (and the press) that the deal would cut the deficit and not raise prices.
Second, the many vested interests that stood to gain from the clean energy package were mobilized and pushed Manchin hard not to leave them high and dry.
This was always a key part of the political strategy of the clean energy package: rather than focus on pricing carbon emissions and making fossil energy more expensive (as Congress had attempted in 2009), the budget bill would instead provide a wide-ranging set of direct subsidies — tax credits, grants, loan programs — to make climate-friendly technologies cheaper and help build up manufacturing of clean energy components in the U.S. Concentrated beneficiaries create organized power to back the bill. That was the theory, and it was time to put it to the test.
The pressure campaign to get Manchin back to the table was “across the board,” according to National Wildlife Federation CEO Collin O’Mara, who was one of the most dogged and effective organizers during those pivotal final days.
Executives from renewable energy companies reminded Manchin that billions of dollars of investment were at stake.
The United Mine Workers of America pushed Manchin not to walk away from his promise to create a permanent trust fund for miners suffering from black lung disease, which the budget bill would do.
In my personal estimation, the most effective voices were probably from those sectors Manchin had styled himself as personally championing as chairman of the Senate Energy Committee: carbon capture, nuclear power, hydrogen, and advanced manufacturing.
A senior executive with a utility operating in Appalachia reportedly told Manchin: “We know coal plants are ultimately going to close. What is going to replace them? What are the jobs? What are we transitioning to? In this case, we are going to explore hydrogen, new nuclear and get manufacturing in the state.”
Manchin received incoming pressure to pass a bill from the Carbon Capture Coalition, oil companies like BP with big plans to invest in hydrogen, and Nucor, the nation’s largest steel maker, which planned new investments in West Virginia in part to supply growing demand for steel for burgeoning renewable energy industries.
Utilities like Constellation and Duke reminded Manchin that this law was our best shot at preserving the nation’s existing nuclear fleet, which provides about a fifth of our electricity without contributing to air pollution or climate change.
Bill Gates, who has invested in nuclear and energy storage startups, called Manchin personally. And executives at a Gates-backed battery company with plans for a West Virginia manufacturing hub explained to Manchin’s staff how the bill’s incentives would accelerate their growth trajectory.
Third, a few key senators that Manchin personally trusted or respected, including John Hickenlooper of Colorado, Chris Coons of Delaware, Tina Smith of Minnesota, Mark Warner of Virginia, and Ron Wyden of Oregon, reportedly pressed him with direct personal appeals.
I imagine their pitches either made the political case — did Manchin really want to send his party into the midterms having utterly failed on their domestic policy agenda? — or a personal one, emphasizing the opportunity to secure his legacy and the admiration of his grandchildren.
I don’t think we should discount the importance of these personal appeals. At the end of the day, senators are humans too. They crave the respect of their colleagues (at least those they admire). And everyone wants to be the hero of their own story, not the villain.
Which of these (or other parallel efforts I don't know about) pushed Manchin back to the table? Who knows what went through his mind in the end. But somehow, against virtually all expectations, it worked.
We didn’t know it until later, but by as early as Tuesday, July 19, Manchin and Schumer, with just a couple key aids each, began meeting in secret somewhere in the Senate offices and got back to work.
No one else had any idea this was happening.
Like others working to save the bill, I spent the next week continuing to talk to press, allies, congressional staff, etc., marshaling talking points and data, mobilizing various interests to pressure Manchin, and doing everything we could to convince the stubborn senator to make a deal that would get a climate package into law. Little did we know, he was already back at it.
In fact, a little over a week later, on Wednesday, July 27, Manchin issued a statement that shocked everyone: He and Leader Schumer had reached a deal after all and were unveiling a full-fledged bill to be called “The Inflation Reduction Act.”
“The Inflation Reduction Act of 2022 addresses our nation’s energy and climate crisis by adopting commonsense solutions through strategic and historic investments that allow us to decarbonize while ensuring American energy is affordable, reliable, clean and secure,” Manchin wrote.
The full text of the bill dropped later that evening, and we were blown away to see how much of the original climate package from the ill-fated Build Back Better Act was retained by this new legislation.
The deal contained roughly $370 billion in estimated climate and clean energy spending, an historic package. All the key tax incentives were still in the proposal, including credits for clean electricity, electric vehicles, and heat pumps. Major grant programs were funded at similar levels. Even a new fee on methane pollution from the oil and gas sector had survived. In fact, a tax credit for U.S. clean energy manufacturing had even been expanded, apparently at Manchin’s request, to support production of batteries and their components and the mining and processing of critical minerals.
Rather than lose it all, we were poised to win nearly everything we’d hoped for.
“Holy shit. Stunned, but in a good way,” wrote Senator Tina Smith, a tireless advocate for the climate package, on Twitter. “$370B for climate and energy … BFD.”
It took us a couple weeks to run the numbers, but once we did, REPEAT Project estimated on August 4 that the Inflation Reduction Act, or IRA (pronounce it like your friendly Uncle Ira!), would cut emissions by about one billion metric tons per year in 2030 and retained about 80% of the cumulative emissions reductions of the larger Build Back Better package.
Courtesy of the REPEAT Project at Princeton University's Zero Lab
IRA could get the United States to about 42% below our peak historical emissions by 2030, we estimated at the time. (REPEAT Project’s latest updated analysis published last month revises 2030 emissions under IRA to 37-41% below peak.) That was still short of the target of 50% below peak levels that President Biden had committed the country to on the world stage, but the proposed legislation was a true game changer that gave us a fighting chance to hit that goal.
After the Manchin-Schumer deal dropped, we were off to the races.
Manchin shifted from the package’s chief obstacle to its chief spokesperson, stumping for the bill on Fox and haranguing senators on the floor alongside Schumer to get IRA passed during an exhausting, overnight “vote-a-rama.” After a 16-hour process where Republicans proposed amendment after amendment to be shot down one by one by a united Democratic caucus — plus a little last minute drama wherein Kyrsten Sinema nearly killed the bill to save private equity firms billions in taxes — the Inflation Reduction Act passed the Senate at 3:17 PM on August 7, 51-50, with Vice President Harris casting the deciding vote.
The House passed IRA in turn on August 14, and President Biden signed it into law two days later. The rest, as they say, is history.
We’re still writing that history, but it’ll be forever changed by passage of the landmark law. And we almost lost it all.
Log in
To continue reading, log in to your account.
Create a Free Account
To unlock more free articles, please create a free account.
On prepurchase agreements, Al Gore, and Norway’s EVs
Current conditions: Ecuador’s government-enforced blackouts will begin tomorrow night as drought threatens hydroelectric plants • Storm Boris is causing flooding in parts of Italy • Montana could see very heavy rainfall and flash flooding today.
Frontier, a coalition of carbon removal buyers, announced this morning a fourth round of prepurchase agreements, worth $4.5 million. The coalition facilitated agreements with nine suppliers to remove carbon from the atmosphere on behalf of five of Frontier’s buyers: Stripe, Shopify, Alphabet, H&M Group, and Match. The removal projects are located across six countries and utilize a range of techniques, including rock weathering, direct air capture, and ocean alkalinity enhancement. In a press release, Frontier said “a significant number of companies in this purchase cycle are integrating carbon removal into existing large-scale industries. This strategy can reduce costs and accelerate scale-up relative to standalone carbon removal projects.”
Frontier
Brazil’s worst drought on record, now in its second year, has caused water levels in the rivers that run through the Amazon to fall to historic lows, and some have even dried up entirely. One key tributary that supplies the mighty Amazon River, the Solimoes, has water levels that are 14 feet below average for the first half of September. The drought is fueling numerous large fires, many of which were started by humans but have plenty of dry vegetation to keep them going.
Plumes of wildfire smoke hang over South America.NASA
According to data from Brazil’s National Institute for Space Research, almost half of the Amazon fires are burning pristine forest. This is unusual, The New York Timesreported, and “means fighting deforestation in the Amazon is no longer enough to stop fires.” The Amazon rainforest is one of the world’s most important carbon sinks. If it collapses, it could release huge amounts of carbon into the atmosphere, exacerbating the climate crisis. Researchers with World Weather Attribution say climate change is the main driver of the Amazon’s ongoing drought. “Climate change is no longer something to worry about in the future, 10 or 20 years from now,” Greenpeace spokesperson Romulo Batista toldReuters. “It’s here and it’s here with much more force than we expected.”
A coalition of some of the world’s most prominent shipping and carrier companies is piloting the “first-ever U.S. over-the-road electrified corridor.” Participants include AIT Worldwide Logistics, DB Schenker, Maersk, Microsoft, and PepsiCo, who will drive their long-haul heavy-duty electric trucks along the I-10 corridor between L.A. and El Paso to identify pain points and share learnings in an effort to hasten the decarbonization of land freight. Terawatt Infrastructure will provide the charging infrastructure for the corridor with six of its own charging hubs. Terawatt’s website says it has 14 sites under development, four of which are expected to come online this year. Heavy-duty vehicles account for a quarter of transport-related greenhouse gas emissions in the U.S. The new coalition is supported by the global nonprofit Smart Freight Centre.
Former U.S. Vice President Al Gore’s green asset management business, Generation Investment Management, put out its eighth annual Sustainability Trends Report this week. The paper is packed full of interesting insights (both uplifting and depressing), but one stands out. It says upgrading the power grid is “the critical issue to get the energy transition moving faster in the big, developed economies.” It includes this graphic showing the cumulative backlog of renewable-energy projects wanting to connect to the grid in the U.S.:
Generation Investment Management
Gore has been doing the media rounds this week. He told the Financial Times that a Trump victory in November “would be very bad.” “Most climate activists that I know in the United States believe that the single most important near-term decision America can make with regard to climate is who is the next president. It’s a bit of a Manichaean choice.” But, he added that the energy transition was, at this point, “unstoppable.”
In case you missed it: Norway has become the first country in the world to have more electric vehicles on the road than gas-powered cars. Diesel still reigns supreme in terms of registered vehicles, but the share of fully electric cars registered is now larger than the share of cars that run on gasoline. The director of the Norwegian road federation said he expects EVs will overtake diesel cars, too, by 2026. EVs already make up the vast majority (94%!) of new vehicle sales in Norway, and could very well approach 100% sometime next year.
A recent study finds that most people have a tendency to grossly underestimate the average carbon footprint of the richest individuals in society, while overestimating the carbon footprint of the poorest individuals.
Geothermal is getting closer to the big time. Last week, Fervo Energy — arguably the country’s leading enhanced geothermal company — announced that its Utah demonstration project had achieved record production capacity. The new approach termed “enhanced geothermal,” which borrows drilling techniques and expertise from the oil and gas industry, seems poised to become a big player on America’s clean, 24/7 power grid of the future.
Why is geothermal so hot? How soon could it appear on the grid — and why does it have advantages that other zero-carbon technologies don’t? On this week’s episode of Shift Key, Rob and Jesse speak with a practitioner and an expert in the world of enhanced geothermal. Sarah Jewett is the vice president of strategy at Fervo Energy, which she joined after several years in the oil and gas industry. Wilson Ricks is a doctoral student of mechanical and aerospace engineering at Princeton University, where he studies macro-energy systems modeling. Shift Key is hosted by Robinson Meyer, the founding executive editor of Heatmap, and Jesse Jenkins, a professor of energy systems engineering at Princeton University.
Subscribe to “Shift Key” and find this episode on Apple Podcasts, Spotify, Amazon, or wherever you get your podcasts.
You can also add the show’s RSS feed to your podcast app to follow us directly.
Here is an excerpt from our conversation:
Robinson Meyer: I just wanted to hit a different note here, which is, Sarah, you’ve alluded a few times to your past in the oil and gas industry. I think this is true across Fervo, is that of course, the technologies we’re discussing here are fracking derived. What has your background in the oil and gas industry and hydrocarbons taught you that you think about at Fervo now, and developing geothermal as a resource?
Sarah Jewett: There are so many things. I mean, I’m thinking about my time in the oil and gas industry daily. And you’re exactly right, I think today about 60% of Fervo’s employees come from the oil and gas industry. And because we are only just about to start construction on our first power facility, the percentage of contractors and field workers from the oil and gas industry is much higher than 60%.
Jesse Jenkins: Right, you can’t go and hire a bunch of people with geothermal experience when there is no large-scale geothermal industry to pull from.
Jewett: That’s right. That’s right. And so the oil and gas industry, I think, has taught us, so many different types of things. I mean, we can’t really exist without thinking about the history of the oil and gas industry — even, you know, Wilson and I are sort of comparing our learning rates to learning rates observed in various different oil and gas basins by different operators, so you can see a lot of prior technological pathways.
I mean, first off, we’re just using off the shelf technology that has been proven and tested in the oil and gas industry over the last 25 years, which has been, really, the reason why geothermal is able to have this big new unlock, because we’re using all of this off the shelf technology that now exists. It’s not like the early 2000s, where there was a single bit we could have tried. Now there are a ton of different bits that are available to us that we can try and say, how is this working? How is this working? How’s this working?
So I think, from a technological perspective, it’s helpful. And then from just an industry that has set a solid example it’s been really helpful, and that can be leveraged in a number of different ways. Learning rates, for example; how to set up supply chains in remote areas, for example; how to engage with and interact with communities. I think we’ve seen examples of oil and gas doing that well and doing it poorly. And I’ve gotten to observe firsthand the oil and gas industry doing it well and doing it poorly.
And so I’ve gotten to learn a lot about how we need to treat those around us, explain to them what it is that we’re doing, how open we need to be. And I think that has been immensely helpful as we’ve crafted the role that we’re going to play in these communities at large.
Wilson Ricks: I think it’s also interesting to talk about the connection to the oil and gas industry from the perspective of the political economy of the energy transition, specifically because you hear policymakers talk all the time about retraining workers from these legacy industries that, if we’re serious about decarbonizing, will unavoidably have to contract — and, you know, getting those people involved in clean energy, in these new industries.
And often that’s taking drillers and retraining some kind of very different job — or coal miners — into battery manufacturers. This is almost exactly one to one. Like Sarah said, there’s additional expertise and experience that you need to get really good at doing this in the geothermal context. But for the most part, you are taking the exact same skills and just reapplying them, and so it allows for both a potentially very smooth transition of workforces, and also it allows for scale-up of enhanced geothermal to proceed much more smoothly than it potentially would if you had to kind of train an entire workforce from scratch to just do this.
This episode of Shift Key is sponsored by …
Watershed’s climate data engine helps companies measure and reduce their emissions, turning the data they already have into an audit-ready carbon footprint backed by the latest climate science. Get the sustainability data you need in weeks, not months. Learn more at watershed.com.
As a global leader in PV and ESS solutions, Sungrow invests heavily in research and development, constantly pushing the boundaries of solar and battery inverter technology. Discover why Sungrow is the essential component of the clean energy transition by visiting sungrowpower.com.
Antenna Group helps you connect with customers, policymakers, investors, and strategic partners to influence markets and accelerate adoption. Visit antennagroup.com to learn more.
Music for Shift Key is by Adam Kromelow.
Why the new “reasoning” models might gobble up more electricity — at least in the short term
What happens when artificial intelligence takes some time to think?
The newest set of models from OpenAI, o1-mini and o1-preview, exhibit more “reasoning” than existing large language models and associated interfaces, which spit out answers to prompts almost instantaneously.
Instead, the new model will sometimes “think” for as long as a minute or two. “Through training, they learn to refine their thinking process, try different strategies, and recognize their mistakes,” OpenAI announced in a blog post last week. The company said these models perform better than their existing ones on some tasks, especially related to math and science. “This is a significant advancement and represents a new level of AI capability,” the company said.
But is it also a significant advancement in energy usage?
In the short run at least, almost certainly, as spending more time “thinking” and generating more text will require more computing power. As Erik Johannes Husom, a researcher at SINTEF Digital, a Norwegian research organization, told me, “It looks like we’re going to get another acceleration of generative AI’s carbon footprint.”
Discussion of energy use and large language models has been dominated by the gargantuan requirements for “training,” essentially running a massive set of equations through a corpus of text from the internet. This requires hardware on the scale of tens of thousands of graphical processing units and an estimated 50 gigawatt-hours of electricity to run.
Training GPT-4 cost “more than” $100 million OpenAI chief executive Sam Altman has said; the next generation models will likely cost around $1 billion, according to Anthropic chief executive Dario Amodei, a figure that might balloon to $100 billion for further generation models, according to Oracle founder Larry Ellison.
While a huge portion of these costs are hardware, the energy consumption is considerable as well. (Meta reported that when training its Llama 3 models, power would sometimes fluctuate by “tens of megawatts,” enough to power thousands of homes). It’s no wonder that OpenAI’s chief executive Sam Altman has put hundreds of millions of dollars into a fusion company.
But the models are not simply trained, they're used out in the world, generating outputs (think of what ChatGPT spits back at you). This process tends to be comparable to other common activities like streaming Netflix or using a lightbulb. This can be done with different hardware and the process is more distributed and less energy intensive.
As large language models are being developed, most computational power — and therefore most electricity — is used on training, Charlie Snell, a PhD student at University of California at Berkeley who studies artificial intelligence, told me. “For a long time training was the dominant term in computing because people weren’t using models much.” But as these models become more popular, that balance could shift.
“There will be a tipping point depending on the user load, when the total energy consumed by the inference requests is larger than the training,” said Jovan Stojkovic, a graduate student at the University of Illinois who has written about optimizing inference in large language models.
And these new reasoning models could bring that tipping point forward because of how computationally intensive they are.
“The more output a model produces, the more computations it has performed. So, long chain-of-thoughts leads to more energy consumption,” Husom of SINTEF Digital told me.
OpenAI staffers have been downright enthusiastic about the possibilities of having more time to think, seeing it as another breakthrough in artificial intelligence that could lead to subsequent breakthroughs on a range of scientific and mathematical problems. “o1 thinks for seconds, but we aim for future versions to think for hours, days, even weeks. Inference costs will be higher, but what cost would you pay for a new cancer drug? For breakthrough batteries? For a proof of the Riemann Hypothesis? AI can be more than chatbots,” OpenAI researcher Noam Brown tweeted.
But those “hours, days, even weeks” will mean more computation and “there is no doubt that the increased performance requires a lot of computation,” Husom said, along with more carbon emissions.
But Snell told me that might not be the end of the story. It’s possible that over the long term, the overall computing demands for constructing and operating large language models will remain fixed or possibly even decline.
While “the default is that as capabilities increase, demand will increase and there will be more inference,” Snell told me, “maybe we can squeeze reasoning capability into a small model ... Maybe we spend more on inference but it’s a much smaller model.”
OpenAI hints at this possibility, describing their o1-mini as “a smaller model optimized for STEM reasoning,” in contrast to other, larger models that “are pre-trained on vast datasets” and “have broad world knowledge,” which can make them “expensive and slow for real-world applications.” OpenAI is suggesting that a model can know less but think more and deliver comparable or better results to larger models — which might mean more efficient and less energy hungry large language models.
In short, thinking might use less brain power than remembering, even if you think for a very long time.