🔴 LIVE: The Secrets of ProPicks AI Success Revealed + November’s List FREEWatch Now

NVIDIA consensus suggests a lot of imminent AI energy is needed: Barclays

Published 07/14/2024, 05:00 AM
Updated 07/14/2024, 05:01 AM
© Reuters.  NVIDIA consensus suggests a lot of imminent AI energy is needed: Barclays
NVDA
-

In a recent thematic investing report, Barclays analysts discussed the energy demands poised to accompany the rise of artificial intelligence (AI) technologies, with a particular focus on NVIDIA's (NASDAQ:NVDA) role in this landscape.

According to analysts, the projected energy needs tied to AI advancements underscore a crucial aspect of NVIDIA’s market outlook.

Barclays’s analysis indicates that data centers could consume more than 9% of the current U.S. electricity demand by 2030, driven largely by AI power requirements. The “AI power baked into NVIDIA consensus” is one of the key factors behind this substantial energy forecast, analysts noted.

The report also points out that while AI efficiency continues to improve with each new generation of GPUs, the size and complexity of AI models are growing at a rapid pace. For instance, the size of major large language models (LLMs) has been increasing approximately 3.5 times per year.

Despite these improvements, the overall energy demand is set to rise due to the expanding scope of AI applications. Each new generation of GPUs, such as NVIDIA's Hopper and Blackwell series, is more energy-efficient. Still, the larger and more complex AI models require substantial computational power.

"Large language models (LLMs) require immense computational power for real-time performance,” the report writes. “The computational demands of LLMs also translate into higher energy consumption as more and more memory, accelerators, and servers are required to fit, train, and infer from these models.”

“Organizations aiming to deploy LLMs for real-time inference must grapple with these challenges,” Barclays added.

To illustrate the scale of this energy demand, Barclays projects that powering approximately 8 million GPUs will require around 14.5 gigawatts of power, translating to roughly 110 terawatt-hours (TWh) of energy. This forecast assumes an 85% average load factor.

With about 70% of these GPUs expected to be deployed in the U.S. by the end of 2027, this equates to over 10 gigawatts and 75 TWh of AI power and energy demand in the U.S. alone within the next three years.

“NVIDIA's market cap suggests this is just the start of AI power demand deployment,” analysts said. The chipmaker’s ongoing development and deployment of GPUs are poised to drive significant increases in energy consumption across data centers.

Moreover, the reliance on grid electricity for data centers stresses the importance of addressing peak power demands. Data centers operate continuously, necessitating a balanced power supply.

The report cites a notable statement from Sam Altman, CEO of OpenAI, at the Davos World Economic Forum, "We do need way more energy in the world than I think we thought we needed before...I think we still don't appreciate the energy needs of this technology."

Latest comments

Risk Disclosure: Trading in financial instruments and/or cryptocurrencies involves high risks including the risk of losing some, or all, of your investment amount, and may not be suitable for all investors. Prices of cryptocurrencies are extremely volatile and may be affected by external factors such as financial, regulatory or political events. Trading on margin increases the financial risks.
Before deciding to trade in financial instrument or cryptocurrencies you should be fully informed of the risks and costs associated with trading the financial markets, carefully consider your investment objectives, level of experience, and risk appetite, and seek professional advice where needed.
Fusion Media would like to remind you that the data contained in this website is not necessarily real-time nor accurate. The data and prices on the website are not necessarily provided by any market or exchange, but may be provided by market makers, and so prices may not be accurate and may differ from the actual price at any given market, meaning prices are indicative and not appropriate for trading purposes. Fusion Media and any provider of the data contained in this website will not accept liability for any loss or damage as a result of your trading, or your reliance on the information contained within this website.
It is prohibited to use, store, reproduce, display, modify, transmit or distribute the data contained in this website without the explicit prior written permission of Fusion Media and/or the data provider. All intellectual property rights are reserved by the providers and/or the exchange providing the data contained in this website.
Fusion Media may be compensated by the advertisers that appear on the website, based on your interaction with the advertisements or advertisers.
© 2007-2024 - Fusion Media Limited. All Rights Reserved.