The surge in demand for artificial intelligence (AI) computing power in 2024 is reshaping how businesses navigate the challenges associated with the rapid growth of generative AI tools. Doug Petkanics, co-founder and CEO of Livepeer, shared valuable insights with Cointelegraph, shedding light on the escalating demand and strategies to manage the burgeoning requirements in this dynamic landscape.
The accessibility of generative AI tools over the past year has led to widespread usage, from addressing simple queries to handling complex work tasks, making technology an integral part of daily life. OpenAI's AI chatbot, ChatGPT, reflects this trend with around 180.5 million monthly users as of January 2024.
As the popularity of generative AI rises, so does the demand for computing power to support these technologies. Petkanics emphasized that computing power plays a crucial role in the development and deployment of AI, influencing the speed and efficiency of AI models. He identified three critical stages in the AI lifecycle - training, fine-tuning, and inference - where substantial computing power is needed.
However, the urgency for faster responses must be balanced against the economic reality of high costs. Petkanics explained the delicate equilibrium between user experience and economic viability, stating, "more computing power generally correlates with faster responses, but there's always a balance."
Amidst the challenges, Petkanics highlighted the role of crypto-coordinated decentralized public infrastructure networks (DePINs) in supporting AI. He noted that GPUs already in use for tasks like video transcoding are well-suited for AI, making these crypto-networks integral to the AI boom.
While developers grapple with computing power concerns, Petkanics pointed out that consumers are often unaware of the infrastructure behind AI. Most users prioritize speed and relevancy over considerations like energy usage or computing costs. Issues with computing power may only become noticeable when costs are passed on through increased ads, decreased response quality, or rising subscription fees.
Looking beyond individual concerns, Petkanics raised apprehensions about the monopolization of scaled AI platforms by big tech companies. Drawing parallels to the emergence of "Big Tech" during the internet era, he stressed the importance of the open-source AI movement. Petkanics emphasized the need for countries to support these movements to ensure accessibility and mitigate risks associated with centralization.
As the AI boom unfolds, industry leaders like Petkanics anticipate a new set of economic, environmental, and social considerations. The evolving landscape necessitates a delicate balance between technological advancement and responsible practices to harness the full potential of AI while addressing its associated challenges.
