Nvidia briefly became the world's most valuable company in June 2024, with a value of $3.34 trillion, and its value has nearly doubled since the beginning of the year. Though it's currently behind Microsoft and Apple, it's only a matter of time before the company takes the top spot again.
HPC Wire In a report from the Bank of America Securities 2024 Global Technology Conference, Ian Buck, vice president and general manager of NVIDIA's Hyperscale and HPC business, explained the economic benefits of investing in GPUs.
“For every dollar a cloud provider spends on buying GPUs, they get $5 in profit over four years,” Buck claims. Inference tasks are even more profitable. “The economics here are even better: for every $1 spent, they get $7 in profit over the same period, and growing,” he says.
Blackwell's Shortage
Nvidia is optimizing its products to meet the growing demand for AI inference with Nvidia Inference Microservices (NIM), which supports popular AI models like Llama, Mistral, Gemma, etc. The company is also focusing on its new Blackwell GPUs, which are specifically designed for improved inference and energy efficiency.
While supply may be tighter than Nvidia would like initially, the company isn't worried: “Any new technology transition comes with challenges on both the supply and demand sides. We certainly experienced that with Hopper, and we'll have similar supply and demand constraints with the launch of Blackwell later this year and into next year,” Buck said.
Looking to the future, NVIDIA has already begun sharing details with cloud providers about its Rubin GPUs, which were announced at Computex and are scheduled to ship in 2026. Buck emphasized the importance of early collaboration, saying, “This is really important to us. Data centers don't just fall from the sky. They're massive construction projects.”
Nvidia's steady progress in AI and GPU technology is encouraging for investors, and a $4 trillion market cap seems within reach. But the path forward is less clear. Rapid growth has inevitably brought Nvidia under scrutiny from antitrust authorities, a situation that is not expected to go away anytime soon.
