April 5 (Reuters) – Qualcomm’s (QCOM.O) artificial intelligence chip outperformed Nvidia’s (NVDA.O) in two of its three measurements of power efficiency in a new set of test data released on Wednesday. beat out and topped by Taiwanese start-ups. both in one category.
Nvidia dominates the market for training AI models with massive amounts of data. However, once these AI models are trained, they are widely used in so-called “inference” by performing tasks such as generating text responses to prompts or determining whether an image contains a cat. will be used.
Analysts believe the market for data center inference chips will grow rapidly as companies incorporate AI technology into their products, but companies such as Alphabet Inc (GOOGL.O) and Google are skeptical of doing so. We are already looking for ways to limit the additional costs incurred in addition.
One of these major costs is power. Qualcomm used its history of designing chips for battery-powered devices such as smartphones to create a chip called Cloud AI 100 aimed at saving power.
Qualcomm’s AI 100 outperforms Nvidia’s flagship H100 chips, with each chip outperforming Nvidia’s flagship H100 chips, in test data released Wednesday by MLCommons, an engineering consortium that maintains widely used test benchmarks in the AI chip industry. It beat out in image classification based on the number of data center server queries it can perform per hour. Watt.
Qualcomm’s chip hit 197.6 server queries per watt versus Nvidia’s 108.4 queries. Neuchips, a startup founded by Taiwanese veteran chip researcher Youn-Long Lin, took the top spot with 227 queries per watt.
Qualcomm also beat Nvidia in object detection with a score of 3.2 queries per watt, while Nvidia had 2.4 queries per watt. Object detection can be used in applications such as analyzing video in a retail store to see where shoppers go most.
However, Nvidia took the top spot for both absolute performance and power efficiency in a test of natural language processing, the AI technology most widely used in systems like chatbots. Nvidia was second with 10.8 samples/watt, Neuchips was second with 8.9 samples/watt, and Qualcomm was third with 7.5 samples/watt.
Reporting by Stephen Nellis of San Francisco.Editing by Paul Simao
Our standards: Thomson Reuters Trust Principles.
