The tech giant showcased its cutting-edge AI and computing solutions at the COMPUTEX 2023 show in Taipei in the first week of June. If NVIDIA CEO Jensen Huang’s keynote focused on his AI-centric company’s groundbreaking innovations, Arm CEO Rene Haas’ keynote focused on Arm’s capabilities in AI. A compelling demonstration was given to introduce. Qualcomm focused on enhancing on-device intelligence and hybrid AI as the mainstream form of AI in the future. A new chapter is expected to begin in the next few years with a major upgrade in computing power. The next section summarizes key takeaways from COMPUTEX 2023.
NVIDIA: The Grace Hopper Superchip Powering the AI Revolution
The world’s first Grace Hopper superchip, built on the TSMC 4nm process node, will further NVIDIA’s commitment to AI. Additionally, more GPUs will be used for generative AI training and inference models, which will accelerate innovative technologies in the short term, Huang stressed.
NVIDIA also introduced the Spectrum-X platform, a fusion of Spectrum-4 switches and Bluefield-3 DPUs. It boasts a record 51Tb/s Ethernet speed and is customized for AI networks. Combined with a BlueField-3 DPU and NVIDIA LinkX optics, it forms an end-to-end he 400GbE network optimized for the AI cloud. This innovation not only fits NVIDIA’s goals, but it also eats up a lot of foundry capacity, especially his TSMC.
NVIDIA ACE Framework
Source: Nvidia
NVIDIA: Avatar Cloud Engine (ACE) for Gaming
NVIDIA hasn’t forgotten about loyal gamers. Today, we introduced Avatar Cloud Engine (ACE) for Games, a breakthrough custom AI model service. ACE revolutionizes the gaming experience by enhancing in-game non-playable characters (NPCs) with AI-driven natural language interaction. ACE allows gamers to enjoy more immersive and intelligent gameplay.
Analyst Q&A Notes with NVIDIA Founder and CEO Jensen Huang
- If most of your workload involves training AI models, your data center acts as an AI factory. The best computer can handle both training and inference tasks, but the choice of processor depends on the specific inference type.
- In the foreseeable future, AI is set to become a dominant force within the realm of NPCs in video games. These NPCs have unique narrative and contextual backgrounds and easily interact with each other in a harmonious way. Their movements are fluid and their command comprehension is exceptional.
- AI will revolutionize the user experience on the PC and drive advances in personalized recommender systems. In addition, even compact smartphones take advantage of the extensive and personalized Internet data. As a result, future interactions will generate real-time, customized content, moving to a production process that meets the growing demand for personalized information. This groundbreaking development marks the dawn of a new era characterized by an explosion of generated and augmented information, thereby breaking away from the previous dominant search-centric paradigm.
- InfiniBand excels at high-performance computing, providing great throughput for single computers and AI factories. Ethernet is the mainstream in supercomputers and AI systems, but Ethernet is prevalent in cloud environments.
- China leads the way in cloud services, consumer internet and digital payments. The company has made rapid progress in the electric and autonomous vehicle space, demonstrating local innovation through numerous GPU startups. This confirms China’s technological superiority and future growth prospects.
- Omniverse streamlines computer setup through cloud integration and partnerships, allowing easy information streaming via browser-based access. Optimize factory design and simulation to minimize effort, errors and expenses.
Arm: Everything is a computer now. AI runs on Arm
Arm CEO Rene Haas said data center workloads showed a staggering 260% increase from 2015 to 2021, citing data centers, automotive technology and AI in driving computing demand with ARM designs. emphasized its vital role.
Arm-based notebooks will overtake Intel and AMD, and their share of shipments will nearly double from 14% today to 25% by 2027, according to Counterpoint Research.
Notebook PC shipment share by CPU/SoC type %
Source: Counterpoint Research
AI emerged as a focus during Haas’s keynote, and Haas captivated the audience with a compelling demonstration of Arm’s capabilities. That said, Arm plans to support an even wider range of applications in the future.
We agree with Arm’s view, believing that generative AI, digital twins and edge computing will emerge as the top technology trends for 2023 and impact the tech industry as a whole.
Qualcomm: Strengthening On-Device Intelligence, Focusing on Hybrid AI
Qualcomm’s “AI” Hexagon processors deliver 3-5X better computing performance compared to existing CPU/GPU solutions. The company aims to expand the application of the Snapdragon 8cx Gen 3 processor to the laptop industry with Microsoft’s thorough support.
When it comes to AI, Qualcomm believes there are limits to the efficiency improvements of edge AI and cloud AI. However, leveraging Qualcomm’s connectivity solutions and combining edge AI with cloud AI provides additional benefits in terms of cost/energy savings, enhanced privacy and security, reliability and latency. Therefore, the company is guiding that hybrid AI (edge AI + cloud AI) will be the mainstream of future AI.
Conclusion
With the impact of the COVID-19 pandemic waning, COMPUTEX returned to on-site mode in Taipei this year, delivering solid and eye-catching AI solutions. We are entering a new era of computing where generative AI will change our lives. Mobile and PC vendors, as well as server vendors and data center hyperscalers, are collaborating to drive technology improvements with AI support.
Counterpoint analysts work closely with the technology product market to keep an eye on any changes and trends.
