At the ongoing Consumer Electronics Show (CES), Nvidia announced Alpamayo, an open-source AI model for self-driving cars. Commenting on the announcement of the new AI model, CEO Jensen Huang said that it is the world's first self-driving car AI with thought reasoning. He also revealed that the Alpamayo will be released on U.S. roads by Mercedes CLA later this year. “Alpamayo brings reasoning to self-driving cars, allowing them to think through rare scenarios, drive safely in complex environments, and explain their driving decisions,” he further added. In response to one such post about self-driving car AI, Tesla CEO Elon Musk wrote: “That’s exactly what Tesla is doing 😂 What they realize is that getting to 99% is easy, but solving the long tail of the distribution is very difficult.”
Nvidia CEO talks about Alpamayo: ChatGPT Physical AI moment is here
Alpamayo introduces a Vision-Language-Action (VLA) model designed for autonomous driving systems. This model allows self-driving cars to understand visual input, evaluate driving situations, and decide on driving actions. The platform also includes large-scale inference models, simulation tools for testing rare or unusual driving situations, and open datasets for training and validation.Commenting on Alpamayo, Nvidia CEO Jensen Huang said in a statement, “The ChatGPT moment for physical AI has arrived: when machines begin to understand, reason, and act in the real world.” “It's trained end-to-end, literally from the camera input to the end of the movement. It infers the action you're about to take, why that action occurred, and the trajectory,” he added.“With a 10 billion parameter architecture, Alpamayo 1 uses video input to generate trajectories with inference traces to show the logic behind each decision. Developers can adapt Alpamayo 1 to smaller runtime models for vehicle development or use it as the basis for AV development tools such as inference-based rating systems and automatic labeling systems. Alpamayo 1 provides open model weights and open source inference scripts. Future models in the family will feature larger parameter counts, more detailed inference capabilities, greater input/output flexibility, and options for commercial use. ” he continued.
Nvidia's Alpamayo debuts in Mercedes CLA
As mentioned earlier, Nvidia partnered with Mercedes to introduce self-driving car AI. Announcing the partnership, the chipmaker said, “NVIDIA brings NVIDIA DRIVE AV software to the U.S. with enhanced Level 2 point-to-point driver assistance capabilities, enabling a new era of AI-defined driving.” Starting with Mercedes-Benz, a long-standing partner in promoting safe and intelligent mobility, the roads are scheduled to be completed by the end of this year.”“The all-new Mercedes-Benz CLA, the brand’s first vehicle powered by the MB.OS platform, introduces advanced driver assistance features powered by NVIDIA’s full-stack DRIVE AV software, AI infrastructure and accelerated computing.This design potentially enables over-the-air updates for future upgrades and new features, including planned enhancements to MB.DRIVE ASSIST PRO, available from the factory and through the Mercedes-Benz Store. ”
