Red Hat and Nvidia partnership takes AI microservices to the next level

Red Hat Inc. and Nvidia Corp., leading artificial intelligence companies, are partnering to better serve enterprises and business users with AI microservices.

“We're excited to partner with Red Hat's AI business unit,” said Steven Huels (pictured, right), vice president and general manager of Red Hat's AI business unit. “The challenges they face have to do with a lot of tools, ease of integration, deployment and usage. And the partnership here is really targeted at accelerating that.[ing] To make implementation as easy as possible”

With fuel Justin Boitano (Left), Vice President of Enterprise AI, Nvidia; I spoke with theCUBE Rob Strechay and Paul Gillin in red hat summit, during an exclusive broadcast on SiliconANGLE Media's live streaming studio, theCUBE. They discussed Red Hat and Nvidia's unique partnership and what users are looking for from their AI provider. (*Disclosure below.)

Justin Boitano and Steven Huels discuss what companies are looking for in an AI provider.

Aim for faster, personalized models and microservices

Red Hat partners with Nvidia to enable users to integrate Nvidia's products. NIM microservices to a model trained with Red Hat OpenShift AI. The goal is to reduce time to market for AI applications.

“Generative AI is only useful in a production environment,” Boitano says. “What you want to do is figure out how to increase accuracy to drive business outcomes and put that into production. Then figure out how to shrink the model to reduce costs and make it more cost-effective. “You can find it.''

Nvidia aims to balance proprietary technology and open source to give users the tools they need to run AI models tailored to their business needs. Huels predicts that the future focus for companies will be on customized models.

“We are focused on our strengths in providing the core components needed for AI management and systems,” he said. “But we rely on our partners to go deep into specific areas. We will continue to look into it.”

Competition in the AI ​​space is heating up as companies look to capitalize on the generative AI boom. But Nvidia aims to stay on top by focusing on collaboration and innovation.

“New industries are being created through generative AI,” Boitano says. “We have to keep going faster. We have to work more with our partners to use generative AI to help our customers succeed faster, and that's why we're working. is one.”

Below is the full video interview. Part of coverage from SiliconANGLE and theCUBE Research. red hat summit:

(*Disclosure: Nvidia Corp and Red Hat Inc. sponsor this segment on theCUBE. Neither Nvidia, Red Hat nor any other sponsor has editorial control over the content on theCUBE or SiliconANGLE. )

Photo: SiliconANGLE