‘In NVIDIA Studio’ This Week RTX Transforms 14″ Laptops, Simultaneous Screen Encoding, May Studio Drivers Available Today

AI Video & Visuals


Editor’s Note: This post is part of a weekly magazine In NVIDIA Studio This series celebrates up-and-coming artists, offers creative tips and tricks, and shows you how. NVIDIA Studio Technology improves creative workflows.We are also looking into new things GeForce RTX 40-series GPUs Learn about features, technologies, resources, and how they can dramatically accelerate your content creation.

Powered by GeForce RTX 40-series laptop GPUs, the new 14-inch NVIDIA Studio laptop delivers a significant performance boost over its predecessor, offering creators the ultimate in portability. AI-dedicated hardware called Tensor Cores powers time-saving tasks in popular apps like Davinci Resolve. Combining the ray tracing core with the neural rendering technology DLSS 3 improves the performance of real-time 3D rendering applications such as D5 Render and his NVIDIA Omniverse.

NVIDIA has also introduced new methods to speed up video encoding. Concurrent scene encoding sends independent groups of frames or scenes to each NVIDIA encoder (NVENC). Taking full advantage of multiple NVENCs can significantly reduce video export time without affecting image quality. The first software to integrate this technology was the popular video editing app CapCut.

May Studio drivers are now available for download. In addition to CapCut, this month’s release includes support for MAGIX VEGAS Pro, D5 Render, VLC Media Player updates, and AI model optimizations for popular apps.

COMPUTEX, Asia’s largest annual technology trade show, launches a series of updates to bring new tools, performance and rich AI power to creators on the NVIDIA Studio platform.

In a keynote at COMPUTEX, NVIDIA founder and CEO Jensen Huang introduced a new generative AI to power game development: the NVIDIA Avatar Cloud Engine (ACE) for Games. The platform adds intelligence to in-game non-playable characters (NPCs) through AI-powered natural language interaction.

of Kairos A demo — a joint venture with Convai led by NVIDIA Creative Director Gabriele Leone — this week demonstrates how a single model can transform into a lifelike character that lives and breathes In NVIDIA Studio.

Ultra-Portable, Ultimate Performance

Powered by the NVIDIA Ada Lovelace architecture, NVIDIA Studio laptops are the world’s fastest laptops for creating and gaming.

GeForce RTX performance comes to 14-inch devices for the first time. In the process, it transforms the ultraportable market, offering the ultimate combination of performance and portability.

The ASUS Zenbook Pro 14 has up to a GeForce RTX 4070 laptop GPU.

Creative and powerful companies dedicated to these purposes do it all. Backed by NVIDIA Studio, the platform powers over 110 creative apps, delivers lasting stability with NVIDIA Studio drivers, and a powerful suite of AI-powered Studio software including NVIDIA Omniverse, Canvas, and Broadcast. Including.

5th generation Max-Q technology brings an advanced suite of AI-powered technologies that optimize laptop performance, power and acoustics for maximum efficiency. Up to 70% better battery life. DLSS is also optimized for laptops, giving creators incredible 3D rendering performance with DLSS 3 optical multiframe generation and super resolution in Omniverse and D5 renders, and hit games like To do. Cyberpunk 2077.

As the ultraportable market heats up, laptop PC makers are giving creators more options than ever before. Recently announced models include the Acer Swift X 14, ASUS Zenbook Pro 14, GIGABYTE Aero 14, Lenovo’s Slim Pro 9i 14 and MSI Stealth 14.

For the latest GeForce RTX-powered NVIDIA Studio systems, visit the Studio Shop and explore a wide range of high-performance Studio products.

Simultaneous encoding of scenes

The recent release of Video Codec SDK 12.1 adds multi-encoder support, which can cut your export time in half. The previously announced split encoding method (splitting the frame and sending each section to the encoder) now has an API that app developers can expose to their end users. Previously, split encoding was automatically performed for 4K or higher videos and fast export presets. With this update, developers have made it easier for users to toggle this option.

Video Codec SDK 12.1 also introduces a new encoding method called simultaneous scene encoding. Video apps can split groups of images or scenes as they are sent to the rendering pipeline. Each group can then be rendered independently and ordered appropriately in the final output.

The result is a significant increase in encoding speed (approximately 80% for dual encoders). Like the NVIDIA RTX 6000 Ada Generation professional GPUs, it’s even faster when there are 3 or more NVENCs. It also improves image quality compared to current split encoding schemes where individual frames are sent to each encoder and spliced ​​together at the final output.

CapCut users will first experience this benefit on RTX GPUs with two or more encoders from the current release of software available today.

Massive Drops of Studio Drivers in May

The May Studio Driver includes significant upgrades and optimizations.

MAGIX has partnered with NVIDIA to migrate its line of VEGAS Pro AI models onto WinML, enabling video editors to apply AI effects faster.

This driver also optimizes AI features for applications running on WinML such as Adobe Photoshop, Lightroom, MAGIX Vegas Pro, ON1, DxO.

Real-Time Ray Tracing Renderer D5 Render also adds NVIDIA DLSS 3 to provide a smoother viewport experience for navigating scenes with hyperfluid motion, ideal for architects, designers, interior designers, and all It has been a tremendous boon to professional 3D artists.

D5 render and DLSS 3 work brilliantly to create photorealistic images.

NVIDIA RTX Video Super Resolution, a video upscaling technology that uses AI and RTX Tensor Cores to improve video quality, is now fully integrated into VLC Media Player, eliminating the need for a separate download. learn more.

Downloading GeForce Experience or NVIDIA RTX Experience is the easiest way to upgrade and stay informed of the latest driver releases.

game ace in the hole

NVIDIA founder and CEO Jensen Huang’s keynote at COMPUTEX introduced NVIDIA ACE for Games, a new foundry that adds intelligence to in-game NPCs through AI-powered natural language interaction.

Game developers and studios can use ACE for Games to build customized voice, dialogue, and animation AI models and deploy them in their software and games. AI technology can transform entire worlds, breathing new life into individual, group, or entire town characters. The possibilities are endless.

ACE for Games is built on technology within NVIDIA Omniverse, an open development platform for building and operating metaverse applications, including AI foundation models optimized for voice, dialogue and character animation.

This includes NVIDIA NeMo, conversational AI fine-tuned for game characters, NVIDIA Riva for automatic speech recognition and text-to-speech, and instantly creating expressive facial animations for game characters that match any voice track. Includes Omniverse Audio2Face. Audio2Face features his Omniverse connector for Unreal Engine 5, allowing developers to add facial animations directly to his MetaHuman character.

Seeing is believing: Kairos Demo

Huang debuted ACE for Games to COMPUTEX attendees, giving a glimpse into the future of gaming with a dubbed demo Kairos.

NVIDIA Inception startup Convai specializes in cutting-edge conversational AI for virtual game worlds. His NVIDIA Lightspeed Studios, led by creative director and 3D artist Gabriele Leone, built stunningly realistic scenes and demos. Together they demonstrated the opportunity for a developer to use his NVIDIA ACE for Games to build his NPCs.

In the demo, the player interacts with Jin, the owner and manager of a ramen shop. The photoreal store is modeled after a virtual ramen shop built with NVIDIA Omniverse.

For this, NVIDIA artists real We visited a ramen shop in Tokyo and collected over 2,000 high-resolution reference images and videos. Each captures aspects of different areas of the kitchen such as cooking, cleaning, food preparation, and storage. “Probably 70% of the existing models he used, 30% new models, 80% retextures,” he says.

Kairos: Beautifully rendered in Autodesk Maya, Blender, Unreal Engine 5 and NVIDIA Omniverse.

At Digital Ramen Shop, objects were modeled in Autodesk 3ds Max with RTX-accelerated AI denoising and RTX-accelerated OptiX ray tracing for smooth, interactive movement within the viewport. With Blender benefiting, it all leveraged the GeForce RTX 40 series in the team’s arsenal. GPUs.

“It’s fair to say that without GeForce RTX GPUs and Omniverse, this project would have been impossible to complete without adding significant hours.” – Gabriele Leone

Adobe Substance 3D Painter’s texture phase used NVIDIA Iray rendering technology with RTX-accelerated lights and ambient occlusion to bake large assets in fractions of a second.

Then, using Omniverse and the Audio2Face app, the team was able to add facial animation and audio directly to the NPCs in the ramen shop via the Unreal Engine 5 connector.

Jin is an NPC, but all with the help of generative AI, he responds to natural language realistically and in line with the story’s backstory.

Lighting and animation work is done in Unreal Engine 5 with the help of NVIDIA DLSS, which uses AI to upscale frames rendered at lower resolutions while preserving high-fidelity detail, allowing the team’s viewport Interactivity has been improved again.

Instruct NPC to order ramen. Well, an interactive conversational character.

Suddenly, NPCs became even more attractive. And they’ve never looked better.

Follow NVIDIA Studio Instagram, twitter and Facebook.Visit the tutorials on Studio YouTube Channel Subscribe to get updates directly in your inbox. studio newsletter.





Source link

Leave a Reply

Your email address will not be published. Required fields are marked *