Pushing the limits: This completely AI-generated music video blows my mind

AI Video & Visuals


I've seen many amazing works of art developed using AI. With Midjourney's help, I was also able to create images for Techlicious. I'm very proud. But this music video released by Spacecadet's Daniel Eckler really surprised me with its amazing graphics and creativity. And everything in it is generated by his 100% AI.

The journey begins with C-3PO sitting on the throne as a result of a fortuitous trip from Midjourney. From this was born the fundamentally absurd concept of a gangster rap video starring C-3PO and Childish Gambino (Donald Glover).Work related to actual video production Intensive 28-step process Eckler and his colleagues use a variety of AI tools and platforms. If you need more information, please see below.

While music requires some work (yes, a lot of work; AI-generated music lags far behind AI's visual capabilities), this video explores how AI will revolutionize the creative industries. I believe it will be a powerful example of what happens. However, not everyone agrees.there were There were many negative reactions on X (formerly Twitter)One commentator called it “a great example of very stupid, very bad taste, and mediocre AI.”

No matter where your opinion lies, we can all expect to see more (and much better) projects like this as AI continues to advance at a rapid pace. Give it a listen and let us know what you think in the comments.

process

The lyrics were generated using ChatGPT, which generated hundreds of options and selected the best ones. A rough cut of the song was created using his AI music tools like Suno, which helped quickly establish the overall mood and flow. In terms of visuals, using Midjourney he generated over 1,000 images and selected the most striking and consistent ones. Figma was used to organize and refine these generated assets.

Consistency was a key issue and was addressed through painstaking and rapid engineering to ensure a consistent visual style. The team also researched extensively to find ways to smooth out the rough edges inherent in AI-generated videos. Character clothing was designed using Midjourney, and rough storyboards were put together using AI tools such as Katalist.

read more: AMD releases Radeon RX 7900 GRE worldwide: affordable powerhouse

Once the components were in place, the actual assembly began. Photoshop's Generative Fill tool was used to clean up and adjust the image. Runway ML is used extensively to animate characters, often requiring multiple runs to achieve the desired effect. The first cut of the video was put together using Fable's different AI editing tools.

For the vocal track, a human rapper was brought in to provide the bass performance, transformed to sound similar to C-3PO using Resemble AI and Eleven Labs' AI voice model. Human character face swaps were done using $NSFW.

The editing process was highly iterative and involved continuous refinement and rework using various AI tools. Lip-syncing was a particular challenge, and different AI models such as Synclab and D-ID were used for different shots. Upscaling of the footage was done using AI-powered tools from Topaz Labs.

read more Artificial intelligence cannot replace mugshot photographers yet

Disclosure: In keeping with the theme of this article, parts of the article were created using Claude.AI.

[Image credit: C-3PO/Donald Glover mashup via Midjourney]

Josh Kirschner is the co-founder of Techlicious and has been covering consumer technology for over 10 years. Josh founded his first company while still in college. It's a home electronics retail store that caters mainly to students. His work has been featured on Today.com, NBC News, and Time.





Source link

Leave a Reply

Your email address will not be published. Required fields are marked *