A new music video by singer-songwriter Washed Out has been released on YouTube. However, this is no ordinary music video, as the entire four-minute film was created using his OpenAI artificial intelligence video generator Sora.
Generated based on a prompt from LA-based director Paul Trillo, the final piece was created by stitching together over 55 individual clips in Adobe Premiere. What stands out is how impressive the consistency of the characters is throughout the video.
The video was commissioned by indie singer Ernest Green, known professionally as “Washed Out” for his track “The Hardest Part.” Trillo says of his X: “This was an idea I had about him nearly 10 years ago, but then abandoned. We were finally able to make it happen.”
This isn't Sora's first music video, but it's the first one commissioned. It also maintains true character consistency throughout the video.
What does the video look like?
This is a fly-through effect seen following the couple in other Sola videos by Trillo, with some bizarre scenes where they appear to weave through multiple cars and run into walls.
There are some obvious AI moments, such as a shot where the baby appears to be floating, but there are few great examples of using AI clips.
Trillo said a total of 55 clips had to be stitched together to create the video, and previous details about how Sora works revealed that each clip could take around 10 minutes to generate. I said it became.
Although there was some correction work in After Effects, there were no major changes. More or less it worked from the clips Sora made. What's not clear is how many clips he generated to find his 55 included in the final video.
Why Sora?
First officially commissioned music video created using @OpenAI Sora for @realwashedout This was an idea I had nearly 10 years ago, but then abandoned. We were finally able to make it happen. Watch the full video here https://t.co/sGpmMLVCul pic.twitter.com/J3RxRD9nzoMay 2, 2024
The video seems to tell the story of a couple from their school days, having a baby, and then growing up. Includes scenes in school hallways, classrooms, and a supermarket.
Some X users who responded to Trillo pointed out how much they saved compared to filming in high schools and doing VFX work for more “mediocre” shots.
Sora may not replace traditional filmmaking in all areas, but if you're creating a music video for a song that might not otherwise be possible due to cost, it's a game-changer. It becomes.
How good are the videos?
When I showed this video to my son, his first reaction was, “There's no way it's AI.” Some scenes don't match up, cars are stretched out, scenery looks out of place, etc. This is clearly due to the AI.
The character's consistency is impressive, but not perfect. However, it shows how much AI tools can accomplish when put in the hands of talented creators.