Sora, OpenAI's text-to-video tool, is making waves in the music industry. Its latest work, the official music video for synth-pop artist Washed Out, marks a milestone as the first commissioned work from a prominent artist and director.
Director Paul Trillo, who has worked with artists such as The Shins, used Sora to bring to life a ten-year-old concept. He says Sora's ease of use and speed streamlined the process compared to his traditional 3D animation techniques.
To create the Washed Out video, Trillo generated 55 clips using text prompts. Only minor editing in Premiere Pro is required. The results demonstrate Sora's strengths in democratizing special effects, highlighting developing areas such as visual consistency and the uncanny valley effect.
Trillo's dream fly-through technology effectively circumvents current limitations, but raises the issue of potential overuse. Nevertheless, Sora-powered effects will definitely become more popular in the near future.
Historically, music videos have been a testing ground for new technologies (think Dire Straits and Michael Jackson). OpenAI expects Sora to be generally available later this year. AI-powered effects are expected to spread from music videos to other visual formats such as advertising and social media.
Watch the video below.
