Every story needs a villain. For decades, Hollywood has portrayed artificial intelligence as a mysterious and powerful antagonist. Spring(2001: A Space Odyssey)Ava (ex machina) and Ultron (the avengers) are all part of a broader narrative that portrays AI as personifying the technological threat to humanity.
With the advent of generative AI, that threat has moved off the screen and onto the negotiating table between multiple creative guilds and producers, studios and streamers represented by the Alliance of Film and Television Producers. AI is a big issue as the industry tries to determine its role. Last week, SAG-AFTRA joined the WGA on strike, the first “double strike” in over 60 years, with hundreds of thousands of Hollywood creators now standing in the picket line.
AI is only one point of contention in the negotiations, but in the eyes of the Guilds, AI has the potential to cause extinction-level events in their technology. With both guilds at a standstill, Hollywood’s production pipeline is in jeopardy.
See Also: Entertainment Professionals Concerned About Gen AI
Advances in AI’s generative capabilities have created a Cambrian-like explosion of AI applicability in every industry, but generative AI has special relevance for Hollywood. Generative AI could profoundly change the way we look at content production, heighten tensions over AI-powered production becoming more of a reality, and erode human creativity from the film industry. As the world collectively appreciates this paradigm shift in technology, protecting human creativity, and thus the art of filmmaking, is paramount.
Augmented Intelligence: From Existential Threats to Essential Tools
We believe the next paradigm in technological evolution will be defined by ‘augmented intelligence’. This means companies that leverage software and machines to enhance the work, expertise and experience of human users and workers. With this veil lifted, the narrative around AI in Hollywood needs to move away from viewing AI as a threat and toward a new set of tools that can empower every filmmaker in the world. becomes clear.
See Also: Will AI Replace or Complement Hollywood Workers?
Despite the recent wave of concerns and negative media, AI is giving more aspiring filmmakers access to previously unobtainable tools and human creativity previously unimaginable. I believe that the movie industry will move forward by being released to the level. As we gain a deeper understanding of the capabilities of AI tools and their underlying models, it becomes more apparent that AI can be a positive and democratizing force in Hollywood.
While issues such as screenplay generation and more robust generative video are looming to strike, the first wave of AI adoption in Hollywood will be video editing, where AI tools will emerge to assist human productivity. and will be felt most strongly in post-production.
Today, filmmakers can use AI solutions for video editing to significantly reduce production time and the budget required to bring their creative vision to life. The film, which previously required huge budgets, uses new technology that leverages large-scale foundation models in many aspects of the process, from storyboards to visual effects to his CGI in post-production editing. Now you can expand your creativity.
See Also: How Gen AI Brings Efficiencies to Production
While the creative art of filmmaking continues to be protected, we can now democratize top-level production capabilities to potentially thousands of filmmakers through enhanced intelligence tools. Giving them the power to realize their creative visions without their current constraints promises to bring a new level of storytelling that captures the hearts and minds of people around the world.
So how do these features work in practice? Founded in 2018, Runway ML empowers artists, filmmakers, and creators with models trained on massive amounts of video data. We provide a complete suite of AI tools. VFX artists use Runway to complete manual tasks that previously took days and required expensive specialized software and equipment.
For example, Runway’s Repair tool allows filmmakers to use AI to seamlessly remove objects and backgrounds during the video editing process. (Remember that pesky Starbucks coffee cup that somehow ended up in Winterfell. game of thrones?) Their suite of video editing AI tools also allows for motion tracking and green screen.
Source: Runway ML
For filmmakers, converting video footage is an important aspect of the post-production workflow. Runway’s Gen-1 is a video-to-video product, a type of generative AI that uses words and images to create new videos based on existing videos. Gen-1 represents a significantly cheaper and more efficient way to create unique visual effects, stylize footage, and create new scenes based on reusable footage.
Finally, text-to-video AI represents a major technological advancement in content generation. Runway’s Gen-2 is widely considered to be one of the most sophisticated text-to-video AI models available. The technology is still in its early stages, but the current version allows users to easily create a 4-second video of her from a text prompt. While current technology capabilities are not yet capable of achieving longer video outputs, Twitter users @TomLikesRobots created the trailer for this film by piecing together the generated clips.
Another company making waves in this space needs no introduction. Adobe has been a leader in the design industry for decades. Iconic products like Photoshop, Illustrator, and After Effects have long been staples in creators’ repertoires and are vital engines of their workflows.
In March, Adobe announced Firefly, a gen AI model embedded within Adobe products, enabling all sorts of new tasks, including After Effects. Developed in 1993, the program ushered in a new era of creative competence for filmmakers.
Since then it has been used consistently in film, television and video game post-production. Powered by Firefly, After Effects is once again poised to unleash a new wave of creativity as it grants access to a toolkit of resources previously only accessible to studios with big budgets.
After Effects enables filmmakers to use AI-powered techniques to automate time-consuming manual tasks such as motion tracking and visual effects. Adobe Firefly’s promise is to dramatically accelerate pre-production, production and post-production workflows through natural language that inspires scene changes and fulfills the creative desires of filmmakers. With prompts as simple as ‘Make this scene feel warm and inviting’, there is very little time between imagination and the final product.
These are just a snapshot of some of the AI-powered technologies that are quickly becoming mission-critical in a filmmaker’s toolset.
While important issues such as the digital portraits of actors and the role of AI in screenplays have dominated much of Hollywood’s conversation, a little-known advance in video editing and production is the first wave of AI. It shows that the apex can be reached elsewhere.
Looking through the lens of augmented intelligence, we see that AI does not necessarily have to be cast as the bad guy. This can have a positive impact as it advances the art of filmmaking while unlocking unprecedented levels of efficiency, allowing more time to be spent on the creativity that is at the heart of this industry. .
Sunny Dillon is an investor in Kyber Knight Capital, a $120 million venture capital fund based in Silicon Valley and Los Angeles.Kyber Knights Ally Vidya Contributed to this article.
Does age affect how you feel about AI onslaught? VIP+ digs into…
