Leading creative technology agency SpecialGuestX and mixed media production company 1stAveMachine have teamed up to develop the first-ever AI-powered cinema camera, the CMR-M1. Still in prototype stage, the camera will enable users to capture AI-generated video content in real-time.
Generative AI software has certainly blossomed over the past year, with its capabilities becoming more intuitive and technologically advanced than ever before, and it's not just limited to still images. Video generation capabilities have also quietly improved, with Open AI's Sora creating highly realistic video content with just a few text prompts.
(Image courtesy of SpecialGuestX)
Currently, this kind of video generation is text-to-video, so you can generate content while sitting at your desk, but the new CMR-M1 is video-to-video, so filmmaking is still a key part of the process.
Inspired by the Cine-Kodak camera, the first portable 16mm camera and the one that paved the way for video production experiences for a wider audience, AI is now doing the same. CMR-M1 stands for Camera Mark 1.
The device is equipped with a FLIR sensor, which is often used for thermal imaging and infrared cameras. It pairs this with a Snapdragon CPU and Viewport. Currently, video is captured locally at 1368 x 768 resolution at 12 frames per second, then uploaded to a cloud server, “running a stable diffusion workflow.” The first version doesn't run in real-time yet, and there is currently a delay between the two, but they're definitely heading in that direction.
“We believe that filmmaking is inherently physical. Filmmakers are accustomed to using cameras, lenses, tripods and lights, and AI should be a new tool to enhance creativity. In the spirit of creative experimentation, we designed a camera that acts as a physical interface to our AI models,” said Miguel Espada, co-founder and executive creative technologist at SpecialGuestX.
(Image courtesy of SpecialGuestX)
The camera is fascinating, and just like using an analogue camera with different film stocks, users can insert cards that provide different effects, such as “Blooming Nature,” which turns the captured scene into a jungle-like environment, or “Cosmic Coma,” which generates stars and galaxies. In the near future, this same card feature will allow users to upload and develop their own AI styles, which could be a game changer.
Get the best camera deals, reviews, product advice and unmissable photography news straight to your inbox.
Using an NFC chip with an identifier, users can customize their style and workflow, as well as create models that can be trained with their own personal videos and images. Imagine being able to capture pre-processed video in real time, or capture live-action footage and instantly turn it into animation.
The developers see AI generation as a tool used by filmmakers, like tripods and lights, and the CMR-MK1 is really a way for AI to get out of the office and into shooting real-world scenes. The CMR-MK1 will make its live debut at the Cannes Lions International Festival of Creativity starting June 17.
image 1 of 3
(Image courtesy of SpecialGuestX)
(Image courtesy of SpecialGuestX)
(Image courtesy of SpecialGuestX)
You can also check out our guides to the best cinema cameras and the best cine lenses.
