Tel Aviv, Israel—Deepdub has launched Deepdub GO, a new AI-powered audio-video localization and creation platform for businesses, advertising agencies, online learning platforms and content creators.
Deepdub originally developed its own AI technology for the entertainment industry and has worked with Hollywood studios on dozens of film and TV projects, including shows currently streaming on Hulu and Amazon Prime. With the release of Deepdub GO, the company says it now offers high-quality, scalable video localization to a wide range of industries.
Deepdub GO allows creators to use their voice to dub in 65 languages. The company says it’s the “first” system that offers AI to prompt emotions and control verbal emotional expression.
Deepdub CEO and co-founder Ofir Krakowski said, “The vast majority of content today is only available to a small fraction of the world’s population.” “There is tremendous value unlocked by bringing educational, business and relationship content to a global audience. Auto-generated subtitles are helpful but not compelling and accessible to many.” and is completely unsuitable for many forms of content, such as fitness videos.”
The new Deepdub Go platform is designed to facilitate content localization with a system that delivers both superior audio quality and emotional resonance. It features human-like sounds, first-of-its-kind emotive voice-guided technology, and a robust composer for creating high-quality audio clones. The professional platform’s capabilities extend to editing audio characteristics, language and translations, in addition to powerful editing features such as length and word count controls for lip-sync adjustments. In addition to duplicating the original voice, users can choose from thousands of platform voices across 65 languages to suit any style, the company reports.
Deepdub GO gives content creators fine-grained control over the emoting of the generated audio through ’emotional prompts’. This is a new approach that utilizes a custom Large Language Model (LLM) that allows users to control performance via text prompts. In addition, the platform allows control by “voice guides”. This is a technology developed by Deepdub to achieve theater-grade results for Hollywood movies. Users can provide voice recordings that act as guides for desired emotional expressions in AI-generated audio, the company explained.
“For the first time ever, professional-level dubbing is available for all types of content, including corporate training videos, college courses, influencer videos,” Krakowski said. “Deepdub GO enables global storytelling and empowers content creators to resonate with their audiences in a deeper, more personal way. Our studio platform allows creators to connect to traditional geographic and linguistic It can extend the potential reach of any content beyond the boundaries of the world.”
Users simply upload their videos to the Deepdub GO platform, select the video style and preferred language, and the videos are instantly available for download. The end-to-end process includes automatic transcription, translation, speech generation and audio mixing. The user has full control over every step of the process and can edit and adjust according to their needs. Deepdub GO is also available as an API, allowing integration into existing tools and automated workflows.
