Prady Modukuru, a researcher of Indian origin, has created an amazing tool that allows you to easily translate any video into your language of choice. All you need is a YouTube link!!
Modukul posted on Twitter a video of a conversation between Meta CEO Mark Zuckerberg and Rex Fridman translated into Hindi. Here’s what it looks like.
Serial entrepreneur Modukuru is currently working on a stealth startup. His previous ventures include marketing startup Sunya and mental wellness startup Oneself (inactive). Previously, he worked with companies such as Microsoft, Cisco and Qknow.
how to use?
Modukuru leveraged GPT-4 capabilities and rapid engineering techniques to achieve seamless translation. He worked with his Eleven Labs on voice training and text-to-speech capabilities to ensure accurate phonetic representations in various languages while preserving the original speaker’s voice.
Additionally, Modukuru also utilizes wav2lip-2, which uses AI to generate realistic lip movements for accurate lip-syncing. This breakthrough in the AI industry opens up new possibilities, making it easier for users to understand informative content in their preferred language.
In the near future, this technology could revolutionize dubbing and could be used by major OTT platforms to translate content such as series and movies into other languages.
