Indian origin researcher Prady Modukuru has made a remarkable tool that effortlessly translates any video into the language of your choice. All you need is a YouTube link!!
Modukuru posted a video on Twitter translating a conversation between Meta CEO Zuckerberg and Lex Fridman to Hindi. Here is the glimpse.
I built the simplest way to convert your video to other languages.
all you need is a youtube link. no install required.
curious? check out @lexfridman + zuck talking about @elonmusk in hindi. pic.twitter.com/nZBi4ZtRde— Prady (@therealprady) July 16, 2023
A serial entrepreneur, Modukuru is currently working on a stealth startup. Some of his previous ventures include marketing startup sunya and mental wellness startup Oneself (inactive). Previously, he has worked with companies like Microsoft, Cisco, Qknow among others.
How it works?
Modukuru leveraged the power of GPT-4 and prompt engineering techniques for seamless translation. To ensure accurate voice representation in different languages while preserving the original speaker’s voice, he collaborated with ElevenLabs for voice training and text-to-speech capabilities
Moreover, for achieving precise lip syncing, Modukuru has also utilised wav2lip-2, which harnesses AI for generating lifelike lip movements. This breakthrough in the AI industry opens up new possibilities, allowing users to easily comprehend informative content in their preferred language.
In the near future, this technology can revolutionise dubbing, and can be used by major OTT platforms to translate content including series and movies to any other language.
The post Indian-Origin Researcher’s AI Breakthrough Simplifies Video Translation Across Languages appeared first on Analytics India Magazine.