The buzz around Ramayana English trailer: Namit Malhotra DECODES DNEG’s AI-powered lip-sync technology! refuses to die down. From social media chatter to box office projections, everyone in the industry seems to have an opinion — and the latest update only strengthens the conversation.

The Story So Far

Add as a preferred source on Google The English preview of Nitesh Tiwari’s Ramayana: Part 1 has successful the shows by Sony Pictures for audiences worldwide, offering an international preview of the highly anticipated epic. While the scale and visual effects have drawn attention, one of the key talking points has been the technology used to ensure that the actors’ lip movements match the English dialogue.

Unlike conventional dubbed versions, where a fresh voice track is placed over the original footage, the English version of Ramayana: Part 1 uses DNEG’s AI-powered technology to digitally adjust the actors’ mouth movements. backer Namit Malhotra has now elaborated how the process combines human performances with technology to achieve a more natural result.

Speaking to ET Now, Malhotra stressed that the process did not begin with AI. The first step involved human voice performances, with members of the principal cast also contributing their own English voices., per the backer. “If you've seen that, where we've got tremendous praise, where we've actually brought in human actors, voice actors, who actually come in and performed the voice performances.

Some of them actually are done by the actors themselves, who have a good command over the language and are able to emote appropriately in a different language,” he said. Malhotra elaborated that this human-led approach was important to preserve the heartfelt quality of the performances. “So we've done that as a first step to make sure that the rendering of that expression and emotion is authentic, and it's led by humans.

There is no AI whatsoever,” he pointed out. The next stage involved creating the appropriate lip movements for the English dialogue. Malhotra said human artists first established the foundation for how the characters’ lips should move in sync with the fresh voice performances.

“There is no AI whatsoever. We followed that up with what we're calling, because we are trying to make the lip sync in line with the voice. So we have a next step, which is again done by humans, where you actually have people coming in, what we call a human driver that actually creates this foundation of how the lips actually move and how it syncs itself to the voice itself,” he elaborated.

According to Malhotra, the challenge was not simply matching a voice to an performer. The team also had to ensure that the voice turn, facial appearance and lip movements worked together convincingly. “And it looks appropriate because the best voice performer may not have the right face for the performer on major screen.

So we are making sure that you've got the voice actors, we've got people whose confronts and lips match the look of the actors,” Malhotra said. The final stage involved a technology tool developed specifically for the project. “And then we're using bespoke technology tool that we've created, leveraging AI, to stitch that into the face of the performer so it feels absolutely seamles…

As the story continues to develop, TeraMovies will keep you updated with every new detail. Until then, this remains one of the most closely watched entertainment stories of the week — and the conversation is only getting started.