In India, political deepfakes are on the rise on the internet.
New Delhi:
An AI-generated voice clone of Congress leader Rahul Gandhi is going viral on the internet, where he can be heard taking oath as the Prime Minister of India.
Congress supporters were spotted sharing audio clones with music and a video montage showing photos of Mr Gandhi and Delhi's Red Fort.
The clip went viral on social media, with users sharing it with the caption, “The day is almost here…June 4th…The Prime Minister will be Rahul Gandhi…” You can see it here.
June 4 is the day of counting of votes in the ongoing Lok Sabha elections, and the election results are expected to be announced.
Fact checker BOOM downloaded the video, separated the audio file and ran it through two different AI detection tools, finding it to be an AI audio clone. First, we ran the audio clip through Itisaar, a deepfake analysis tool created by the Indian Institute of Technology (IIT) Jodhpur. The tool confirmed that the audio was generated by AI.
BOOM also tested the audio clip through another deepfake detection tool, contrails.ai, further confirming that the audio clip was generated using an AI voice clone.
A report written by contrails.ai states that the technology used to create the audio is “a very cheap AI audio clone mixed with loud BG music.”
With the 2024 Lok Sabha elections underway, political deepfakes on the internet are on the rise in India. BOOM has used AI to fact-check several celebrity videos that were manipulated to falsely appear to be political messages.
Last week, we also fact-checked an AI voice clone of Congress leader Kamal Nath in which he promised land to Muslims to build a mosque and promised to reinstate Article 370. I heard it.
(This story was originally published by BOOM and republished by NDTV as part of Shakti Collective.)
(Except for the headline, this story has not been edited by NDTV staff and is published from a syndicated feed.)
