Rahul Gandhi, the leader of the Congress, is heard taking the oath of office as India’s prime minister in an artificial intelligence (AI) voice clone that has gone viral.
Supporters of the Congress were observed using the voice clone in tandem with music and a video montage that included images of the Red Fort in Delhi and Mr. Gandhi.
Social media users shared the video with the caption, “The day is soon… on June 4… The Prime Minister will be Rahul Gandhi…”, and it quickly went viral.
June 4 refers to the day of counting for the ongoing Lok Sabha elections when the results for elections are expected to be announced.
Fact-checker BOOM downloaded the video, separated the audio file to run it through two different AI detection tools, and found it to be an AI voice clone. It first ran the audio clip through Itisaar, a deepfake analysis tool created by the Indian Institute of Technology (IIT) Jodhpur. The tool confirmed that the audio has been AI-generated.
BOOM also tested the audio clip through another deepfake detection tool contrails.ai, which further confirmed that the audio clip has been generated using AI voice cloning.
The report that contrails produced.AI claimed that a “very cheap AI audio clone mixed with loud BG music” was the method utilized to create the audio.
A rise in political deepfakes on the internet has been observed in India in connection with the ongoing Lok Sabha Elections of 2024. In the past, BOOM fact-checked a number of videos in which celebrities were deceitfully attributed with a political message by AI.
We also fact-checked an AI voice clone of Congressman Kamal Nath last week, in which he was heard endorsing Muslims with land for building mosques and reintroducing Article 370.
Read More