‘Wild West’ for AI tools ahead of India’s election
For a glimpse of where artificial intelligence is headed in election campaigns, look to India, the world’s largest democracy, as it starts heading to the polls Friday.
An AI-generated version of Prime Minister Narendra Modi that has been shared on WhatsApp shows the possibilities for hyperpersonalized outreach in a country with nearly 1 billion voters. In the video — a demo clip whose source is unclear — Modi’s avatar addresses a series of voters directly, by name.
However, it is not perfect. Modi appears to wear two different pairs of glasses, and some parts of the video are pixelated.
Down the ladder, workers in Modi’s party are sending videos by WhatsApp in which their own AI avatars deliver personal messages to specific voters about the government benefits they have received and ask for their vote.
Those video messages can be automatically generated in whichever of India’s dozens of languages the voter speaks. So can phone messages by AI-powered chatbots that call constituents in the voices of political leaders and seek their support.
The outreach requires a fraction of the time and money spent on traditional campaigning, and it has the potential to become an essential instrument in elections. But as the technology races onto the political scene, there are few guardrails to prevent misuse.
Chatbots and personalized videos may seem more or less harmless.
Experts worry, however, that voters will have an increasingly difficult time distinguishing between real and synthetic messages as the technology advances and spreads.
“It’ll be the Wild West and an unregulated AI space this year,” said Prateek Waghre, executive director of the Internet Freedom Foundation, a digital rights group based in New Delhi. The technology, he added, is entering a media landscape already polluted with misinformation.
Around the world, elections have become a testing ground for the AI boom. The tools have been used to turn an Argentine presidential candidate into Indiana Jones and a Ghostbuster. During the New Hampshire primary, voters received robocall messages urging them not to vote in a voice that was most likely artificially generated to sound like President Joe Biden’s.
And in India, Modi’s Bharatiya Janata Party, or BJP, and the opposition Indian National Congress party have accused each other of spreading election-related deepfake content online.
One outpost on this new Indian frontier is in the western desert state of Rajasthan. On the ground floor of a residential building on a dusty back lane, a 31-year-old college dropout, Divyendra Singh Jadoun, operates an AI startup, The Indian Deepfaker.
His team of nine people has been making commercials with AI-generated avatars of Bollywood actors and actresses. But this year, political parties and politicians began asking him to do for them what he had done for celebrities. Of the 200 requests, Jadoun said, he took on 14.
Among those getting the AI treatment is Shakti Singh Rathore, a 33-year-old BJP member.
His job this election season is to tell as many people as possible about Modi’s programs and policies. So he decided to create a replica of himself.
“AI is wonderful and the way forward,” Rathore said as he settled in front of a video camera at the office of The Indian Deepfaker, preparing to become digitally incarnated. “How else could I reach the beneficiaries of Mr. Modi’s programs in such large numbers and in so short a period of time?”
As Rathore adjusted a saffron scarf with the party’s logo that hung around his neck, Jadoun instructed him, “Just look into the camera and talk as if the person is sitting right in front of you.”
With about five minutes’ worth of material, including an audio recording and profile shots, Jadoun went to work.
He said he uses open-source AI systems and builds upon them with his own code.
In one demo, it took about four minutes to create 20 personalized greeting videos. Jadoun said his team could produce up to 10,000 videos a day.
Political parties are not only texting constituents video messages but also using cloned voices to call people directly, all powered by chatbots like ChatGPT.
Narendra Singh Bhati, 28, a resort owner in Rajasthan, received an AI-generated call from Rathore this week. Bhati said he was impressed with its personalization.
He said he had not realized the call was AI-generated, though the script made that clear.
“I even said goodbye to Mr. Rathore” at the end, Bhati said.