AI content, deep fake big headache above all during polls

NEW DELHI: As political parties go all out to woo voters ahead of the general elections, cybersecurity experts have raised concern over the possible misuse of artificial intelligence and deepfake technology, among others, to influence the electorate.

The Election Commission of India has already issued standard operating procedures for identification and quick response to fake news and misinformation.

“Deepfake videos and voice cloning are two tools that could be massively used during the election campaign,” a senior officer of the Delhi Police’s cyber crimes unit said. He believes that a major challenge before the police is timely detection of such content and taking prompt action.

There is no technology available that can automatically detect and differentiate between original and fake video content created using artificial intelligence (AI).

“By the time it gets noticed, the damage is already done because it gets spread on social media,” the officer said.

In January 2024, during the New Hampshire primary of the Democratic Party in the US, a robocall mimicking President Joe Biden’s voice falsely advised voters not to participate, claiming it would affect their eligibility for the general election.

In Slovakia, an AI-generated voice, mimicking that of a liberal candidate, discussing plans to raise alcohol prices and rig the election was widely circulated on Facebook.

Similarly, a manipulated audio clip falsely implicated a presidential candidate in plans to manipulate ballots during the Nigerian elections of February 2023.

In Bangladesh, deepfake videos of opposition politicians Rumin Farhana in a bikini and Nipun Roy in a swimming pool

— Triveni Singh, Former IPS officer and cybersecurity expert

surfaced on social media ahead of the national elections.

Former Indian Police Service (IPS) officer and cybersecurity expert Triveni Singh said the widespread dissemination of AI-generated misinformation can erode public trust in the electoral process and democratic institutions. The government should engage with stakeholders, including cybersecurity experts, tech companies and civil society organisations, to develop transparent and fair guidelines for evaluating and approving AI tools, Singh said.

Widespread dissemination of AI-generated misinformation can erode public trust in the electoral process and democratic institutions