Connect with us

Tech

Experts fear AI deepfakes can deceive voters in Pakistan, India other Asian nations

Published

on

Divyendra Singh Jadoun was busy making artificial intelligence-based visual effects and voice clones for film and television in India, when he began getting calls from politicians: could he create AI videos, or deepfakes, for their election campaign?

With a hotly-contested local election in his home state of Rajasthan last November, and a national election due by May this year, the opportunity for his company, The Indian Deepfaker, is tremendous. But Jadoun was reluctant.

“The technology to create deepfakes is so good now, it can be done almost instantaneously, with very little effort – and people cannot tell if it’s real or fake,” said Jadoun, 30.

“There are no guidelines on deepfakes, and that’s worrying, as it has the potential to influence how a person votes,” he told the Thomson Reuters Foundation.

Instagram reels of Indian Prime Minister Narendra Modi singing in regional languages have gone viral recently, as have TikTok videos of Indonesian presidential candidates Prabowo Subianto and Anies Baswedan speaking in fluent Arabic.

But they were all created with AI, and posted with no label.

With elections due in India, Indonesia, Bangladesh and Pakistan in the coming weeks, misinformation is rife on social media platforms, with deepfakes – video or audio made using AI and broadcast as authentic – being particularly concerning, say tech experts and authorities.

In India, where more than 900 million people are eligible to vote, Modi has said deepfake videos are a “big concern”, and authorities have warned social media platforms they could lose their safe-harbour status that protects them from liability for third-party content posted on their sites if they do not act.

In Indonesia – where more than 200 million voters will go to the polls on Feb 14 – deepfakes of all three presidential candidates and their running mates are circulating online, and have the potential to influence election outcomes, said Nuurrianti Jalli, who studies misinformation on social media.

“From microtargeting of voters with disinformation to spreading false narratives at a scale and speed unachievable by human actors alone, these AI tools can significantly influence voter perceptions and behaviour,” she said.

“In environments where misinformation is already prevalent, AI-generated content can further skew public perception and influence voting behaviour,” added Jalli, an assistant professor at Oklahoma State University’s media school.

‘Political propaganda’

Deepfake images and videos churned out by generative AI tools such as Midjourney, Stable Diffusion and OpenAI’s Dall-E popped up ahead of elections from New Zealand to Turkey and Argentina last year, with growing concerns about their impact on US presidential polls in November.

AI makes the creation and spread of disinformation faster, cheaper and more effective, the US non-profit Freedom House said in a recent report.

In Bangladesh — where Prime Minister Sheikh Hasina is set for her fourth straight term after polls on Jan 7 — deepfake videos of female opposition politicians Rumin Farhana in a bikini and Nipun Roy in a swimming pool have emerged.

While they were debunked quickly, they are still circulated, and even poor-quality deepfake content is misleading people, said Sayeed Al-Zaman, an assistant professor of journalism at Bangladesh’s Jahangirnagar University, who studies social media.

“Given the low levels of information and digital literacy in Bangladesh, deepfakes can be potent carriers of political propaganda if crafted and deployed effectively,” he said.

“But the government does not appear concerned.”

The ministry of information did not respond to a request for comment.

In Pakistan, where an election is scheduled for Feb 8, Imran Khan, who is in prison on an official secrets acts case after being ousted as prime minister last year, used a AI-generated image and voice clone to address an online election rally in December, which drew more than 1.4 million views on YouTube and was attended live by tens of thousands.

While Pakistan has drafted an AI law, digital rights activists have criticised the lack of guardrails against disinformation, and to protect vulnerable communities including women.

“The threat that disinformation poses to elections and the overall democratic process in Pakistan cannot be stressed upon enough,” said Nighat Dad, co-founder of the non-profit Digital Rights Foundation.

“In the past, disinformation on online platforms has managed to sway voting behaviour, party support, and even influenced legislation change. Synthetic media will make this easier to do,” she added.

‘Dangerous sign’

At least 500,000 video and voice deepfakes were shared on social media sites globally in 2023, estimated DeepMedia, a company developing tools to detect synthetic media.

Platforms have struggled to keep up.

Meta, which owns Facebook, Instagram and WhatsApp, said it aims to remove synthetic media when the “manipulation is not apparent and could mislead, particularly in the case of video content”.

Google, which owns YouTube, said in November that the video sharing platform requires “creators to disclose altered or synthetic content that is realistic, including using AI tools, and we’ll inform viewers about such content through labels”.

But countries including India, Indonesia and Bangladesh have recently passed laws to more closely police online content and penalise social media sites for content deemed misinformation, so platforms are “holding their punches”, said Raman Jit Singh Chima, Asia policy director at advocacy group Access Now.

In these countries, “this election cycle is actually worse than the last cycle – platforms are not set up to handle problems, and they are not being responsive and proactive enough. And that’s a very dangerous sign,” he said.

“There is a danger that the world’s attention is only on the US election, but the standards being applied there, the effort being made there should be duplicated everywhere,” he added.

In India, where Modi is widely forecast to win a third term, Jadoun — who had declined to make deepfake campaign videos for the state elections — is gearing up to make them for the general election.

These will be personalised video messages from politicians for party workers, not voters, that can be sent on WhatsApp.

“They can really have an impact, because there are hundreds of thousands of party workers and they will, in turn, forward them to their friends and family,” he said.

“But we will add a watermark to show that it is made with AI, so there is no misunderstanding. That’s important.”

Latest News

Will artificial intelligence overtake coding? The head of Google Research expresses dissent.

Published

on

By

In the context of swift developments in artificial intelligence (AI), Yossi Matias, Head of Research and Vice President at Google, has emphasised the enduring significance of coding as an essential ability.

Despite the abundance of AI tools in coding and development, Matias asserts that human coders are indispensable, especially in comprehending the principles of programming.

In a recent interview with Business Insider, Matias elucidated AI’s function in the technology sector, underscoring that, although transformational, the technology is not expected to supplant human developers.

The fundamental concept of mastering essential subjects continues to hold significant importance. He asserted that everyone ought to acquire coding skills, emphasising its significance in the contemporary technological environment.

Matias’s comments arise as several individuals in the technology sector voice apprehensions regarding AI’s capacity to automate programming activities. Instruments such as GitHub Copilot have prompted conjecture over AI’s influence on conventional programming positions, with some asserting that these tools can save coding time by up to 70 percent. Matias contended that AI is now inadequate for managing the intricacies of the coding process entirely, particularly due to the necessity of human intuition and oversight to enhance AI-generated code.

“AI can aid in specific tasks, particularly at the junior level, but it has not yet assumed control of the entire coding process,” Matias elucidated. He observed that although AI can streamline repetitive processes, it is devoid of the complex decision-making abilities that seasoned programmers provide to software development.

Matias recognised that current trends in the technology sector provide difficulties for junior developers, who may find it challenging to gain the practical expertise required in a field increasingly augmented by AI tools. In response, Google has been endorsing projects to assist young talent, facilitating the connection between coding theory and actual application.

Matias posited that coding, akin to mathematics, is a fundamental ability in the digital era. “Coding resembles fundamental mathematics,” he stated, elucidating that individuals beyond the software sector gain advantages from a core comprehension of programming. The sentiment emphasises his belief that coding is essential not only within

Continue Reading

Latest News

IT Conference: Shaza Reports A 25% Increase in Pakistan’s Exports

Published

on

By

“The Pak-US Tech investment conference will be a pillar for the IT industry,” stated Shaza Fatima Khawaja, Minister of State for Information Technology (IT).

In the United States, she was giving a speech at the 2024 Pak-US Tech Investment Conference.

Shaza Fatima stated that Pakistan’s exports have grown by 25% and that our goal is to reach $25 billion in exports in accordance with Prime Minister Shehbaz Sharif’s orders.

According to the State Minister, there has been progress in giving businesses a safe online environment.

In the global cyber security index, Pakistan has been assigned the same tier-1 rank as the United States and Japan, she said.

Continue Reading

Latest News

The Pakistani government banned unregistered VPNs.

Published

on

By

The unregistered VPNs have been temporarily restricted for whitelisting purposes. Sources within the Pakistan Telecommunication Authority (PTA) classified unregistered VPNs as a ‘security risk’ for Pakistan, as they may provide access to ‘important information.’

The PTA has advised enterprises, including IT companies, software houses, freelancers, and banks, to register their IP addresses to guarantee ongoing VPN access and uninterrupted internet services for authorized customers. Registrants must disclose their intended purpose and delineate their commercial operations.

The PTA commenced the registration of VPNs in 2010, and to date, around 20,500 VPNs have been registered, according to sources.

VPNs are widely utilized globally to circumvent restricted content. In Pakistan, residents have employed VPNs to access the social media network X (previously Twitter), which has been prohibited for several months.

The government of Pakistan has declared that it will not remove the ban on X unless the platform officially registers within the nation.

Previously, to guarantee seamless commercial operations for software houses, contact centers, freelancers, and foreign embassies, the Pakistan Telecommunication Authority (PTA) initiated a one-window operation for the whitelisting of IP and VPN registrations.

Continue Reading

Trending