The Independent finds that AI-generated influencers are spreading unchecked far-right rhetoric on Facebook to millions of people

AI Video & Visuals


a The nurse broke down in tears and claimed she was fired for posting her opinions about immigration online. Farmers accuse the Labor government of deliberately destroying British agriculture to import foreign meat. A man watches over migrants as they arrive on British shores, claiming they will be given luxurious accommodation on arrival.

These politically divisive videos about Britain have racked up millions of views, but they’re all created using artificial intelligence (AI) and produced by people more than 5,000 miles away.

The page ‘Life in Britain’ has over 100,000 followers on Facebook. Even though all the videos are generated by AI, they do not include any warnings from Facebook, which is owned by parent company Meta. independent person We reported this to the technology company over a month ago.

Facebook transparency information posted on the page shows that the page’s administrators are based in Sri Lanka, even though it produces content for a UK audience.

This AI-generated video claims to show a large-scale protest in central London
This AI-generated video claims to show a large-scale protest in central London (facebook)

said experts at Resemble AI, a deepfake and synthetic media detection company. independent person This account may be part of an AI-generated influence campaign aimed at amplifying British political discourse online.

Similar AI analyzes videos independent person They discovered several signs generated using AI, including unnatural audio and visual defects such as facial distortions. The video was rated 97% likely to have been generated by AI.

“It’s not uncommon to receive social engineering attacks from foreign organizations. Sometimes we receive scam calls that don’t originate from within the UK at all. This one looks very similar.” Similar to AI said Independent.

Facebook reported independent person On May 29, the company announced that it was investigating the account after it was reported, but did not provide a timeline for the investigation or whether any action would be taken.

when asked independent person Facebook did not respond to questions about whether the account was monetized.

Dr. Lukasz Oleinik, Visiting Senior Research Fellow in the Department of War Studies, told KCL. The Independent: “The use of AI-generated influence and propaganda content is on the rise. AI-generated videos are particularly important because they can create false visual evidence that is easy to share, emotionally convincing, and difficult to quickly verify. These tools can be used by individuals, coordinated non-state and state actors.”

This AI-generated video falsely claimed to show migrants arriving in the UK by boat
This AI-generated video falsely claimed to show migrants arriving in the UK by boat (facebook)

Dr Oleinik added: “The risk for the UK is not only that voters could believe a single false video, but that repeated exposures could undermine trust in institutions, journalism, elections and foreign policy decisions.”

“In leadership, including during times of crisis. This creates opportunities for external actors to capitalize on sensitive political debates, such as security, immigration, protests, defense policy, and relations with allies.”

The potential impact of this type of online content has gone unnoticed. An investigation submitted to the House of Commons Home Affairs Committee last year showed that AI-generated images depicting Muslims as a threat fueled the 2024 Southport riots.

Far-right accounts were reportedly spreading manipulated images online that reinforced racist stereotypes, including depictions of Muslims carrying guns or wearing suicide vests.

A study by the London School of Economics found that social media posts containing visual depictions of these racist conspiracy theories were amplified 30 percent more than other posts.

LSE researchers warned that the rise of AI-generated content, coupled with the way social media algorithms reward divisive content, is accelerating radicalization and making extremist ideas more visible.

The rise of online disinformation prompted London Mayor Sadiq Khan last month to pledge £7m to tackle the problem, saying the capital was under a “relentless and unprecedented attack of lies and hate”.

The announcement followed a Greater London Authority (GLA) report which found that online posts depicting London as a declining and increasingly dangerous city had increased by 200 per cent in the past two years.

This AI-generated video claims to show migrants arriving in the UK by boat
This AI-generated video claims to show migrants arriving in the UK by boat (facebook)

“If I want to influence decisions, the easiest way right now is to create generative AI content and create fake AI accounts on social media platforms. That way I have a distribution channel,” Ahmed said.

He added: “These algorithms get that content out to millions of people and get viewed billions of times almost instantly. So it almost becomes a mathematical game.”

Earlier this year, Meta’s independent oversight board warned that the company needs to label AI-generated content on its platform more aggressively and “more frequently.”

They recommended that Meta invest in more powerful detection tools for AI-generated content.

The Department for Science, Innovation and Technology said: “Platforms have a legal obligation to address illegal content, including content that incites violence or hatred, and we expect them to take strong action to protect their users.”

Facebook says it has clear guidelines that prohibit hate speech, harmful misinformation, deceptive conduct, and systemic abuse, and that it takes action against content that violates its policies.

Earlier this year, the tech platform removed several Vietnam-based Facebook pages that were described as: A “content farm” has been set up after BBC Wales was discovered to be using deepfakes to spread false stories about British politics.

The owner of the Life in Britain Facebook page has been approached for comment.



Source link