With ‘AI slop’ distorting our reality, the world is sleepwalking into disaster | Nesrine Malik
www.theguardian.com
A perverse information ecosystem is being mined by big tech for profit, fooling the unwary and sending algorithms crazy, says Guardian columnist Nesrine Malik

There are two parallel image channels that dominate our daily visual consumption. In one, there are real pictures and footage of the world as it is: politics, sport, news and entertainment. In the other is AI slop, low-quality content with minimal human input. Some of it is banal and pointless – cartoonish images of celebrities, fantasy landscapes, anthropomorphised animals. And some is a sort of pornified display of women just simply … being, like a virtual girlfriend you cannot truly interact with. The range and scale of the content is staggering, and infiltrates everything from social media timelines to messages circulated on WhatsApp. The result is not just a blurring of reality, but a distortion of it.

A new genre of AI slop is rightwing political fantasy. There are entire YouTube videos of made-up scenarios in which Trump officials prevail against liberal forces. The White House account on X jumped on a trend of creating images in Studio Ghibli style and posted an image of a Dominican woman in tears as she is arrested by Immigration and Customs Enforcement (Ice). AI political memefare has, in fact, gone global. Chinese AI videos mocking overweight US workers on assembly lines after the tariff announcement raised a question for, and response from, the White House spokesperson last week. The videos, she said, were made by those who “do not see the potential of the American worker”. And to prove how pervasive AI slop is, I had to triple-check that even that response was not itself quickly cobbled-together AI content fabricating another dunk on Trump’s enemies.

The impulse behind this politicisation of AI is not new; it is simply an extension of traditional propaganda. What is new is how democratised and ubiquitous it has become, and how it involves no real people or the physical constraints of real life, therefore providing an infinite number of fictional scenarios.

  • Rhaedas@fedia.io
    41·
    23 hours ago

    AI certainly can be a tool to combat it. Such things should have been hardcoded within these neural nets to have some type of watermarking way before it became a problem, but now as far as it’s gone and in the open, it’s a bit too late for that remedy.

    But when tools are put out to detect what is and isn’t AI, trust will develop in THOSE AI systems, and then they could be manipulated to claim actual real events aren’t true. The real problem is that the humans in all of this from the beginning are losing their ability to critically examine and verify what they’re being shown. I.e., people are gullible, always have been to a point, but are at the height now of believing anything they’re told without question.