Social media platforms aren’t doing enough to stop harmful AI bots, research finds
While artificial intelligence (AI) bots can serve a legitimate purpose on social media — such as marketing or customer service — some are designed to manipulate public discussion, incite hate speech, spread misinformation or enact fraud and scams. To combat potentially harmful bot activity, some platforms have published policies on using bots and created technical mechanisms to enforce those policies.
But are those policies and mechanisms enough to keep social media users safe?
New research from the University of Notre Dame analyzed the AI bot policies and mechanisms of eight social media platforms: LinkedIn, Mastodon, Reddit, TikTok, X (formerly known as Twitter) and Meta platforms Facebook, Instagram and Threads. Then researchers attempted to launch bots to test bot policy enforcement processes.
The researchers successfully published a benign “test” post from a bot on every platform.
“As computer scientists, we know how these bots are created, how they get plugged in and how malicious they can be, but we hoped the social media platforms would block or shut the bots down and it wouldn’t really be a problem,” said Paul Brenner, a faculty member and director in the Center for Research Computing at Notre Dame and senior author of the study. “So we took a look at what the platforms, often vaguely, state they do and then tested to see if they actually enforce their policies.”
The researchers found that the Meta platforms were the most difficult to launch bots on — it took multiple attempts to bypass their policy enforcement mechanisms. Although the researchers racked up three suspensions in the process, they were successful in launching a bot and posting a “test” post on their fourth attempt.
The only other platform that presented a modest challenge was TikTok, due to the platform’s frequent use of CAPTCHAs. But three platforms provided no challenge at all.
“Reddit, Mastodon and X were trivial,” Brenner said. “Despite what their policy says or the technical bot mechanisms they have, it was very easy to get a bot up and working on X. They aren’t effectively enforcing their policies.”
As of the study’s publishing date, all test bot accounts and posts were still live. Brenner shared that interns, who had only a high school-level education and minimal training, were able to launch the test bots using technology that is readily available to the public, highlighting how easy it is to launch bots online.
Overall, the researchers concluded that none of the eight social media platforms tested are providing sufficient protection and monitoring to keep users safe from malicious bot activity. Brenner argued that laws, economic incentive structures, user education and technological advances are needed to protect the public from malicious bots.
“There needs to be U.S. legislation requiring platforms to identify human versus bot accounts because we know people can’t differentiate the two by themselves,” Brenner said. “The economics right now are skewed against this as the number of accounts on each platform are a basis of marketing revenue. This needs to be in front of policymakers.”
To create their bots, researchers used Selenium, which is a suite of tools for automating web browsers, and OpenAI’s GPT-4o and DALL-E 3. The research, published as a pre-print on ArXiv, was led by Kristina Radivojevic, a doctoral student at Notre Dame, and supported by CRC student interns Catrell Conley, Cormac Kennedy and Christopher McAleer.
Contact: Brandi Wampler, associate director of media relations, 574-631-2632, brandiwampler@nd.edu
Latest ND NewsWire
- Notre Dame Forum to present ‘Fr. TED Talks’ on Catholic social tradition, featuring President Rev. Robert A. Dowd, C.S.C., and Dr. Jim O’ConnellHonoring the legacy of legendary University of Notre Dame President Rev. Theodore M. Hesburgh, C.S.C., the 2024-25 Notre Dame Forum will host “Fr. TED Talks: Ideas from the Catholic Social Tradition That We Find Inspiring,” a two-night festival on Oct. 28 and 29.
- Notre Dame Rome signs agreement with Rome’s Sovrintendenza Capitolina ai Beni CulturaliIn September, Notre Dame Rome, part of the University of Notre Dame’s global network, signed a three-year agreement with Rome’s Superintendence of Cultural Heritage, which will allow Notre Dame faculty, undergraduate students and graduate students privileged study and research access to some of the city’s most significant historic buildings and cultural artifacts.
- Democrats and Republicans agree on one thing: Censoring hate speechIn an era of intense polarization, Democrats and Republicans have historically, and mistakenly, believed that members of the other party prioritize protecting certain types or victims of hate speech over others based on stereotypes or their affiliation with those potentially vulnerable groups. New research from the University of Notre Dame, however, revealed that partisans generally agree on what to censor when it comes to the target, source and severity of hate speech.
- ‘Great powers don’t mind their own business’: Former Secretary of State Condoleezza Rice warns of perils of US isolationism at Notre Dame Forum eventAs part of the 2024-25 Notre Dame Forum, Condoleezza Rice, the 66th U.S. Secretary of State, the Tad and Dianne Taube Director of the Hoover Institution and a University of Notre Dame alumna, returned to campus Friday (Oct. 11) to speak to an overflow crowd of more than 1,000 people in the DeBartolo Performing Arts Center and hundreds more online.
- ND Expert: Han Kang, first Korean writer to win Nobel Prize in literature, ‘has irrevocably changed the landscape’On Oct. 10, the Nobel Prize in literature was awarded to Han Kang, the first Asian woman writer and the first Korean writer to win the prize. According to Hayun Cho, an assistant professor of Korean literature and popular culture at the University of Notre Dame, Han’s win is moving for many, including for readers of the Korean diaspora.
- Definitions of ‘church’ and ‘association of churches’ must be updated to prevent abuse of special legal protections, study arguesNew research from Notre Dame Law School Professor Lloyd Hitoshi Mayer highlights how the federal tax law definitions for “church” and “convention or association of churches” require revision to address multiple recent developments in the American religious landscape, including religious organizations seeking such status when Congress did not intend them to benefit from the special protections for such organizations.