AI Security

AI Chatbots Being Used To Create Fake Online Stories

WNWNIAI Newsroom 1 min read(updated 12 June 2026)
Reviewed by the WNIAI Newsroom · Independent Australian AI coverage
AI Chatbots Being Used To Create Fake Online Stories — illustrative image

You've probably heard about AI chatbots like ChatGPT – those clever computer programs that can write and chat almost like a real person. Well, a new report from OpenAI, the company behind ChatGPT, has uncovered something a bit concerning. It seems some groups overseas have been using these AI tools to create fake social media accounts and even draft posts designed to look like they're from real people.

The goal of these fake accounts, among other things, was to influence online opinions and spread certain messages. In one case, the AI was even asked to help design a system to watch what people were saying online and collect 'harmful' content from 'key persons'. Essentially, it was being used as a tool to try and manipulate public discussions and spread specific viewpoints, all while trying to stay hidden.

This isn't about blaming the technology itself – AI can do many wonderful things. But it does highlight a growing challenge: how do we tell what's real online when sophisticated AI can create such convincing fakes? For small business owners, parents, and everyday Australians, it’s a reminder to be more vigilant than ever about the information we encounter online. Always consider the source, and if something seems a bit off, it might be worth a second look.

OpenAI has taken action, shutting down these accounts and trying to prevent future misuse of their technology. It’s an ongoing battle, but knowing about these sorts of activities can help us all be savvier internet users and protect ourselves from being unintentionally influenced by AI-generated deception.

Why it matters

This matters because fake online content created by AI can make it harder for everyday Australians to trust what they read online, potentially influencing their views on important topics. For small business owners, it's a reminder that their brand's online reputation could unknowingly be affected by AI-generated misinformation.

#ai security#online safety#misinformation#chatbots#social media#ai regulation#openai
Newsletter

The AI news that actually matters — explained simply.

A free daily briefing for Australians. The biggest AI updates without the tech jargon. No spam, unsubscribe anytime.

  • Free, always
  • No spam, one email a day
  • Unsubscribe in one click
  • Written for Australians

Discussion(0)

0/2000 · Posting anonymously

Loading comments…

Related articles