AI Regulation

Even Experts Can Fall for AI's Made-Up Stories

WNWNIAI Newsroom 1 min read(updated 15 June 2026)
Reviewed by the WNIAI Newsroom · Independent Australian AI coverage
Even Experts Can Fall for AI's Made-Up Stories — illustrative image

You might have heard that artificial intelligence, or AI, sometimes makes things up – a bit like an overeager teenager telling tall tales. This is often called an 'AI hallucination'.

What's surprising, and a little bit concerning, is that even big, reputable companies can fall for these made-up facts. A recent report from a major consulting firm, KPMG, supposedly contained a fair bit of these AI 'hallucinations'. This report then got cited by other AI systems like ChatGPT and Google Gemini, and even reputable news outlets, spreading the incorrect information further.

This isn't about blaming the technology entirely; it's a stark reminder that AI tools are just that – tools. They're only as good as the information they're fed and the checks we put in place. Even the most sophisticated AI can sometimes produce confident-sounding but completely false information. It highlights a really important lesson for anyone looking to use AI, whether it's for writing business reports or just looking up information online.

For small business owners especially, this means that while AI can save you time and effort, you absolutely can't switch off your critical thinking. Always double-check any facts, figures, or advice an AI gives you, especially if you're using it for something important. It's like checking the weather forecast before a picnic – helpful, but you still glance at the sky.

This incident shows that even the pros need to be careful. It’s a good warning for all of us that while AI is incredibly powerful, it's not foolproof, and human oversight remains crucial for accuracy and trust.

Why it matters

If you're using AI for your small business or even just to quickly find information online, this highlights the critical need to verify everything. Relying solely on AI could lead to costly mistakes or spread false information, impacting your business and reputation.

#ai bias#ai accuracy#misinformation#business risks#critical thinking#ai tools#ai regulation
Newsletter

The AI news that actually matters — explained simply.

A free daily briefing for Australians. The biggest AI updates without the tech jargon. No spam, unsubscribe anytime.

  • Free, always
  • No spam, one email a day
  • Unsubscribe in one click
  • Written for Australians

Discussion(0)

0/2000 · Posting anonymously

Loading comments…

Related articles