Physical Address
124 City Road, London EC1V 2NX
You ask for three statistics to support a point. You get three, with sources, formatted neatly.
Two of them are real. One was assembled out of thin air, and it is written in exactly the same tone as the other two.
That is an AI hallucination, and the reason it catches so many people is not that AI gets things wrong. Everything gets things wrong. It is that there is no tell. No hedging, no “I think,” no slightly awkward sentence where the tool was unsure. The invented one is often the tidiest of the three.
ā Quick Answer: An AI hallucination is a confident, well-written statement that happens to be false. The tool is not lying, and it is not broken. It has no mechanism for knowing the difference, so the fix is a checking habit on your side, not a better prompt.
š± Why It Happens, in Plain English
An AI tool is not looking things up. That is the part most explanations skip.
It is predicting what the next piece of text should be, based on patterns in an enormous amount of writing. Ask it for a statistic, and it produces something shaped exactly like a statistic. A number, a percentage, a plausible-sounding source. Whether that particular number ever existed is not a question it is able to ask.
Most of the time the thing that fits is also the thing that is true, because most of what it learned from was accurate. That is why it is genuinely useful. But when there is a gap, it fills the gap rather than leaving it empty, and it fills it in the same confident voice.
Confidence is not evidence. A polished answer proves the tool is good at writing. It proves nothing at all about whether the content is correct.
š What It Looks Like in Real Work
The abstract version is easy to nod along to. The version that actually costs you something is far more ordinary.
Say you are writing a post comparing email platforms, and you ask AI for the free-plan limits of three of them.
Back comes a neat table. Three platforms, three subscriber caps, three monthly send limits, all formatted properly, all sounding equally certain. Two are current. One was accurate eighteen months ago and quietly changed, or was never right in the first place.
Nothing in that table tells you which one. There is no asterisk on the wrong row, no softer wording, no hedge. The invented figure sits there in the same font as the real ones.
Now picture publishing it. Someone signs up for a platform expecting a limit that does not exist, and finds out at the exact moment it matters, which is usually the moment they were deciding whether to trust you.
The same thing happens with affiliate commission rates, refund windows, whether one tool integrates with another, plugin version numbers, and pricing tiers. Every one of those is a fact sitting on a page you could open in ten seconds. Every one of them is something an AI tool will state confidently without opening anything.
That is the risk in a sentence, and it is also the fix. If a claim has a source page behind it, go and look at the source page.
ā ļø It Is Not a Prompting Problem
There is a common response to this: you just need better prompts.
It is worth being honest that this does not hold up. When the argument flared up on X recently, one developer pushed back on it directly:
“some people said that this was a prompting skill issue. i dont think it is, literally everyone (including experienced AI devs) has the same problem… if its horrible for people who know how to do it its gonna be abysmal for average users.”
The companion thread on r/ChatGPT drew hundreds of comments arguing the same fight.
Better instructions genuinely help with tone, length, format, and focus. They do not give the tool a way to verify itself, because that ability was never in there to begin with.
Which is quietly good news. It means you can stop hunting for the prompt that fixes it and put that time into the check instead.
š The Two-Minute Check That Catches It
Not everything needs verifying. That is the mistake that makes people give up on checking altogether, because checking everything genuinely does take longer than writing it yourself.
Sort the output into two piles.
1ļøā£ Low risk, no check needed. Structure and outlines. Rewrites of notes you already wrote. Explanations of something you already understand well enough to spot an error. Suggestions and questions. If it is wrong here, you will notice, because it is your own material coming back.
2ļøā£ High risk, always check. Any statistic or number. Any named source, study, or book. Any link. Any direct quote. Any price, date, or version number. Any claim about what a specific tool does or how a platform works.
The rule underneath both piles is short enough to remember: check anything you would not want your name attached to.
Verify against the original, not against a second AI answer. Asking a tool whether its own output is accurate produces another confident paragraph, which is the same problem wearing a different hat.
ā Common Mistakes With AI Hallucinations
š« Trusting a claim because the writing around it was good. Fix: quality of prose and accuracy of content are unrelated. Judge them separately.
š« Publishing a link the tool produced without opening it. Fix: click it. Invented URLs are one of the most common forms this takes, and one of the easiest to catch.
š« Checking the first draft carefully, then not the fifth. Fix: the check belongs to the task, not to your mood. Later drafts are exactly where confidence quietly replaces verification.
š« Asking the AI to fact check itself. Fix: go to the original source. A second opinion from the same tool is not a second opinion.
šÆ Final Thoughts
An AI hallucination is not a sign you picked the wrong tool or wrote a bad prompt. It is a normal, permanent feature of how these tools work, and once you know that, it stops being alarming and becomes something you simply account for.
Sort the output. Check the risky half. Publish what you can stand behind.
That is the entire skill, and it takes about two minutes.
š Ready for the Next Step?
Start with the full guide: AI Limitations: Where the Tool Stops and You Start
Related reading:
š Is ChatGPT Safe? What You Should Never Put Into an AI Tool
š What Is Prompt Engineering? The Honest, Simple Answer
š Does AI Content Still Rank? What Changed in 2026
š This post gives you the sorting habit. The free AI Tools Foundations workbook gives you the page you actually work through.
Inside, the AI Output Check turns the habit into six written questions you answer before anything gets published, so the check happens every time instead of only when you remember. Part 3: Review Before You Use covers what to look for beyond accuracy, including claims that need verification and examples that are not real. And Day 6 of the 7-Day Build is one job: verify the important facts, test the instructions, and confirm the thing you made has a purpose.
The whole workbook is free. You get a short preview on the page, then you add your email to carry on reading it. You can download the PDF as well if you would rather work through it offline.
Get the free AI Tools Foundations workbook ā
No hype, no pressure, just the honest starting point most guides skip.
Q: Why does AI make things up?
Because it is built to produce text that fits, not text that is true. It predicts what a good answer to your question would look like. Most of the time the thing that fits is also correct, which is why it works at all. When it is not, the tool has no way of noticing, so it writes the wrong answer in exactly the same voice as the right one.
Q: Do AI content detectors catch hallucinations?
No, and this catches people out. A detector tries to guess whether text was written by AI. It has no opinion at all on whether the text is true. A completely invented statistic written in a very human style will sail through, and a perfectly accurate paragraph you wrote yourself may get flagged. They are answering a different question.
Q: How do I fact check AI output without it taking longer than writing it myself?
Do not check everything. Check the things that carry risk. Statistics, sources, links, quotes, prices, dates, and any claim about how a tool works all get verified against the original. Structure, phrasing, and explanations of things you already know do not. That distinction is what keeps the checking to a couple of minutes rather than an afternoon.
Q: Does a paid plan or a newer model stop it happening?
It reduces how often, but it does not remove it. Better models are more often right, which quietly makes the problem harder, because you check less carefully as your confidence grows. The habit matters more than the model.
