RELTY
  1. RELTY
  2. Guides
  3. AI detectors
Guide · Detection

Why AI detectors disagree, and how to read their results

You upload the same picture to two AI detectors. One says it is almost certainly AI. The other says it is almost certainly real. This happens often, and it does not mean one tool is broken. This guide explains why detectors disagree and how to make sense of their results.

Updated 8 November 2026About 6 minutesHow we check guides

1. What a detector score means

Most AI detectors give a score or a percentage. Sightengine, for example, describes its score as the model's confidence, from 0 to 1, that an image was produced or edited by a generative AI model.

So a score of 0.9 means the tool is fairly sure the file looks like the AI examples it has learned from. It does not mean that 90% of the picture was made with AI. It is also not proof. Each tool sets its own scale and its own idea of what counts as "likely", so a 70% from one tool and a 70% from another are not the same thing.

2. Each tool learned from different examples

Most detectors are trained on large sets of real and AI-made files. They learn to spot patterns that the AI examples share. A tool can only recognise what looks like the material it was trained on.

Two tools trained on different examples can look at the same file and reach opposite conclusions. Both are reporting honestly what their own model sees.

3. The file you check matters

Detectors look at fine detail in the pixels or the sound. Anything that throws detail away makes their job harder.

In a 2023 test, Bellingcat found that the detector AI or Not correctly flagged all 100 original Midjourney images it was given. When ten of them were compressed to a smaller file size, it called seven photorealistic AI images the work of a human. Bellingcat concluded that the larger the file, the more accurate the detector. Sightengine also says its confidence may drop on heavily degraded images and on screenshots.

If two people check different copies of the same picture, they may get different answers for this reason alone. Always use the best copy you can find. Our guide on reverse image search shows how to find larger, earlier copies.

4. Watermark checkers answer a narrower question

Some tools do not guess from patterns at all. They look for a hidden watermark that an AI company placed in its own output. Google's SynthID Detector checks for watermarks from Google and its partners, including OpenAI, NVIDIA and Kakao. OpenAI's own checker covers content from its tools.

These tools answer a different question from a general detector. They can tell you a watermark from a particular company was found. They cannot tell you about AI tools that do not use that watermark. OpenAI says that a "not detected" result is an absence of evidence, and not proof that a person made the content.

So a watermark checker can find nothing while a general detector gives a high AI score, and both can be right. The picture may have come from a tool that adds no watermark. See what Content Credentials are for a related kind of record.

5. Detectors are wrong in both directions

Detectors miss AI content, and they also flag real content as AI.

A high AI score is not proof that something is fake. A low one is not proof that it is real. Treat every score as one clue among several.

6. Why RELTY never averages scores

Suppose one tool gives 95% AI and another gives 5%. The average is 50%, which looks like a fair middle answer. It hides the most useful thing you have learned, which is that the tools strongly disagree.

Averaging also treats every tool as equally good at every kind of file. They are not. One may be strong on faces and weak on landscapes. Another may handle compressed files better. Only the separate results let you see that.

That is why RELTY's reports will show each tool's result on its own, with what it checks and what it cannot see. When tools disagree, the report will say so. The illustrative sample report on the home page shows the idea.

7. How to read several results

The checks that do not depend on detectors often decide the case. Finding who posted it first, searching for earlier copies and reading existing fact-checks are covered in our guides to AI images and viral videos.

8. Decide what you can say

If you cannot verify something, say so, and do not share it as fact.

In the news

Recent reports from RELTY's AI news that show why this check matters.

Sources

The pages this guide relies on, checked on 8 November 2026.