The Hugging Face AI Content Detector (https://huggingface.co/) is a free online app that assesses how human or AI a scanned piece of writing is. The result is displayed as percentages of how “Real” and “Fake” the text is. The AI Content Detector provides an alternative link for a more user-friendly page and interface.
Hugging Face is an open source hub for developers and researchers to share and develop AI models.[1] Due to its open-source nature, users should be extremely wary of possible security threats and providing personal information when using the site.
There are several other open source AI text detectors in the Spaces community. This review is for the AI Content Detector only.
Pros
- Free without any signup
- No character limit
- Passed the false positive test
Cons
- Open source and lacks security
- Failed 2 AI-detection tests
- Results may be difficult to read
Features
- AI content detector: Scans pasted text for AI content.
- Real/Fake rating: Provides a rating of how Real/Fake the content is.
- Spaces community: Many other AI apps can be found in Spaces.
Test #1 Hugging Face vs. LLMs
To test how good the AI Content Detector is at correctly scanning LLM-generated text as AI, we gave the below prompt to 7 different LLMs and ran the resulting texts through the detector.
Prompt Used
“Write me a short 400-word essay about climate change with the intent of being factual while also trying to sound as human as possible, specifically, to pass AI detectors. Please remove all em dashes in your generation.”
Result:
Test #2 Hugging Face vs AI Humanizers
Many LLM-users also use humanizers to make their AI texts read as more human and to bypass AI detectors.
To test the AI Content Detector against humanizers, we humanized the ChatGPT-generated text from the first test using 8 different humanizers. The humanized texts were then scanned for AI content with the results below.
The interesting thing about our results is that the AI detector performed better against humanized text than against the LLM-generated text in Test #1, correctly detecting that 2 humanized texts were AI-generated. This is surprising, because usually detectors have a harder time with humanized LLM content.
Result:
Test #3 False Positives
Some AI detectors may give “false positive” results by rating a human written text as AI-generated. To test the Hugging Face detector, we scanned 10 human-written pieces to see if they would be incorrectly labelled “Fake.”
Result:
Frequently Asked Questions
Are sentence-by-sentence breakdowns provided?
No. there is additional information provided in the scan, but it’s not explained.
Is document scanning allowed?
No. Only pasted text can be scanned.
Is image scanning included?
No. However, there are image scanners in Spaces.
Are reports shareable?
No, but the results can be copied and shared.
Does Hugging Face provide certifications?
No, there are no additional features beyond AI detection.
Are AI detections used for internal training?
Not clear. There isn’t any information stating whether or not inputted text is used to train the AI Content Detector.
Is Hugging Face Accurate?
Hugging Face has a poor TrustPilot rating of 2.5 stars based on 8 reviews, with 4 of them being 1 star. Users complain about the paid subscription, which isn’t required to use the AI Content Detector reviewed on this page.
























