Slop or not
can you tell AI writing from human in everyday contexts?
Details
- External ID
- 47357745
- Source
- HN
- Company
- —
- Product
- Slop or not
- Website domain
- slop-or-not.space
- Launched
- March 12, 2026
- Cohort
- —
- Upvotes
- 19
- Upvotes percentile
- 0.7312423124231242
- Tags
- —
- Fetched at
- Sept. 7, 2026, 9:26 p.m.
- Updated at
- Sept. 7, 2026, 9:26 p.m.
Description
I’ve been building a crowd-sourced AI detection benchmark. Two responses to the same prompt — one from a real human (pre-2022, provably pre prevalence of AI slop on the internet), one generated by AI. You pick the slop. Three wrong and you’re out.The dataset: 16K human posts from Reddit, Hacker News, and Yelp, each paired with AI generations from 6 models across two providers (Anthropic and OpenAI) at three capability tiers. Same prompt, length-matched, no adversarial coaching — just the model’s natural voice with platform context. Every vote is logged with model, tier, source, response time, and position.Early findings from testing: Reddit posts are easy to spot (humans are too casual for AI to mimic), HN is significantly harder.I'll be releasing the full dataset on HuggingFace and I'll publish a paper if I can get enough data via this crowdsourced study.If you play the HN-only mode, you’re helping calibrate how detectable AI is on here specifically.Would love feedback on the pairs — are any trivially obvious? Are some genuinely hard?
Enrichment
- Theme
- AI text humanizers and detectors
- Vertical
- Horizontal
- Function
- Observability & eval
- Audience
- B2C
- AI stance
- AI feature
- Project type
- Hobby / open-source project
- Normalized one-liner
- ai writing detection tool
- Manually corrected
- False
Could you build this?
Yes A Next.js trivia-style guessing game comparing two text snippets stored in a database is a textbook vibe-coding project.
Discussion
20 comments analyzed.
Concerns raised: AI detection game helps train models to be less detectable, Success rates lower than expected (90%), missing AI-generated content elsewhere, UX quality issues with the interface, Difficulty distinguishing between human and AI at higher capability levels, Dataset quality concerns - obvious tells need filtering for serious research
Feature requests: Toggle option to choose human-written or AI-generated detection mode, Clearer visual feedback - green/red card for correct/wrong answers, Publish complete dataset with all questions, answers, user metadata, and timing
Competitors
Other products that read as similar to this one — 131 launches clear the similarity bar, closest 8 shown.
Attention rank: #45 of 132 (itself plus its competitors, highest first — normalized so YC and Product Hunt are compared fairly).
Launched 133 days after the earliest competitor.
- Training a model to identify AI web content from structure alone · hn · 2026-09-22 · 73 upvotes · similarity 0.57
- AI Slop Detector · ph · 2026-09-30 · 2 upvotes · similarity 0.56
- Flag AI Slop in PRs · hn · 2026-01-16 · 6 upvotes · similarity 0.54
- The Journal of AI Slop · hn · 2025-12-03 · 5 upvotes · similarity 0.53
- Scan any website for AI design patterns · hn · 2026-07-07 · 5 upvotes · similarity 0.52
- Isitslop.xyz, a free AI-writing detector built on latest research · hn · 2026-06-15 · 5 upvotes · similarity 0.50
- Slop Awwwards · ph · 2026-09-18 · 2 upvotes · similarity 0.50
- I made a tool that prevents websites from tracking you · hn · 2026-07-03 · 31 upvotes · similarity 0.48
Other launches for this product
- No other launches for this product.
Same idea, different domain
Nobody's really built a observability & eval tool for Media & entertainment yet.