dear robots
The public record of who blocks AI, and who doesn't
Details
- External ID
- 1246232
- Source
- PH
- Company
- —
- Product
- dear robots
- Website domain
- producthunt.com
- Launched
- Sept. 10, 2026
- Cohort
- —
- Upvotes
- 2
- Upvotes percentile
- 0.7405388069275176
- Tags
- Developer Tools, Artificial Intelligence, GitHub, Search
- Fetched at
- Sept. 12, 2026, 1:01 a.m.
- Updated at
- Sept. 12, 2026, 1:01 a.m.
Description
See which websites block AI crawlers like GPTBot, ClaudeBot and CCBot — the web's top sites checked weekly, plus a live checker for any site you name.
Enrichment
- Theme
- AI developer tools and resources
- Vertical
- Horizontal
- Function
- Analytics & BI
- Audience
- B2C
- AI stance
- Not AI
- Project type
- Commercial product
- Normalized one-liner
- public record of ai opt-out policies
- Manually corrected
- False
Could you build this?
Yes It is a directory and checker that fetches and parses public robots.txt files for specified user-agent strings (like GPTBot) and displays the historical or real-time results.
Competitors
Other products that read as similar to this one — 116 launches clear the similarity bar, closest 8 shown.
Attention rank: #21 of 117 (itself plus its competitors, highest first — normalized so YC and Product Hunt are compared fairly).
Launched 268 days after the earliest competitor.
- Dreamlaunch · ph · 2026-09-15 · 2 upvotes · similarity 0.58
- Bravo Crawler Hunter · ph · 2026-09-12 · 3 upvotes · similarity 0.56
- Robots.txt Editor & Validator · ph · 2026-09-15 · 2 upvotes · similarity 0.52
- DeployRadar · ph · 2026-09-30 · 1 upvotes · similarity 0.51
- Alovia · ph · 2026-09-29 · 1 upvotes · similarity 0.51
- botready.dev · ph · 2026-09-06 · 1 upvotes · similarity 0.47
- AI Site Check · ph · 2026-09-26 · 1 upvotes · similarity 0.46
- IndexGraph · ph · 2026-09-16 · 2 upvotes · similarity 0.44
Other launches for this product
- No other launches for this product.
Same idea, different domain
Nobody's really built a analytics & bi tool for Legal yet.