Nicheloom visits: 58,069 all-time · 7,637 in the last 7 days

The opportunity tracker for new startups.

Today: 1,953 launches · Niche of the day: specialized calculation tools · See what launched today →

Trying to fix the web scraping industry's benchmark problem

Get picks like this daily. Today's launch numbers, the top launches, AI and tech news, and a daily opportunity pick, straight to your inbox.

Want to reach these readers? Sponsor an issue.

We've been trying to evaluate web scraping companies, but when you look at their benchmarks, you can't verify anything, and they mostly exist to prove the company is successful. They put somewhere between 98% and 100% because they pick their own urls, define success their own way, and don't publish the harness. We also saw companies like scrapfly astroturf websites like scrapeway and call them independent.So, we built an open source benchmark that we want to represent the frontier of web data. We're trying to look across all major anti-bot providers and industries, to build a comprehensive hard-target test set. It's all in the repo, you can run it, and we pledge to maintain it monthly.Curious what people think we could do to improve it? Would you change any of the conditions, add sites, etc. Our target list and pass criteria are something we're trying to improve, so would love to get feedback from the community on how we can actually provide something useful for people to test against!

HN · launched Jul 16, 2026 · 18 upvotes (top 31%) · 0 views

Niche: web scraping tools and apis · 172 launches, 12 in the last 7 days ▲ +9% · Explore this niche →

Category and tags

  • Horizontal
  • Observability & eval
  • Developer
  • Not AI
  • Commercial product

Visit website ↗ Source listing ↗

Could you build this?

Partial The benchmarking dashboard and test orchestration UI can be vibe-coded, but running automated scraping evaluations against hostile anti-bot defenses requires massive proxy infrastructure and reverse-engineering skills.

What it would actually take: The architecture requires a distributed worker cluster executing headless browsers across rotating residential and mobile proxy pools, paired with automated fingerprint analysis. The hard part is continuously bypassing and accurately measuring responses against advanced bot mitigations (Cloudflare, Akamai, Datadome, TLS/JA4 fingerprinting, CAPTCHA challenges) without burning proxy fleets. This requires deep web scraping and reverse-engineering domain expertise.

Discussion

No comments on this launch.

Competitors

Other products that read as similar to this one : 343 launches clear the similarity bar, closest 8 shown.

Attention rank: #101 of 344 (itself plus its competitors, highest first, normalized so YC and Product Hunt are compared fairly).

Launched 258 days after the earliest competitor.

The niche, labels, vibe code rating and competitor comparison on this page are analysis by Nicheloom. If you use them, please credit nicheloom.com. How you may use our data.