22 GB of Hacker News in SQLite
Details
- External ID
- 46435308
- Source
- HN
- Company
- —
- Product
- 22 GB of Hacker News in SQLite
- Website domain
- dosaygo.com
- Launched
- Dec. 30, 2025
- Cohort
- —
- Upvotes
- 730
- Upvotes percentile
- 0.9961832061068703
- Tags
- —
- Fetched at
- Sept. 7, 2026, 9:25 p.m.
- Updated at
- Sept. 7, 2026, 9:25 p.m.
Description
Community, All the HN belong to you. This is an archive of hacker news that fits in your browser. When I made HN Made of Primes I realized I could probably do this offline sqlite/wasm thing with the whole GBs of archive. The whole dataset. So I tried it, and this is it. Have Hacker News on your device.Go to this repo (https://github.com/DOSAYGO-STUDIO/HackerBook): you can download it. Big Query -> ETL -> npx serve docs - that's it. 20 years of HN arguments and beauty, can be yours forever. So they'll never die. Ever. It's the unkillable static archive of HN and it's your hands. That's my Year End gift to you all. Thank you for a wonderful year, have happy and wonderful 2026. make something of it.
Enrichment
- Theme
- Hacker News clients, datasets, and tools
- Vertical
- Horizontal
- Function
- Data infrastructure
- Audience
- Developer
- AI stance
- Not AI
- Project type
- Hobby / open-source project
- Normalized one-liner
- hacker news dataset in sqlite
- Manually corrected
- False
Could you build this?
Partial The client-side SQLite/WASM viewer is straightforward, but downloading, chunking, indexing, and serving 22 GB of raw HN data via HTTP range requests requires specialized data pipeline work.
What it would actually take: Building this requires ETL scripts pulling the complete HN dataset via BigQuery/Firebase API, normalizing it, and generating highly optimized SQLite databases with custom full-text search indexes. Serving it in-browser demands advanced sqlite-wasm integration using HTTP range requests (like sql.js-http or absurd-sql) to page through large virtual files over CDN without crashing client memory.
Discussion
20 comments analyzed.
Competitors mentioned: DuckDB with remote HTTP/S3 Parquet files, BigQuery, Go-based VFS implementations
Concerns raised: Performance bottleneck on I/O delivery, not parsing, Mobile design needs improvement, Playback doesn't progress past first note
Feature requests: ASCII keyboard support for music playback instead of MIDI, Search functionality implementation, Daily automatic updates via CI/GitHub Actions
Competitors
Other products that read as similar to this one — 106 launches clear the similarity bar, closest 8 shown.
Attention rank: #1 of 107 (itself plus its competitors, highest first — normalized so YC and Product Hunt are compared fairly).
Launched 54 days after the earliest competitor.
- Running Analytics on 22 GB of Hacker News in SQLite · hn · 2025-12-31 · 5 upvotes · similarity 0.57
- 20 years of Hacker News discussions, clustered and visualized · hn · 2026-03-22 · 7 upvotes · similarity 0.53
- HN Hall of Fame · hn · 2026-07-22 · 219 upvotes · similarity 0.49
- Hacker Atlas · hn · 2026-09-25 · 86 upvotes · similarity 0.49
- HN Buffer · hn · 2025-11-22 · 5 upvotes · similarity 0.49
- Use Claude Code to Query 600 GB Indexes over Hacker News, ArXiv, etc. · hn · 2025-12-31 · 397 upvotes · similarity 0.47
- Trader News · hn · 2026-09-24 · 25 upvotes · similarity 0.47
- Hacker Backlinks · hn · 2026-02-06 · 6 upvotes · similarity 0.47
Other launches for this product
- No other launches for this product.
Same idea, different domain
Nobody's really built a data infrastructure tool for Media & entertainment yet.