Interactive 3D and 2D Visualization of GPT-2
Details
- External ID
- 47441593
- Source
- HN
- Company
- —
- Product
- Interactive 3D and 2D Visualization of GPT-2
- Website domain
- llm-visualized.com
- Launched
- March 19, 2026
- Cohort
- —
- Upvotes
- 12
- Upvotes percentile
- 0.6439114391143912
- Tags
- —
- Fetched at
- Sept. 7, 2026, 9:26 p.m.
- Updated at
- Sept. 7, 2026, 9:26 p.m.
Description
I’ve been building an interactive 3D + 2D visualization of GPT-2. It displays real activations and attention scores extracted from GPT-2 Small (124M) during a forward pass. The goal is to make it easier to learn how LLMs work by showing what is happening inside the model.The 3D part is built with Three.js, and the 2D part is built with plain HTML/CSS/JS.Would love to hear your thoughts or feedback!
Enrichment
- Theme
- multimodal generative ai and developer tools
- Vertical
- Education
- Function
- Observability & eval
- Audience
- Developer
- AI stance
- Not AI
- Project type
- Hobby / open-source project
- Normalized one-liner
- interactive visualization of gpt-2 architecture
- Manually corrected
- False
Could you build this?
Partial A web frontend with Three.js can be vibe-coded, but faithfully running GPT-2 inference in the browser or extracting and visualizing exact tensor activations, attention weights, and KV cache states requires deep transformer understanding and WebGL/WebGPU shader mastery.
What it would actually take: The stack uses WebGPU or WebGL alongside Three.js/D3.js to render massive interactive matrix transformations, token activations, and attention heads in real time. The technical barrier is implementing high-performance client-side tensor operations (or streaming multi-layer transformer internal states without UI thread bottlenecks) and managing dynamic 3D scenes with hundreds of thousands of active nodes. This requires specialized knowledge in transformer architecture internals and graphics programming/GPU compute shaders.
Discussion
2 comments analyzed.
Competitors
Other products that read as similar to this one — 101 launches clear the similarity bar, closest 8 shown.
Attention rank: #46 of 102 (itself plus its competitors, highest first — normalized so YC and Product Hunt are compared fairly).
Launched 139 days after the earliest competitor.
- NanoEuler · hn · 2026-06-19 · 6 upvotes · similarity 0.43
- The Two by Two Truth Diagram · hn · 2026-03-21 · 5 upvotes · similarity 0.43
- NanoEuler · hn · 2026-06-28 · 55 upvotes · similarity 0.43
- Seoul 3D Atlas v5.4 · ph · 2026-09-18 · 1 upvotes · similarity 0.43
- I built GPT from scratch to understand how it works · hn · 2026-01-14 · 7 upvotes · similarity 0.42
- cellular stories · ph · 2026-09-14 · 1 upvotes · similarity 0.42
- LLM Attention Visualization · hn · 2026-09-08 · 173 upvotes · similarity 0.42
- awesome-gpt-image-2-5-prompts · github · 2026-09-10 · 34 upvotes · similarity 0.42
Other launches for this product
- No other launches for this product.
Same idea, different domain
Nobody's really built a observability & eval tool for Media & entertainment yet.