Attenta
A from-scratch Rust Transformer trained on legal documents
Get picks like this daily. Today's launch numbers, the top launches, AI and tech news, and a daily opportunity pick, straight to your inbox.
Want to reach these readers? Sponsor an issue.
Attenta is a from-scratch Rust implementation of the Transformer architecture (Vaswani et al. 2017) built without PyTorch or TensorFlow. Designed for high efficiency, it features multi-head attention, BPE tokenization, and custom matrix multiplication. This release comes pre-trained on Indian legal documents, showcasing a pure Rust pipeline for specialized NLP tasks from tokenization to beam search decoding. Fully tested with 85 unit tests and ready to self-host.
PH · launched Sep 7, 2026 · 3 upvotes (top 11%) · 0 views
Niche: large language models · 191 launches, 4 in the last 7 days ▼ -33% · Explore this niche →
Category and tags
- Legal
- Model & infra
- Developer
- AI-native
- Hobby / open-source project
- Open Source
- Developer Tools
- Artificial Intelligence
- GitHub
Visit website ↗ Source listing ↗
More like this: all 191 launches in large language models →
Could you build this?
No Writing a Transformer architecture completely from scratch in Rust—implementing custom matrix multiplication, BPE tokenization, and attention without PyTorch or TensorFlow—and training it on legal corpora requires advanced systems programming, numerical linear algebra, and deep learning engineering.
What it would actually take: Building this requires writing custom BLAS/matrix math kernels or integrating SIMD/GPU compute primitives (wgpu/CUDA) in Rust, implementing forward and backward autograd passes, custom BPE tokenizers, and distributed or accelerated training routines. It requires specialized expertise in low-level systems engineering, numerical computing, and deep learning internals.
Competitors
Other products that read as similar to this one : 100 launches clear the similarity bar, closest 8 shown.
Attention rank: #12 of 101 (itself plus its competitors, highest first, normalized so YC and Product Hunt are compared fairly).
Launched 298 days after the earliest competitor.
- Proa · hn · 2026-10-15 · 107 upvotes · similarity 0.42
- RustClamp · ph · 2026-10-24 · 1 upvotes · similarity 0.41
- Proa · ph · 2026-10-20 · 2 upvotes · similarity 0.40
- Hierarchos-Native · github · 2026-09-16 · 17 upvotes · similarity 0.40
- rust_ASC · github · 2026-10-16 · 68 upvotes · similarity 0.39
- rusteerio · github · 2026-10-16 · 36 upvotes · similarity 0.39
- Rusdantic · hn · 2026-03-30 · 5 upvotes · similarity 0.38
- casita · github · 2026-09-27 · 77 upvotes · similarity 0.38
The niche, labels, vibe code rating and competitor comparison on this page are analysis by Nicheloom. If you use them, please credit nicheloom.com. How you may use our data.