Rising1 sources· last seen 8h ago· first seen 8h ago
Karpathy's MicroGPT running at 50,000 tps on an FPGA
Sure, it's only 4,192 parameters, but it's a start. Project write-up here: [https://v2.talos.wtf/](https://v2.talos.wtf/) and github repository here: [https://github.com/Luthiraa/TALOS-V2](https://github.com/Luthiraa/TALOS-V2) Some of the speed comes from having the weights onboard, rather than
Lead: r/LocalLLaMABigness: 27karpathy'smicrogptrunning000tps
📡 Coverage
10
1 news source
🟠 Hacker News
0
🔴 Reddit
64
117 upvotes across 1 sub
📈 Google Trends
0
Full methodology: How scoring works
Receipts (all sources)
Karpathy's MicroGPT running at 50,000 tps on an FPGA
REDDIT · r/LocalLLaMA · 8h ago · ⬆ 117 · 💬 27
score 119
Sure, it's only 4,192 parameters, but it's a start. Project write-up here: [https://v2.talos.wtf/](https://v2.talos.wtf/) and github repository here: [https://github.com/Luthiraa/TALOS-V2](https://github.com/Luthiraa/TALOS-V2) Some of the speed comes from having the weights onboard, rather than