Cluster1 sources· last seen 4h ago· first seen 4h ago
Qwen3.5-4B GGUF quants comparison (KLD vs speed) - Lunar Lake
I wanted to know which type of quant is the best on this laptop (Intel 258V - iGPU 140V 18GB), so I tested all these small quants hoping that it generalizes to bigger models: **Winners in bold (KLD≤0.01)** | Uploader | Quant | tk/s | KLD | GB | KLD/GB* | | --- | --- | --- | --- | --- | --- | | m
Lead: r/LocalLLaMABigness: 24qwen35-4bggufquantscomparison
📡 Coverage
10
1 news source
🟠 Hacker News
0
🔴 Reddit
56
70 upvotes across 1 sub
📈 Google Trends
0
Full methodology: How scoring works
Receipts (all sources)
Qwen3.5-4B GGUF quants comparison (KLD vs speed) - Lunar Lake
REDDIT · r/LocalLLaMA · 4h ago · ⬆ 70 · 💬 6
score 122
I wanted to know which type of quant is the best on this laptop (Intel 258V - iGPU 140V 18GB), so I tested all these small quants hoping that it generalizes to bigger models: **Winners in bold (KLD≤0.01)** | Uploader | Quant | tk/s | KLD | GB | KLD/GB* | | --- | --- | --- | --- | --- | --- | | m