Rising1 sources· last seen 10h ago· first seen 20h ago
MTP PR Merged!!!
We've got great outputs for 27B via club 3090, but what about those of us who love the blazing speed of 35B on dual 3090s? I was getting 1500 p/p and 120 t/g with split layers, but MTP slowed it down to 80 t/g when I tested last week. I'm sticking with my CPU overflow fallback of 3500 p/p and 80 t
Lead: r/LocalLLaMABigness: 35mtpmerged
📡 Coverage
10
1 news source
🟠 Hacker News
0
🔴 Reddit
87
760 upvotes across 1 sub
📈 Google Trends
0
Full methodology: How scoring works
Receipts (all sources)
MTP PR Merged!!!
REDDIT · r/LocalLLaMA · 20h ago · ⬆ 742 · 💬 103
score 115
Now that MTP is merged... What's the best outputs you're getting on Qwen 3.6 35B on 2x3090s?
REDDIT · r/LocalLLaMA · 10h ago · ⬆ 18 · 💬 8
score 105
We've got great outputs for 27B via club 3090, but what about those of us who love the blazing speed of 35B on dual 3090s? I was getting 1500 p/p and 120 t/g with split layers, but MTP slowed it down to 80 t/g when I tested last week. I'm sticking with my CPU overflow fallback of 3500 p/p and 80 t