Cluster1 sources· last seen 50m ago· first seen 50m ago
A very basic litmus test for LLMs "ok give me a python program that reads my c: and put names and folders in a sorted list from biggest to small"
Then ask your cloud FOTM api to verify the code it spit. I thought it was an easy question, but my local ones just died on it, with wrong executions, double-reading the sizes of files, putting recursive functions inside recursive functions. I think I got my magic test.
Lead: r/LocalLLaMABigness: 14basiclitmustestllmspython
📡 Coverage
10
1 news source
🟠 Hacker News
0
🔴 Reddit
26
5 upvotes across 1 sub
📈 Google Trends
0
Full methodology: How scoring works
Receipts (all sources)
A very basic litmus test for LLMs "ok give me a python program that reads my c: and put names and folders in a sorted list from biggest to small"
REDDIT · r/LocalLLaMA · 50m ago · ⬆ 5 · 💬 3
score 111
Then ask your cloud FOTM api to verify the code it spit. I thought it was an easy question, but my local ones just died on it, with wrong executions, double-reading the sizes of files, putting recursive functions inside recursive functions. I think I got my magic test.