LIVE · refreshes every 20 min
updated Oct 13, 01:24 UTC
110010.art(ificial intelligence)
AI products, research, and launches — clustered and ranked, not just re-blogged.
← 110010.art all stories
r/LocalLLaMA ·1h ago

How to get more performance from dual A100 80GB?

Read the original at www.reddit.com→

Dual A100X PCIe (link at Gen4 x8, weird DPU cards) in a 2U EPYC 7402P box, 256GB DDR4. Proxmox with the GPU's passed through to debian 13, 610.43.02 drivers. llama.cpp, qwen3.8 flash next UD-Q4_K_XL, Q8_0 MTP head,...

Coverage timeline

Qwen Llama

Related stories

Open-source AI leaderboard shows the best models your machine can run locally, with rank and run commands for each model
r/LocalLLaMA · 16h ago · source ↗
Receipt scanner runs a fine-tuned 0.8B vision model on device to extract store, date, total, and line items from receipts; app tracks grocery spending without sending data to servers
r/LocalLLaMA · 19h ago · source ↗
Qwen3.8-Flash-Next Strata pi beats Claude-code Opus 5.5 on AirBench benchmark for everyday tasks.
r/LocalLLaMA · 2d ago · source ↗
Llama.cpp optimizations for specific hardware and models
r/LocalLLaMA · 4h ago · source ↗
Qwen releases QwenGyre, an elastic RL framework for training AI agents on extremely long tasks with an elastic scheduler and trajectory processor.
r/LocalLLaMA · 12h ago · source ↗