LLM inference dashboard offers local, scalable logging and metrics across multiple engines; not public yet but seeks interest
Read the original at www.reddit.com→Working on a resource dashboard, rich logs, lightweight 64mb cap, all local, scales on network API endpoints via collector, supports multiple engines (llama, strata, custom cuda engines, unsloth, LMS) Not public...
Original headline: "LLM Inference Dashboard"
Coverage timeline
- Oct 4, 18:00 UTC r/LocalLLaMA lead source LLM Inference Dashboard