Graphsignal-top provides per-GPU util, memory, power, and throttling over time in the open-source Graphsignal profiler
Read the original at www.reddit.com→A few weeks ago we posted the open-source Graphsignal profiler here: wrap vllm serve / sglang serve / whatever in graphsignal-run and it serves everything it measures as JSON, mainly so an agent can read it in a...
Original headline: "graphsignal-top: a `top` for inference GPUs in the open-source Graphsignal profiler, kernels ranked by time, live, with readable names"
Coverage timeline
- Oct 12, 13:35 UTC r/LocalLLaMA lead source graphsignal-top: a `top` for inference GPUs in the open-source Graphsignal profiler, kernels ranked by time, live, with readable names