Tiny site lets you feel how fast a local LLM runs before buying GPU, using an estimate of local performance before hardware purchase.
Read the original at www.reddit.com→I made a tiny site that let's you feel how fast a local LLM runs before buying the hardware. I made it for myself and a friend but thought it could be useful for others. Note that it works as an estimate and not...
Original headline: "I built a tiny site that let's you feel the tokens/s before you buy the GPU"
Coverage timeline
- Oct 17, 06:30 UTC r/LocalLLaMA lead source I built a tiny site that let's you feel the tokens/s before you buy the GPU