Simple mental model before LLM inference optimization
Read the original at old.reddit.com→LLM Inference companies are now raising Billions of dollars. I have been working on LLM inference for some time while benchmarking some latest models' inference speed (TPS, TTFT, etc) against artificial analysis...
Original headline: "A simple mental model before LLM inference optimization"
Coverage timeline
- Aug 8, 19:28 UTC r/LocalLLaMA lead source A simple mental model before LLM inference optimization