GAUSS: a workload-aware analytical and Monte-Carlo simulator for LLM inference serving
Read the original at arxiv.org→arXiv:2610.37989v1 Announce Type: new Abstract: Large language model (LLM) inference has become an operational workload that fleets must provision, monitor, and bill against latency service-level objectives (SLOs)....
Original headline: "GAUSS: A Workload-Aware Analytical and Monte-Carlo Simulator for LLM Inference Serving"
Coverage timeline
- Oct 30, 04:00 UTC arXiv cs.AI lead source GAUSS: A Workload-Aware Analytical and Monte-Carlo Simulator for LLM Inference Serving