A feasibility condition for confidence-gated tiered LLM inference
Read the original at arxiv.org→arXiv:2611.05394v1 Announce Type: new Abstract: Tiered inference distributes large language model computation across a hierarchy of devices, from on-device and edge hardware to the datacenter, and is increasingly...
Original headline: "A Feasibility Condition for Confidence-Gated Tiered LLM Inference"
Coverage timeline
- Nov 5, 05:00 UTC arXiv cs.AI lead source A Feasibility Condition for Confidence-Gated Tiered LLM Inference