Beyond static RAG: an adaptive, tri-metric routing framework for efficient long-context inference on commodity GPUs
Read the original at arxiv.org→arXiv:2609.17564v1 Announce Type: new Abstract: Deploying retrieval-augmented generation (RAG) on commodity GPUs such as the NVIDIA T4 (16 GB VRAM) exposes a practical failure mode we call the Compression Paradox:...
Original headline: "Beyond Static RAG: An Adaptive, Tri-Metric Routing Framework for Efficient Long-Context Inference on Commodity GPUs"
Coverage timeline
- Sep 17, 04:00 UTC arXiv cs.LG lead source Beyond Static RAG: An Adaptive, Tri-Metric Routing Framework for Efficient Long-Context Inference on Commodity GPUs