Orthrus enables efficient iterative retrieval with heterogeneous batching for embedding and generative models in a single serving system
Read the original at arxiv.org→arXiv:2609.25405v1 Announce Type: new Abstract: Modern information retrieval increasingly employs both embedding and generative models to handle complex queries. However, current serving systems suffer from low...
Original headline: "Efficient Iterative Retrieval with Heterogeneous Batching"
Coverage timeline
- Sep 23, 04:00 UTC arXiv cs.AI lead source Efficient Iterative Retrieval with Heterogeneous Batching