FutureBridge ranks joint LLM-SLM token candidates for collaborative decoding beyond local preference
Read the original at arxiv.org→arXiv:2608.06819v1 Announce Type: new Abstract: Token-level collaboration allows a large language model (LLM) to assist a small language model (SLM) when their predictions diverge. Existing methods either use...
Original headline: "FutureBridge: Token Selection Beyond Local Preference in Collaborative Decoding"
Coverage timeline
- Aug 10, 04:00 UTC arXiv cs.CL lead source FutureBridge: Token Selection Beyond Local Preference in Collaborative Decoding