TinyLeague update replaces AA with KV cache efficiency as a measure for VRAM-poor local models.
Read the original at www.reddit.com→Hi folks, Today I made a significant update to Tiny League. Based on the recent developments of AA (and leaving conspiracy theories aside), I decided it's no longer a viable metric to track and use. Mostly because...
Original headline: "Important update to TinyLeague (AA out, KV efficiency in)"
Coverage timeline
- Oct 28, 12:59 UTC r/LocalLLaMA lead source Important update to TinyLeague (AA out, KV efficiency in)