Let the gate decide: per-lookup precision for quantized conditional memory in LLMs
Read the original at arxiv.org→arXiv:2610.35985v1 Announce Type: new Abstract: Conditional memory layers, such as DeepSeek's Engram, attach large hashed n-gram tables to a language model, and removing them from DeepSeek-V4.1-Flash costs 36.8...
Original headline: "Let the Gate Decide: Per-Lookup Precision for Quantized Conditional Memory in LLMs"
Coverage timeline
- Oct 28, 04:00 UTC arXiv cs.LG lead source Let the Gate Decide: Per-Lookup Precision for Quantized Conditional Memory in LLMs