The COUNT: Counting n-grams unlocks scaling on host memory and training-free adaptation.

The scaling relationship of compute and performance for language models (LMs) has been extensively studied; more recently, models are being designed to scale memory use, as well. In particular, adding embeddings for...