Recurrent Looped Transformer: a model with a parallel causal encoder and recurrent decoder that grows computation with sequence length per token

arXiv:2610.07591v1 Announce Type: new Abstract: State tracking requires an update at every input, but the depth a Transformer applies to each token is fixed regardless of sequence length. We introduce the Recurrent...