Does Morphological Correctness Matter for Tokenization? A Scrambled Control Study in Tagalog

arXiv:2610.20859v1 Announce Type: new Abstract: Typology-aware tokenizers are motivated by the claim that segmentation which respects morpheme boundaries preserves information that frequency-driven segmentation...