ClockRoPE: Random Fourier Rotations for Temporal Routine Modeling
Read the original at arxiv.org→arXiv:2607.26369v1 Announce Type: new Abstract: Rotary Position Embedding (RoPE) has been widely adopted in transformer-based large language models. However, its log-linear frequency schedule, originally designed to...
Coverage timeline
- Jul 30, 04:00 UTC arXiv cs.LG lead source ClockRoPE: Random Fourier Rotations for Temporal Routine Modeling