EGGROLL enables low-rank evolution strategies for LLMs by using rank-one Gaussian products instead of dense perturbations; study analyzes mean update field at finite rank and perturbation radii
Read the original at arxiv.org→arXiv:2609.10980v1 Announce Type: new Abstract: EGGROLL makes evolution strategies (ES) practical for LLMs by replacing dense Gaussian weight perturbations with low-rank Gaussian products, often of rank one. This...
Original headline: "EGGROLL, Unrolled: Understanding and Improving Low-Rank Evolution Strategies at Scale"
Coverage timeline
- Sep 11, 04:00 UTC arXiv cs.LG lead source EGGROLL, Unrolled: Understanding and Improving Low-Rank Evolution Strategies at Scale