Llama2.c runs on a 2006 iPod @ 80 MHz with 64 MB RAM and no FPU, using integer math and lookup tables for exp/softmax and RMSNorm on a 15M model
Read the original at www.reddit.com→hardware: PortalPlayer PP5022, ARM7TDMI @ 80 MHz, 64 MB ram wrote a fun rockbox plugin that runs Karpathy's llama2.c TinyStories models on an ipod video 5.5G. since there's no FPU, I ported llama2.c's int8 runq.c to...
Original headline: "llama2.c on a 2006 iPod @ 80 MHz w/ 64 MB ram and no FPU"
Coverage timeline
- Nov 1, 19:15 UTC r/LocalLLaMA lead source llama2.c on a 2006 iPod @ 80 MHz w/ 64 MB ram and no FPU