LFM3-Omni-2B runs fully offline on iPhone 18 Pro Max at ~80 tok/s using custom WebGPU kernels in a React Native app
Read the original at www.reddit.com→submitted by /u/xenovatech [link] [comments]
Original headline: "LFM3-Omni-2B running fully offline on my iPhone 18 Pro Max at ~80 tok/s, powered by custom WebGPU kernels in a React Native app."
Coverage timeline
- Nov 4, 17:08 UTC r/LocalLLaMA lead source LFM3-Omni-2B running fully offline on my iPhone 18 Pro Max at ~80 tok/s, powered by custom WebGPU kernels in a React Native app.