App runs decision models on Apple Neural Engine via Shortcuts; LiquidAI d1-3B offers about 40 ms latency on warm short-context decisions, with Shortcuts integration for events like email, iMessages, and file changes.
Read the original at www.reddit.com→LiquidAI d1-3B is currently on the Pareto frontier of the Decision Index 0.3.2 https://huggingface.co/spaces/multimodalart/jev-decision-index, and you can run it on the ANE with around 40 ms latency on warm...
Original headline: "I built an app to efficiently run decision models on the Apple Neural Engine with Shortcuts actions for OS automations"
Coverage timeline
- Oct 19, 20:23 UTC r/LocalLLaMA lead source I built an app to efficiently run decision models on the Apple Neural Engine with Shortcuts actions for OS automations