Custom inference per model per hardware is now possible; when will custom hardware for models appear?
Read the original at www.reddit.com→Is it possible to have a custom hardware designed (by ai) and open sourced that we can send for manufacturing for specific models? like for DSF 4.1F submitted by /u/catbluesgames [link] [comments]
Original headline: "We got custom inference per model per hardware now. How long before we get custom hardware for model?"
Coverage timeline
- Nov 10, 22:04 UTC r/LocalLLaMA lead source We got custom inference per model per hardware now. How long before we get custom hardware for model?