2x256gb m5u: clustering yields better results with separate models; current clustering tech and decode concurrency limitations hinder improvement
Read the original at www.reddit.com→Just an update for anyone looking to get the m5u and thinking about clustering. I tried clustering but I think running 2 separate models gets significantly better results. The current clustering technology...
Original headline: "2x256gb M5U: current status"
Coverage timeline
- Nov 8, 12:52 UTC r/LocalLLaMA lead source 2x256gb M5U: current status