Long context sweeps for Flash-Next and other models on a 4x Intel B65 rig, with offload tests to system RAM
Read the original at www.reddit.com→EDIT: Argh, forgive the formatting, .md and reddit are getting the better of me today! Howdy Folks! New batch of tests from my 4x B65 rig I built, because I was curious to test how the high memory bandwidth works out...
Original headline: "Hardly any benchmarks for Intel B65, so I got 4x and tested them. Long Context Sweeps for Flash-Next and other models"
Coverage timeline
- Oct 20, 15:57 UTC r/LocalLLaMA lead source Hardly any benchmarks for Intel B65, so I got 4x and tested them. Long Context Sweeps for Flash-Next and other models