Benchmarks on quality degradation across Basalt, Infernix, and Strata-nvfp4; note speed vs. penalties and missing features like dynamic rope scaling and censorship switch
Read the original at www.reddit.com→While fast inference is very welcome, I would like to know if it's worth increasing the speed over strata-nvfp4 or am I paying some unacceptable penalties. One thing I've noticed with Basalt is that it doesn't have...
Original headline: "Do we have any benchmarks on quality degradation between Basalt, Infernix, Strata(-nvfp4)? Not "engine go more brr" benchmarks, exploring wrong avenues fast is worthless."