FP8/BF16 users see someone run IQ1_S
Read the original at www.reddit.com→https://preview.redd.it/egchx5bap8th1.png?width=746&format=png&auto=webp&s=ab25375dcb6c204400ac8ba9b04497ded4c34e25 Why FP8/BF16 get horrified/disgusted even with FP4/INT4 or Any 4 bit quantisation method? ...
Original headline: "FP8/BF16 users seeing someone run IQ1_S"
Coverage timeline
- Oct 3, 11:47 UTC r/LocalLLaMA lead source FP8/BF16 users seeing someone run IQ1_S