Llama.cpp fork AbliteratedOutTheBox performs inference-time abliteration on models; Inference time abliteration reports attention-based inhibitions and speed gains
Read the original at github.com→★ 33 stars
Original headline: "heterodoxin/AbliteratedOutTheBox: llama.cpp fork that abliterates at inference"
Coverage timeline
- Oct 21, 21:54 UTC GitHub Trending (AI) lead source heterodoxin/AbliteratedOutTheBox: llama.cpp fork that abliterates at inference
- Oct 21, 22:24 UTC r/LocalLLaMA Inference time abliteration