AbliteratedOutTheBox is a llama.cpp fork that abliterates any model at inference without fine-tuning or extra files
Read the original at www.reddit.com→AbliteratedOutTheBox is a llama.cpp fork that abliterates any model you load, live at inference, with no fine-tuning and no extra files. This eliminates any hassle of abliteration without requiring any more vram. ...
Original headline: "Inference time abliteration"
Coverage timeline
- Oct 21, 22:24 UTC r/LocalLLaMA lead source Inference time abliteration