Replacing vector databases with SQLite and SIMD hypervectors in under 1.2GB VRAM (Hillock)

Disclosure: I am the creator of this project. After days of lurking and building up enough karma, I can finally post here. Every time I tried running local RAG on my own machine, I hit the exact same bottlenecks....