k_llama.cpp adds MoE optimizations: expert residency, hybrid CPU/GPU execution, and Q2_0 support

Finally finished my fork: https://github.com/IceFog72/ik_llama.cpp Nothing else I wanted to add/try currently works In short, it now has: Bandwidth-adaptive CPU/GPU execution Shared expert-residency ideas from...