ggml-org/llama.cpp adds --shard support to load models from multiple shard locations and enables PLE (engram) file loading from separate GGUFs
Read the original at www.reddit.com→Overview Provides a new --shard command line argument and support for loading a model from multiple shard locations; common use case is loading the PLE (engram) files from a separate GGUF. Adds conversion support for...
Original headline: "feat: external PLE file loading by pwilkin · Pull Request #31185 · ggml-org/llama.cpp"
Coverage timeline
- Nov 10, 07:26 UTC r/LocalLLaMA lead source feat: external PLE file loading by pwilkin · Pull Request #31185 · ggml-org/llama.cpp