Georgi Gerganov says transformers can run GGUF models directly
Georgi Gerganov says GGUF models can be run directly with transformers. He says this work brings ggml’s Metal kernels into the transformers ecosystem, increasing compatibility and performance.