Transformers now runs llama.cpp quants

TL;DR - Hugging Face announced that Transformers can now run llama.cpp quantized models. Based on the title alone, this suggests improved interoperability for memory- and compute-efficient local inference; implementation details and supported formats are not provided.

• Adds llama.cpp quant compatibility to the Transformers ecosystem.
• Quantized models typically reduce inference memory and compute requirements.
• The available metadata does not specify supported architectures, quantization levels, performance, or usage instructions.