GGUF models by lm-kit
109 GGUF models quantized by lm-kit on Hugging Face. Sizes run from 33M to 70.6B parameters. The longest trained context is 1024K tokens.
About lm-kit on Hugging Face
lm-kit has published 109 GGUF models that ggufmodels.com tracks, across families such as Qwen, Gemma and Mistral. The most downloaded are bge m3, Qwen3 14B and gemma 3 4b instruct.
The quants lm-kit publishes most often are F16 (90), Q4_K_M (66), Q8_0 (48) and Q6_K (48). Their Q4_K_M files range from 0.1 to 42.5 GB. Parameter counts run from 33M to 70.6B, and the longest trained context window is 1024K tokens.
Frequently asked questions
What GGUF models has lm-kit published?
109 models are listed here, mainly from the Qwen, Gemma and Mistral families. The most downloaded is bge m3.
Which quants does lm-kit publish?
The most common are F16 (90 models), Q4_K_M (66 models), Q8_0 (48 models) and Q6_K (48 models).