GGUF models by llmware
118 GGUF models quantized by llmware on Hugging Face. Sizes run from 494M to 119B parameters. The longest trained context is 1024K tokens.
QW
qwen2.5 7b coder
Qwen · llmware
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3-Vl-4B-Instruct
Qwen · llmware
Params4.02B
Context256K
Q4_K_M2.5 GB
LL
Llama 3.2 1B Instruct
Llama · llmware
Params1.24B
Context128K
Q4_K_M0.8 GB
GR
bling granite 4.2 3b
Granite · llmware
Params3.66B
Context128K
Q4_K_M2.2 GB
JA
jamba2 50b
Jamba · llmware
Params51.6B
Context256K
Q4_K_M31.2 GB
GE
gemma 4 4b it
Gemma · llmware
Params7.52B
Context128K
Q4_K_M5.0 GB
PH
Phi 4 Mini Instruct
Phi · llmware
Params3.84B
Context128K
Q4_K_M2.5 GB
MI
mistral 3.2 24b
Mistral · llmware
Params23.6B
Context128K
Q4_K_M14.3 GB
SL
slim nli tool
Slim · llmware
Params1.1B
Context2K
Smallest0.7 GB
QW
Qwen3-Vl-8B-Instruct
Qwen · llmware
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
dragon qwen 9b
Qwen · llmware
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
tiny llama chat
Llama · llmware
Params1.1B
Context2K
Smallest0.7 GB
SL
slim intent tool
Slim · llmware
Params1.1B
Context2K
Smallest0.7 GB
GE
gemma 4 2b it
Gemma · llmware
Params4.65B
Context128K
Q4_K_M3.1 GB
BL
bling-stablelm-3b
Bling · llmware
Params2.8B
Context4K
Smallest1.7 GB
QW
Qwen3-Vl-30B-A3B-Instruct
Qwen · llmware
Params30.5B
Context256K
Q4_K_M18.6 GB
SL
slim category tool
Slim · llmware
Params1.1B
Context2K
Smallest0.7 GB
GR
dragon granite 8b
Granite · llmware
Params8.79B
Context128K
Q4_K_M5.3 GB
LL
dragon llama answer tool
Llama · llmware
Params6.74B
Context4K
Smallest4.1 GB
QW
Qwen3.5-9B
Qwen · llmware
Params8.95B
Context256K
Q4_K_M5.7 GB
SL
slim extract tiny tool
Slim · llmware
Params1.1B
Context2K
Smallest0.7 GB
SL
slim ratings tool
Slim · llmware
Params1.1B
Context2K
Smallest0.7 GB
SL
slim-boolean
Slim · llmware
Params2.8B
Context4K
Smallest1.7 GB
LL
dragon llama 7b v0
Llama · llmware
Params6.74B
Context4K
Q4_K_M4.1 GB
SL
slim xsum tool
Slim · llmware
Params2.8B
Context4K
Smallest1.7 GB
MI
Ministral-3-14B-Instruct-2512
Mistral · llmware
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
dragon mistral answer tool
Mistral · llmware
Params7.24B
Context32K
Smallest4.4 GB
SL
slim-tags-3b
Slim · llmware
Params2.8B
Context4K
Smallest1.7 GB
DE
deepseek qwen 14b
DeepSeek · llmware
Params14.8B
Context128K
Q4_K_M9.0 GB
MI
mistral small 4 2603 119b
Mistral · llmware
Params119B
Context1024K
Q4_K_M73.8 GB