GGUF models by llmware
118 GGUF models quantized by llmware on Hugging Face. Sizes run from 494M to 119B parameters. The longest trained context is 1024K tokens.
LL
llama31-instruct
Llama · llmware
Params8.03B
Context128K
Smallest4.9 GB
PH
phi 4
Phi · llmware
Params14.7B
Context16K
Smallest9.3 GB
DE
deepseek qwen 7b
DeepSeek · llmware
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen3 1.7B Instruct
Qwen · llmware
Params1.72B
Context40K
Smallest1.8 GB
GP
Gpt Oss 20b
gpt-oss · llmware
Params20.9B
Context128K
Smallest12.1 GB
QW
qwen2-7b-instruct
Qwen · llmware
Params7.62B
Context32K
Smallest4.7 GB
QW
Qwen3.6-35B-A3B
Qwen · llmware
Params34.7B
Context256K
Q4_K_M22.1 GB
GR
granite 4 micro
Granite · llmware
Params3.4B
Context128K
Q4_K_M2.1 GB
PH
slim sa ner phi 3
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
QW
Qwen2.5 32B Instruct
Qwen · llmware
Params32.8B
Context32K
Q4_K_M19.9 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · llmware
Params7.25B
Context32K
Q4_K_M4.4 GB
PH
slim extract phi 3
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
GR
Granite 4.1 30b
Granite · llmware
Params28.9B
Context128K
Q4_K_M17.8 GB
PH
bling phi 3.5
Phi · llmware
Params3.82B
Context128K
Smallest2.4 GB
LL
dragon llama 3.1
Llama · llmware
Params8.03B
Context128K
Smallest4.9 GB
MI
dragon mistral 0.3
Mistral · llmware
Params7.25B
Context32K
Smallest4.4 GB
GE
Gemma 3 12b It
Gemma · llmware
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Qwen3.5-27B
Qwen · llmware
Params26.9B
Context256K
Q4_K_M16.7 GB
QW
Qwen3 14B Awq Compatible Instruct
Qwen · llmware
Params14.8B
Context40K
Q4_K_M9.0 GB
OL
olmo 13b
OLMo · llmware
Params13.7B
Context4K
Q4_K_M8.4 GB
MI
mistral 3.2 small 2506
Mistral · llmware
Params23.6B
Context128K
Q4_K_M14.3 GB
PH
bling phi 2
Phi · llmware
Params2.78B
Context2K
Smallest1.8 GB
PH
slim boolean phi 3
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
MI
teknium_openhermes-2.5-mistral-7b
Mistral · llmware
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
berkeley-nest_starling-lm-7b-alpha
Starling · llmware
Params7.24B
Context8K
Q4_K_M4.4 GB
PH
slim xsum phi 3
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
QW
Qwen2.5 72B Instruct
Qwen · llmware
Params72.7B
Context32K
Q4_K_M47.4 GB
OL
olmo 7b
OLMo · llmware
Params7.3B
Context4K
Q4_K_M4.5 GB