GGUF models by llmware
118 GGUF models quantized by llmware on Hugging Face. Sizes run from 494M to 119B parameters. The longest trained context is 1024K tokens.
QW
Qwen2 VL 2B Instruct
Qwen · llmware
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Llama 3.2 3B Instruct
Llama · llmware
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwen3 8B Awq Compatible Instruct
Qwen · llmware
Params8.19B
Context40K
Q4_K_M5.0 GB
GE
gemma 2 27b instruct
Gemma · llmware
Params27.2B
Context8K
Q4_K_M16.6 GB
SL
slim qa gen tiny tool
Slim · llmware
Params1.1B
Context2K
Smallest0.7 GB
SL
slim q gen tiny tool
Slim · llmware
Params1.1B
Context2K
Smallest0.7 GB
QW
bling qwen nano tool
Qwen · llmware
Params630M
Context128K
Smallest0.5 GB
PH
slim qa gen phi 3 tool
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
QW
slim extract qwen 0.5b
Qwen · llmware
Params630M
Context128K
Smallest0.5 GB
QW
Qwen2.5 14B Instruct
Qwen · llmware
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
slim extract qwen 1.5b
Qwen · llmware
Params1.78B
Context128K
Smallest1.1 GB
ZE
huggingfaceh4_zephyr-7b-beta
Zephyr · llmware
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3.5-27B
Qwen · llmware
Params26.9B
Context256K
Q4_K_M16.7 GB
PH
Phi 3 Mini 128k Instruct
Phi · llmware
Params3.82B
Context128K
Smallest2.2 GB
QW
dragon-qwen-7b
Qwen · llmware
Params7.62B
Context128K
Smallest4.7 GB
LF
liquidai lfm2 2.6b
Lfm · llmware
Params2.57B
Context125K
Q4_K_M1.6 GB
QW
qwen2-0_5b-instruct
Qwen · llmware
Params494M
Context32K
Q4_K_M0.4 GB
QW
bling qwen mini tool
Qwen · llmware
Params1.78B
Context128K
Smallest1.1 GB
NE
nemotron 3 nano 4b
Nemotron · llmware
Params3.97B
Context1024K
Q4_K_M2.8 GB
QW
Qwen3.5-35B-A3B
Qwen · llmware
Params34.7B
Context256K
Q4_K_M22.0 GB
QW
qwen2-1.5b-instruct
Qwen · llmware
Params1.54B
Context32K
Smallest1.0 GB
GR
Granite 4.1 3b
Granite · llmware
Params3.4B
Context128K
Q4_K_M2.1 GB
PH
phi 3.5
Phi · llmware
Params3.82B
Context128K
Smallest2.4 GB
GR
Granite-4.1-8B
Granite · llmware
Params8.79B
Context128K
Q4_K_M5.3 GB
YI
dragon yi 9b
Yi · llmware
Params8.83B
Context4K
Smallest5.3 GB
PH
slim q gen phi 3 tool
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
GE
Gemma-4-26B-A4B-It
Gemma · llmware
Params25.2B
Context256K
Q4_K_M16.9 GB
QW
Qwen2.5 14B Instruct
Qwen · llmware
Params14.8B
Context32K
Q4_K_M9.0 GB
NE
Nemotron-3-Nano-30B-A3B
Nemotron · llmware
Params31.6B
Context1024K
Smallest18.2 GB
QW
Qwen3.6-27B
Qwen · llmware
Params26.9B
Context256K
Q4_K_M16.8 GB