GGUF models by llmware

118 GGUF models quantized by llmware on Hugging Face. Sizes run from 494M to 119B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
qwen2.5 7b coder
Qwen · llmware
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
QW
Qwen3-Vl-4B-Instruct
Qwen · llmware
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool useVision
LL
Llama 3.2 1B Instruct
Llama · llmware
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
GR
bling granite 4.2 3b
Granite · llmware
Params3.66B
Context128K
Q4_K_M2.2 GB
GGUF
JA
jamba2 50b
Jamba · llmware
Params51.6B
Context256K
Q4_K_M31.2 GB
Tool use
GE
gemma 4 4b it
Gemma · llmware
Params7.52B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
PH
Phi 4 Mini Instruct
Phi · llmware
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
MI
mistral 3.2 24b
Mistral · llmware
Params23.6B
Context128K
Q4_K_M14.3 GB
Tool use
SL
slim nli tool
Slim · llmware
Params1.1B
Context2K
Smallest0.7 GB
Tool use
QW
Qwen3-Vl-8B-Instruct
Qwen · llmware
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
QW
dragon qwen 9b
Qwen · llmware
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
LL
tiny llama chat
Llama · llmware
Params1.1B
Context2K
Smallest0.7 GB
GGUF
SL
slim intent tool
Slim · llmware
Params1.1B
Context2K
Smallest0.7 GB
Tool use
GE
gemma 4 2b it
Gemma · llmware
Params4.65B
Context128K
Q4_K_M3.1 GB
ReasoningTool use
BL
bling-stablelm-3b
Bling · llmware
Params2.8B
Context4K
Smallest1.7 GB
GGUF
QW
Qwen3-Vl-30B-A3B-Instruct
Qwen · llmware
Params30.5B
Context256K
Q4_K_M18.6 GB
Tool useVision
SL
slim category tool
Slim · llmware
Params1.1B
Context2K
Smallest0.7 GB
Tool use
GR
dragon granite 8b
Granite · llmware
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
LL
dragon llama answer tool
Llama · llmware
Params6.74B
Context4K
Smallest4.1 GB
Tool use
QW
Qwen3.5-9B
Qwen · llmware
Params8.95B
Context256K
Q4_K_M5.7 GB
ReasoningTool use
SL
slim extract tiny tool
Slim · llmware
Params1.1B
Context2K
Smallest0.7 GB
Tool use
SL
slim ratings tool
Slim · llmware
Params1.1B
Context2K
Smallest0.7 GB
Tool use
SL
slim-boolean
Slim · llmware
Params2.8B
Context4K
Smallest1.7 GB
Tool use
LL
dragon llama 7b v0
Llama · llmware
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SL
slim xsum tool
Slim · llmware
Params2.8B
Context4K
Smallest1.7 GB
Tool use
MI
Ministral-3-14B-Instruct-2512
Mistral · llmware
Params13.5B
Context256K
Q4_K_M8.2 GB
Tool use
MI
dragon mistral answer tool
Mistral · llmware
Params7.24B
Context32K
Smallest4.4 GB
Tool use
SL
slim-tags-3b
Slim · llmware
Params2.8B
Context4K
Smallest1.7 GB
Tool use
DE
deepseek qwen 14b
DeepSeek · llmware
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
MI
mistral small 4 2603 119b
Mistral · llmware
Params119B
Context1024K
Q4_K_M73.8 GB
Tool use

Keep browsing