GGUF models by llmware

118 GGUF models quantized by llmware on Hugging Face. Sizes run from 494M to 119B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
llama31-instruct
Llama · llmware
Params8.03B
Context128K
Smallest4.9 GB
Tool use
PH
phi 4
Phi · llmware
Params14.7B
Context16K
Smallest9.3 GB
GGUF
DE
deepseek qwen 7b
DeepSeek · llmware
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
QW
Qwen3 1.7B Instruct
Qwen · llmware
Params1.72B
Context40K
Smallest1.8 GB
ReasoningTool use
GP
Gpt Oss 20b
gpt-oss · llmware
Params20.9B
Context128K
Smallest12.1 GB
Tool use
QW
qwen2-7b-instruct
Qwen · llmware
Params7.62B
Context32K
Smallest4.7 GB
GGUF
QW
Qwen3.6-35B-A3B
Qwen · llmware
Params34.7B
Context256K
Q4_K_M22.1 GB
ReasoningTool use
GR
granite 4 micro
Granite · llmware
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
PH
slim sa ner phi 3
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
GGUF
QW
Qwen2.5 32B Instruct
Qwen · llmware
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
MI
Mistral-7B-Instruct-v0.3
Mistral · llmware
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
PH
slim extract phi 3
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
GGUF
GR
Granite 4.1 30b
Granite · llmware
Params28.9B
Context128K
Q4_K_M17.8 GB
Tool use
PH
bling phi 3.5
Phi · llmware
Params3.82B
Context128K
Smallest2.4 GB
GGUF
LL
dragon llama 3.1
Llama · llmware
Params8.03B
Context128K
Smallest4.9 GB
GGUF
MI
dragon mistral 0.3
Mistral · llmware
Params7.25B
Context32K
Smallest4.4 GB
GGUF
GE
Gemma 3 12b It
Gemma · llmware
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
QW
Qwen3.5-27B
Qwen · llmware
Params26.9B
Context256K
Q4_K_M16.7 GB
ReasoningTool use
QW
Qwen3 14B Awq Compatible Instruct
Qwen · llmware
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
OL
olmo 13b
OLMo · llmware
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
MI
mistral 3.2 small 2506
Mistral · llmware
Params23.6B
Context128K
Q4_K_M14.3 GB
Tool use
PH
bling phi 2
Phi · llmware
Params2.78B
Context2K
Smallest1.8 GB
GGUF
PH
slim boolean phi 3
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
GGUF
MI
teknium_openhermes-2.5-mistral-7b
Mistral · llmware
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
ST
berkeley-nest_starling-lm-7b-alpha
Starling · llmware
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
PH
slim xsum phi 3
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
GGUF
QW
Qwen2.5 72B Instruct
Qwen · llmware
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
OL
olmo 7b
OLMo · llmware
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF

Keep browsing