GGUF models by llmware

118 GGUF models quantized by llmware on Hugging Face. Sizes run from 494M to 119B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
dragon mistral 7b v0
Mistral · llmware
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
slim summary phi 3
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
GGUF
SL
slim summary tool
Slim · llmware
Params2.8B
Context4K
Smallest1.7 GB
Tool use
BO
bonchon
Bonchon · llmware
Params8.03B
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwen3 4B Instruct Awq
Qwen · llmware
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
YI
dragon yi 6b v0
Yi · llmware
Params6.06B
Context4K
Q4_K_M3.7 GB
Coding
GE
gemma 2 9b instruct
Gemma · llmware
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
SL
slim summary tiny tool
Slim · llmware
Params1.1B
Context2K
Smallest0.7 GB
Tool use
MU
muse glimmer 30b
Muse · llmware
Params27.9B
Context128K
Q4_K_M16.8 GB
ReasoningTool use
SL
slim sentiment tool
Slim · llmware
Params1.1B
Context2K
Smallest0.7 GB
Tool use
GE
gemma 3 4b
Gemma · llmware
Params3.88B
Context128K
Smallest3.2 GB
Vision
SL
slim sql tool
Slim · llmware
Params1.1B
Context2K
Smallest0.7 GB
Tool use
QW
Qwen3.5-4B
Qwen · llmware
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
SL
slim emotions tool
Slim · llmware
Params1.1B
Context2K
Smallest0.7 GB
Tool use
SL
slim tags tool
Slim · llmware
Params1.1B
Context2K
Smallest0.7 GB
Tool use
QW
Qwen2.5-Vl-3B-Instruct
Qwen · llmware
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
MI
minicpm 2.6
MiniCPM · llmware
Params7.61B
Context32K
Q4_K_M4.7 GB
CodingVision
JA
AI21 Jamba2 3B
Jamba · llmware
Params3.2B
Context256K
Q4_K_M1.9 GB
Tool use
GR
Granite 4.2 30b
Granite · llmware
Params29.3B
Context128K
Q4_K_M17.7 GB
ReasoningTool use
BL
bling answer tool
Bling · llmware
Params1.1B
Context2K
Smallest0.7 GB
Tool use
GR
Granite 4.2 3b
Granite · llmware
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
GR
Granite 4.2 8b
Granite · llmware
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
QW
Qwen3.5-9B
Qwen · llmware
Params8.95B
Context256K
Q4_K_M5.7 GB
ReasoningTool useVision
SL
slim ner tool
Slim · llmware
Params1.1B
Context2K
Smallest0.7 GB
Tool use
DR
dragon yi answer tool
Dragon · llmware
Params6.06B
Context4K
Smallest3.7 GB
Tool use
SL
slim extract tool
Slim · llmware
Params2.8B
Context4K
Smallest1.7 GB
Tool use
SL
slim sa ner tool
Slim · llmware
Params2.8B
Context4K
Smallest1.7 GB
Tool use
SL
slim topics tool
Slim · llmware
Params1.1B
Context2K
Smallest0.7 GB
Tool use
GE
Gemma-4-12B-It
Gemma · llmware
Params11.9B
Context256K
Q4_K_M7.1 GB
ReasoningTool use
PH
bling phi 3
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
GGUF

About llmware on Hugging Face

llmware has published 118 GGUF models that ggufmodels.com tracks, across families such as Qwen, Slim and Phi. The most downloaded are dragon mistral 7b v0, slim summary phi 3 and slim summary tool.

The quants llmware publishes most often are Q4_K_M (64), Q4_0 (2), Q8_0 (1) and Q4_1 (1). Their Q4_K_M files range from 0.4 to 73.8 GB. Parameter counts run from 494M to 119B, and the longest trained context window is 1024K tokens.

Frequently asked questions

What GGUF models has llmware published?

118 models are listed here, mainly from the Qwen, Slim and Phi families. The most downloaded is dragon mistral 7b v0.

Which quants does llmware publish?

The most common are Q4_K_M (64 models), Q4_0 (2 models), Q8_0 (1 models) and Q4_1 (1 models).

Keep browsing