GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
SP
spark s1 4b v6
Spark · abhishek085
Params4.21B
Context256K
Smallest3.5 GB
QW
Qwen2.5 Coder 1.5B Instruct GGUF
Qwen · Qwen
Params1.78B
Context32K
Q4_K_M1.1 GB
QW
Qwen2.5 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
SP
Spark X2.5 1.7B
Spark · XHToken
Params1.71B
Context1024K
Q4_K_M1.1 GB
NO
North-Mini-Code-1.0
North · unsloth
Params30.5B
Context488K
Q4_K_M19.2 GB
QW
Qwen3.5-4B-Uncensored-HauhauCS-Aggressive-BF16
Qwen · HauhauCS
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3-1.7B
Qwen · unsloth
Params1.72B
Context40K
Q4_K_M1.1 GB
XX
T5 V1_1 Xxl
Xxl · city96
Params4.76B
Context512
Q4_K_M2.9 GB
QW
Qwen3 0.6B Instruct
Qwen · Qwen
Params596M
Context40K
Smallest0.6 GB
QW
Parable Qwen3 8B Claude Fable 5
Qwen · AnkitAI
Params8.2B
Context40K
Q4_K_M5.0 GB
GE
gemma 4 12B it qat
Gemma · unsloth
Params440M
Context256K
Smallest0.3 GB
TE
Tess-4.5-27B
Tess · migtissera
Params27B
Context256K
Q4_K_M2.0 GB
QW
Parable Qwen3 4B Claude Fable 5
Qwen · AnkitAI
Params4B
Context40K
Q4_K_M2.5 GB
MI
MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking
MiniCPM · GnLOLot
Params1.08B
Context128K
Smallest1.2 GB
CA
Carbon 8B
Carbon · HuggingFaceBio
Params8.26B
Context32K
Q4_K_M5.5 GB
QW
Huihui Qwen3.5 9B Abliterated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
MU
Muse Glimmer 30B
Muse · meta-models
Params27.9B
Context128K
Q4_K_M1.6 GB
QW
Qwen3-Vl-8B-Instruct
Qwen · unsloth
Params8.19B
Context256K
Q4_K_M5.0 GB
AG
Agents A1 4B
Agents · InternScience
Params4.21B
Context256K
Smallest4.5 GB
QW
Qwen3.8 27B Coder390 EfficientThink Opus5.5 GPT6Astra Grok4.7 DSV4Pro K3 SFT RLOO GGUF NInfer
Qwen · nerkyor
Params27.3B
Context256K
Smallest0.0 GB
MX
mxbai-embed-large-v1
Mxbai · ChristianAzinn
Params334M
Context512
Q4_K_M0.2 GB
WA
Wan2.1 I2V 14B 480P
Wan · city96
Params16.4B
Context—
Q4_K_M11.3 GB
CA
Carbon 3B
Carbon · HuggingFaceBio
Params3.45B
Context32K
Q4_K_M2.3 GB
FL
Flint Preview
Flint · unsloth
Params39.8B
Context256K
Smallest11.4 GB
MI
MiniCPM5 1B Claude Opus Fable5 Thinking
MiniCPM · GnLOLot
Params1.08B
Context128K
Q4_K_M0.7 GB
GE
gemma 4 26B A4B it qat q4 0
Gemma · google
Params25.2B
Context256K
Smallest14.4 GB
GE
humanizer-12b
Gemma · jialinyyzz
Params11.9B
Context256K
Q4_K_M7.6 GB
QW
Qwen3.5 9B
Qwen · bartowski
Params9.2B
Context256K
Q4_K_M6.2 GB
HY
Hy3
AngelSlim
Params295B
Context256K
Q4_K_M182.3 GB
QW
Qwen2.5 Coder 14B Instruct AWQ
Qwen · Qwen
Params29B
Context128K
Q4_K_M18.0 GB