GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
SP
spark s1 4b v6
Spark · abhishek085
Params4.21B
Context256K
Smallest3.5 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct GGUF
Qwen · Qwen
Params1.78B
Context32K
Q4_K_M1.1 GB
Coding
QW
Qwen2.5 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
SP
Spark X2.5 1.7B
Spark · XHToken
Params1.71B
Context1024K
Q4_K_M1.1 GB
GGUF
NO
North-Mini-Code-1.0
North · unsloth
Params30.5B
Context488K
Q4_K_M19.2 GB
Coding
QW
Qwen3.5-4B-Uncensored-HauhauCS-Aggressive-BF16
Qwen · HauhauCS
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
QW
Qwen3-1.7B
Qwen · unsloth
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
XX
T5 V1_1 Xxl
Xxl · city96
Params4.76B
Context512
Q4_K_M2.9 GB
Coding
QW
Qwen3 0.6B Instruct
Qwen · Qwen
Params596M
Context40K
Smallest0.6 GB
GGUF
QW
Parable Qwen3 8B Claude Fable 5
Qwen · AnkitAI
Params8.2B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
GE
gemma 4 12B it qat
Gemma · unsloth
Params440M
Context256K
Smallest0.3 GB
Vision
TE
Tess-4.5-27B
Tess · migtissera
Params27B
Context256K
Q4_K_M2.0 GB
ReasoningVision
QW
Parable Qwen3 4B Claude Fable 5
Qwen · AnkitAI
Params4B
Context40K
Q4_K_M2.5 GB
Reasoning
MI
MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking
MiniCPM · GnLOLot
Params1.08B
Context128K
Smallest1.2 GB
ReasoningTool use
CA
Carbon 8B
Carbon · HuggingFaceBio
Params8.26B
Context32K
Q4_K_M5.5 GB
GGUF
QW
Huihui Qwen3.5 9B Abliterated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
MU
Muse Glimmer 30B
Muse · meta-models
Params27.9B
Context128K
Q4_K_M1.6 GB
Vision
QW
Qwen3-Vl-8B-Instruct
Qwen · unsloth
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
AG
Agents A1 4B
Agents · InternScience
Params4.21B
Context256K
Smallest4.5 GB
Vision
QW
Qwen3.8 27B Coder390 EfficientThink Opus5.5 GPT6Astra Grok4.7 DSV4Pro K3 SFT RLOO GGUF NInfer
Qwen · nerkyor
Params27.3B
Context256K
Smallest0.0 GB
GGUF
MX
mxbai-embed-large-v1
Mxbai · ChristianAzinn
Params334M
Context512
Q4_K_M0.2 GB
Embedding
WA
Wan2.1 I2V 14B 480P
Wan · city96
Params16.4B
Context—
Q4_K_M11.3 GB
GGUF
CA
Carbon 3B
Carbon · HuggingFaceBio
Params3.45B
Context32K
Q4_K_M2.3 GB
GGUF
FL
Flint Preview
Flint · unsloth
Params39.8B
Context256K
Smallest11.4 GB
GGUF
MI
MiniCPM5 1B Claude Opus Fable5 Thinking
MiniCPM · GnLOLot
Params1.08B
Context128K
Q4_K_M0.7 GB
Reasoning
GE
gemma 4 26B A4B it qat q4 0
Gemma · google
Params25.2B
Context256K
Smallest14.4 GB
Vision
GE
humanizer-12b
Gemma · jialinyyzz
Params11.9B
Context256K
Q4_K_M7.6 GB
Vision
QW
Qwen3.5 9B
Qwen · bartowski
Params9.2B
Context256K
Q4_K_M6.2 GB
Vision
HY
Hy3
AngelSlim
Params295B
Context256K
Q4_K_M182.3 GB
GGUF
QW
Qwen2.5 Coder 14B Instruct AWQ
Qwen · Qwen
Params29B
Context128K
Q4_K_M18.0 GB
Coding

Keep browsing