GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 27B Heretic Ara
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwopus3.8 27B Flash V2 Abliterated
Qwopus · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
WH
Whisper Base
Whisper · handy-computer
Params73M
Context—
Q4_K_M0.1 GB
GGUF
LY
Lythri 7B A4B
Lythri · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GGUF
GE
Gemma 4 31B StyleTune
Gemma · bartowski
Params32.1B
Context256K
Q4_K_M20.4 GB
Roleplay
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
Vision
TE
Tess 4.5 27B
Tess · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningTool useVision
SM
SmolLM2 1.7B Instruct
SmolLM · HuggingFaceTB
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SP
Raptor 0.6 4B
Spark · OsaurusAI
Params4.1B
Context1024K
Q4_K_M2.6 GB
ReasoningTool use
ME
MedGo i1
Medgo · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
ST
StandardOne 8B
Standardone · StandardThinking
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningVision
QW
Qwen3.6-35B-A3B
Qwen · TokenTinkerer
Params34.7B
Context256K
Q4_K_M0.6 GB
ReasoningTool use
QW
Ternary Bonsai 2 27B gguf dev
Qwen · prism-ml
Params27B
Context256K
Smallest7.6 GB
GGUF
QW
Qwen2.5 32B AGI
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
MA
MS3.2 24B Magnum Diamond
Magnum · Doctor-Shotgun
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
QW
imajev 9b
Qwen · mindchain
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Qwen3 4B
Qwen · ggml-org
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
QW
Huihui Qwen3.5 2B Abliterated
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
MI
Mistral Small 4 119B 2603 Heretic
Mistral · Rioky
Params119B
Context1024K
Q4_K_M72.2 GB
Vision
HO
K2-Horizon-MoVA-36B-A4B
Horizon · bartowski
Params37.4B
Context512K
Q4_K_M22.7 GB
GGUF
QW
Qwen3 VL 4B Instruct
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
Vision
JU
Julia-1
Julia · ggml-org
Params144M
Context8K
Smallest0.2 GB
GGUF
GE
gemma-4-E4B-it
Gemma · TheStageAI
Params7.46B
Context128K
Q4_K_M4.3 GB
GGUF
QW
Qwen3.8 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
AN
Anima Turbo V1.1
Anima · vanes430
Params2.09B
Context—
Q4_K_M1.4 GB
GGUF
QW
Qwopus3 5 9B Coder Flash Test2 MTP HF
Qwen · Jackrong
Params9.2B
Context256K
Q4_K_M5.8 GB
CodingReasoningTool use
QW
Qwen3.8 35B A3B Distill
Qwen · IsValorum
Params34.7B
Context256K
Smallest1.2 GB
ReasoningTool useVision
MI
MiniCPM5 2B heretic abliterated
MiniCPM · Abiray
Params2.52B
Context128K
Q4_K_M1.6 GB
GGUF
FL
FLUX 3 Image Klein pup Uncensored
Flux · AtomicChat
Params8.95B
Context256K
Smallest0.0 GB
GGUF
WA
Wan2.2 LightX2V 260412 4STEP
Wan · Abiray
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF

Keep browsing