GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mistral NeMo 12B Abliterated
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
FA
Falcon
Falcon · mradermacher
Params41.8B
Context2K
Q4_K_M26.0 GB
GGUF
GR
granite 20b code instruct i1
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
CodingTool use
TE
Ternary-Bonsai-2-27B-Uncensored
Ternary · gaston-parravicini
Params27B
Context256K
Smallest7.1 GB
Reasoning
MP
Mpt 7b Storywriter
Mpt · mradermacher
Params6.65B
Context64K
Q4_K_M4.3 GB
GGUF
QW
Qwen Image 2.1 Text Encoder Heretic DHQ
Qwen · pottokao
Params8.2B
Context256K
Q4_K_M5.0 GB
CodingVision
LI
Linne Oak 1 0
Linne · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Tool useVision
PA
PaddleOCR-VL-1.6
Paddleocr · Mungert
Params467M
Context128K
Q4_K_M0.4 GB
Vision
TE
Ternary Bonsai 2 27B MTP
Ternary · ManniX-ITA
Params27.3B
Context256K
Smallest6.4 GB
GGUF
QW
Huihui Qwen3 30B A3B Thinking 2507 Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
NE
neutts air q4
Neutts · neuphonic
Params748M
Context—
Smallest0.5 GB
GGUF
PA
Pantheon Reasoning 27B
Pantheon · bartowski
Params27.3B
Context256K
Q4_K_M18.0 GB
ReasoningRoleplay
MI
Mistral-Small-4-119B-2603
Mistral · mudler
Params119B
Context1024K
Smallest52.9 GB
Vision
QW
EUAIAct Qwen2.5 0.5B Edge
Qwen · sallani
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
GE
Gemma 4 26B A4B
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
IN
InternVL3 1B Instruct
Internvl · ggml-org
Params630M
Context32K
Smallest0.7 GB
Vision
PY
Pythia 12b Deduped
Pythia · mradermacher
Params11.8B
Context2K
Q4_K_M7.6 GB
GGUF
KE
Kev-27B Artemis 12.3GB
Kev · turintech
Params25.6B
Context256K
Smallest12.3 GB
ReasoningTool use
QW
Qwen2.5 1.5B Instruct
Qwen · lmstudio-community
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
JA
Jan nano
Jan · Menlo
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
QW
qwen3 tts 1.7b voicedesign
Qwen · cstr
Params1.92B
Context—
Smallest2.0 GB
GGUF
QW
Dongfangshuo Qwen3.8 27B NSFW
Qwen · dongfangshuo
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
OZ
lyrics room final refiner ozan v1
Ozan · rambrogi
Params12.2B
Context128K
Smallest13.0 GB
GGUF
XY
Xyntetik Kvist 14B
Xyntetik · mradermacher
Params14.4B
Context128K
Q4_K_M10.3 GB
Tool use
HO
K2-Horizon-3.7B
Horizon · mradermacher
Params5.06B
Context512K
Q4_K_M3.2 GB
GGUF
GR
Granite 3.1 2b Instruct
Granite · bartowski
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
QW
Scion FlashNext 176B A6B
Qwen · SkyIsNotGreen
Params177B
Context256K
Smallest57.6 GB
ReasoningTool use
YI
dolphin-2.9.3-Yi-1.5-34B-32k
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
CodingTool use
QW
Qwen2.5 VL 32B Instruct
Qwen · lmstudio-community
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
OM
Omega Arsenal 12B
Omega · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use

Keep browsing