GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
VE
Venusaur i1
Venusaur · mradermacher
Params16M
Context512
Q4_K_M0.0 GB
Embedding
QW
Ornith 1.0 9B
Qwen · samuelchristlie
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
LL
Llama 3B Coder
Llama · koshuro
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use
PH
Phi 1.5 Tele
Phi · mradermacher
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
BI
bitnet persian r10
Bitnet · smhsmh
Params2.41B
Context4K
Smallest1.2 GB
GGUF
OR
Ornith 1.5 9B DSH Agentic GPT 5.6 Sol Distill
Ornith · xoykor
Params9.2B
Context256K
Smallest6.6 GB
Tool useVision
QW
Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
Tool use
FA
Fara 7B
Fara · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
FR
FrogNano 4B 2609 Heretic
Frognano · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
LI
Ling 3.0 Tiny Heretic
Ling · mradermacher
Params7.89B
Context128K
Q4_K_M4.8 GB
ReasoningTool use
CH
Chocolatine 2 14B Instruct v2.0.1 i1
Chocolatine · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
OR
Ornith 1.0 9B Abliterated Fable
Ornith · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
GL
GLM 4 32B 0414
GLM · mradermacher
Params32.6B
Context32K
Q4_K_M19.7 GB
Tool use
MI
MiniMax M2 THRIFT
Minimax · bartowski
Params173B
Context192K
Q4_K_M104.6 GB
CodingReasoningTool use
DE
DeepScaleR 1.5B Preview
Deepscaler · DevQuasar-12
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
NE
Neuraltranslate 27b Mt Nah Es v1.1
Neuraltranslate · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
PR
PRO STEP Policy 7B
Pro · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
QW
Self Certainty Qwen3 8B Base OpenRS
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use
TI
tinyllamas BE
Tinyllamas · taronaeo
Params24M
Context—
Smallest0.0 GB
GGUF
IN
Intellect V0.3 1.6B i1
Intellect · mradermacher
Params1.64B
Context1K
Q4_K_M1.2 GB
Reasoning
LI
Lightnovel_Cpt
Lightnovel · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
BG
bge large en i1
BGE · mradermacher
Params334M
Context512
Q4_K_M0.2 GB
Embedding
QW
BaronLLM v2 OffensiveSecurityLLM Q8
Qwen · AlicanKiraz0
Params14.8B
Context40K
Smallest15.7 GB
GGUF
LI
Ling Lite 1.5 2507
Ling · mradermacher
Params16.8B
Context32K
Q4_K_M11.2 GB
Reasoning
GL
GLM 4.7 REAP 268B A32B i1
GLM · mradermacher
Params269B
Context198K
Q4_K_M162.3 GB
ReasoningTool use
MA
MAmmoTH2 8B
Mammoth · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OR
Ornith 1.5 9B MXFP4 Hybrid Imatrix
Ornith · jashepp
Params8.95B
Context256K
Smallest0.0 GB
ReasoningTool use
NO
NousYarnFlashLlama 13B 64k
Nousyarnflashllama · mradermacher
Params13B
Context64K
Q4_K_M7.9 GB
GGUF
QW
Qwen3 Next 384E Abliterated Instruct
Qwen · mradermacher
Params60.3B
Context256K
Q4_K_M36.7 GB
Tool use
PE
Peach 9B 8k Roleplay i1
Peach · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
Roleplay

Keep browsing