GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
VE
Venusaur i1
Venusaur · mradermacher
Params16M
Context512
Q4_K_M0.0 GB
QW
Ornith 1.0 9B
Qwen · samuelchristlie
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
Llama 3B Coder
Llama · koshuro
Params3.21B
Context128K
Q4_K_M2.0 GB
PH
Phi 1.5 Tele
Phi · mradermacher
Params1.42B
Context2K
Q4_K_M0.9 GB
BI
bitnet persian r10
Bitnet · smhsmh
Params2.41B
Context4K
Smallest1.2 GB
OR
Ornith 1.5 9B DSH Agentic GPT 5.6 Sol Distill
Ornith · xoykor
Params9.2B
Context256K
Smallest6.6 GB
QW
Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
FA
Fara 7B
Fara · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
FR
FrogNano 4B 2609 Heretic
Frognano · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
LI
Ling 3.0 Tiny Heretic
Ling · mradermacher
Params7.89B
Context128K
Q4_K_M4.8 GB
CH
Chocolatine 2 14B Instruct v2.0.1 i1
Chocolatine · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
OR
Ornith 1.0 9B Abliterated Fable
Ornith · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
GL
GLM 4 32B 0414
GLM · mradermacher
Params32.6B
Context32K
Q4_K_M19.7 GB
MI
MiniMax M2 THRIFT
Minimax · bartowski
Params173B
Context192K
Q4_K_M104.6 GB
DE
DeepScaleR 1.5B Preview
Deepscaler · DevQuasar-12
Params1.78B
Context128K
Q4_K_M1.1 GB
NE
Neuraltranslate 27b Mt Nah Es v1.1
Neuraltranslate · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
PR
PRO STEP Policy 7B
Pro · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Self Certainty Qwen3 8B Base OpenRS
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
TI
tinyllamas BE
Tinyllamas · taronaeo
Params24M
Context—
Smallest0.0 GB
IN
Intellect V0.3 1.6B i1
Intellect · mradermacher
Params1.64B
Context1K
Q4_K_M1.2 GB
LI
Lightnovel_Cpt
Lightnovel · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
BG
bge large en i1
BGE · mradermacher
Params334M
Context512
Q4_K_M0.2 GB
QW
BaronLLM v2 OffensiveSecurityLLM Q8
Qwen · AlicanKiraz0
Params14.8B
Context40K
Smallest15.7 GB
LI
Ling Lite 1.5 2507
Ling · mradermacher
Params16.8B
Context32K
Q4_K_M11.2 GB
GL
GLM 4.7 REAP 268B A32B i1
GLM · mradermacher
Params269B
Context198K
Q4_K_M162.3 GB
MA
MAmmoTH2 8B
Mammoth · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
OR
Ornith 1.5 9B MXFP4 Hybrid Imatrix
Ornith · jashepp
Params8.95B
Context256K
Smallest0.0 GB
NO
NousYarnFlashLlama 13B 64k
Nousyarnflashllama · mradermacher
Params13B
Context64K
Q4_K_M7.9 GB
QW
Qwen3 Next 384E Abliterated Instruct
Qwen · mradermacher
Params60.3B
Context256K
Q4_K_M36.7 GB
PE
Peach 9B 8k Roleplay i1
Peach · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB