GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
QW
AceCoder Qwen2.5 7B Ins Rule i1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
SA
Sarashina 13B Finetuned v2
Sarashina · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
ZE
zephyr 7b sft full SPIN iter3 i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
UnifiedReward 2.0 Qwen35 9b
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GL
glm non uniform 2026 10 22 edd87e
GLM · anm2211
Params313B
Context1024K
Smallest78.2 GB
DE
DeepSeek Llama3.3 Bllossom 70B
DeepSeek · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3 1.7B Jailbreak Reasoning
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
OR
Ornith 1.0 9B
Ornith · KikoCis
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
Truthful_DPO_cloudyu_Mixtral_34Bx2_MoE_60B
Mistral · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
FU
FusionNet
Fusionnet · mradermacher
Params21.2B
Context4K
Q4_K_M12.7 GB
QW
MiroThinker-v1.0-30B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M19.0 GB
QW
Qwen3.8 27B py3.15
Qwen · satyrn-ai
Params27.3B
Context256K
Q4_K_M16.8 GB
GL
GLM 4 32B 0414 Abliterated
GLM · mradermacher
Params32.6B
Context32K
Q4_K_M19.7 GB
GE
Geo R1 i1
Geo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
BG
bge reranker base
BGE · cstr
Params278M
Context—
Smallest0.3 GB
OR
Ornith 1.0 9B 1M
Ornith · satgeze
Params456M
Context1024K
Q4_K_M5.8 GB
PE
Models ClosedCharacter Peach 2.0 9B 8k Roleplay
Peach · MaziyarPanahi
Params8.83B
Context16K
Smallest6.1 GB
DE
DeepSeek V4 Flash 0731 StrixHalo Verified
DeepSeek · Kevletesteur
Params284B
Context1024K
Smallest103.2 GB
OR
Ornith 1.5 35B A3B 3MPER0RR Abliterated
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ET
EtherealAurora 12B
Etherealaurora · BasedAGI
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
Gervasio 70b Portuguese Ptpt Decoder
Gervasio · tjusto2409
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
MiroThinker v1.0 30B
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
AL
AllwissenGPT 7B
Allwissengpt · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
VI
VibeThinker 1.5B
Vibethinker · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
GL
GLM 5.3 Flash Heretic Abliterated LoRA V3
GLM · MorinoNushi
Params34M
Context—
Smallest0.1 GB
DE
mango deepseek41 gsq iq2xs uncensored
DeepSeek · isilicon
Params552B
Context1024K
Smallest155.2 GB
LO
Loom Swift Mini 2 Upload
Loom · textilelabs
Params2M
Context2K
Q4_K_M0.0 GB
LL
LLaMA 2 13b GTL Delta
Llama · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
PH
Borea Phi 3.5 Mini Instruct Common
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
ME
MediPhi Instruct
Mediphi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB