GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
AceCoder Qwen2.5 7B Ins Rule i1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
SA
Sarashina 13B Finetuned v2
Sarashina · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
ZE
zephyr 7b sft full SPIN iter3 i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
UnifiedReward 2.0 Qwen35 9b
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
GL
glm non uniform 2026 10 22 edd87e
GLM · anm2211
Params313B
Context1024K
Smallest78.2 GB
ReasoningTool use
DE
DeepSeek Llama3.3 Bllossom 70B
DeepSeek · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
QW
Qwen3 1.7B Jailbreak Reasoning
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
OR
Ornith 1.0 9B
Ornith · KikoCis
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
MI
Truthful_DPO_cloudyu_Mixtral_34Bx2_MoE_60B
Mistral · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF
FU
FusionNet
Fusionnet · mradermacher
Params21.2B
Context4K
Q4_K_M12.7 GB
GGUF
QW
MiroThinker-v1.0-30B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M19.0 GB
ReasoningTool use
QW
Qwen3.8 27B py3.15
Qwen · satyrn-ai
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoningTool use
GL
GLM 4 32B 0414 Abliterated
GLM · mradermacher
Params32.6B
Context32K
Q4_K_M19.7 GB
Tool use
GE
Geo R1 i1
Geo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Reasoning
BG
bge reranker base
BGE · cstr
Params278M
Context—
Smallest0.3 GB
GGUF
OR
Ornith 1.0 9B 1M
Ornith · satgeze
Params456M
Context1024K
Q4_K_M5.8 GB
Vision
PE
Models ClosedCharacter Peach 2.0 9B 8k Roleplay
Peach · MaziyarPanahi
Params8.83B
Context16K
Smallest6.1 GB
Roleplay
DE
DeepSeek V4 Flash 0731 StrixHalo Verified
DeepSeek · Kevletesteur
Params284B
Context1024K
Smallest103.2 GB
GGUF
OR
Ornith 1.5 35B A3B 3MPER0RR Abliterated
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
ET
EtherealAurora 12B
Etherealaurora · BasedAGI
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GE
Gervasio 70b Portuguese Ptpt Decoder
Gervasio · tjusto2409
Params70.6B
Context128K
Q4_K_M42.5 GB
CodingTool use
MI
MiroThinker v1.0 30B
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
AL
AllwissenGPT 7B
Allwissengpt · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
VI
VibeThinker 1.5B
Vibethinker · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingTool use
GL
GLM 5.3 Flash Heretic Abliterated LoRA V3
GLM · MorinoNushi
Params34M
Context—
Smallest0.1 GB
GGUF
DE
mango deepseek41 gsq iq2xs uncensored
DeepSeek · isilicon
Params552B
Context1024K
Smallest155.2 GB
ReasoningTool use
LO
Loom Swift Mini 2 Upload
Loom · textilelabs
Params2M
Context2K
Q4_K_M0.0 GB
Tool use
LL
LLaMA 2 13b GTL Delta
Llama · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
PH
Borea Phi 3.5 Mini Instruct Common
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
ME
MediPhi Instruct
Mediphi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF

Keep browsing