GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
UnifiedReward Think Qwen35 9b
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
TH
Thyme RL
Thyme · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
OR
Ornith 1.5 35B A3B
Ornith · el4
Params35.5B
Context256K
Smallest12.1 GB
Reasoning
DI
Dirty-Alice
Dirty · mradermacher
Params464M
Context4K
Q4_K_M0.3 GB
GGUF
QW
Entropy Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
FU
FusionNet
Fusionnet · RichardErkhov
Params21.2B
Context4K
Q4_K_M12.7 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Uncensored Reasoner
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
PH
Phi Delthanar i1
Phi · mradermacher
Params7.81B
Context2K
Q4_K_M4.8 GB
GGUF
AX
Axon26 Coder
Axon · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
CodingTool use
LE
Lens Turbo GGUF ComfyUI
Lens · vantagewithai
Params4.1B
Context—
Q4_K_M2.5 GB
GGUF
UN
Unlimited OCR 2
Unlimited · cicaba
Params2.94B
Context128K
Q4_K_M2.0 GB
Vision
LL
cais HarmBench Llama 2 13b cls multimodal behaviors
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PU
PulseMind 72B
Pulsemind · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
Reasoning
QW
Nexora Qwen Coder 4B
Qwen · guell00
Params4.33B
Context256K
Q4_K_M2.8 GB
CodingReasoningTool use
PH
Phi 3.5 Mini 3.8B ArliAI RPMax v1.1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 4
Phi · gaianet
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
RE
RealSafe R1 7B
Realsafe · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
GL
GLM 4.5 Air
GLM · lmstudio-community
Params110B
Context128K
Q4_K_M73.5 GB
ReasoningTool use
DE
deepseek v41 flash 1017 abliterated gguf public
DeepSeek · ktobik
Params748B
Context1024K
Smallest1.6 GB
GGUF
OM
OmniDimen 2 8B Emotion Absolute Heresy
Omnidimen · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DR
DRIFT VL 7B
Drift · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningVision
SH
shisa v2.1 unphi4 14b i1
Shisa · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
QW
UnifiedReward Qwen 7b
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · brittlewis12
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
LL
Cakrawala 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LO
M3.2 24B Loki V1.3
Loki · CrucibleLab-TG
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
QW
Huihui Qwen3 30B A3B Abliterated Fusion 5050
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
OP
All Hands.Openhands Lm 32b v0.1
Openhands · DevQuasar-12
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
GL
GLM 4.7 Flash Impotent Heresy
GLM · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
ReasoningTool use

Keep browsing