GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
BL
Q3.5 BlueStar 27B Ultra Heretic
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplayTool use
GE
gemma-3-12b-it-codeforces-SFT
Gemma · BasedAGI
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
CR
CroissantLLMChat v0.1
Croissantllmchat · nold
Params1.35B
Context2K
Q4_K_M0.9 GB
Coding
GL
GLM 4.7 Flash REAP 50
GLM · mradermacher
Params16B
Context198K
Q4_K_M9.7 GB
CodingReasoningTool use
LL
Llm4Decompile 22b v2
Llm · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
PH
Luminis phi 4 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · Ashwinxs
Params1.68B
Context1024K
Smallest0.6 GB
GGUF
QW
SynthAgent SFT Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
GU
GUI Owl 7B
Gui · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
CH
lahgtna chatterbox v1
Chatterbox · cstr
Params537M
Context—
Smallest1.1 GB
GGUF
CR
CroPond 7B
Cropond · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
LI
Lime V4 ReasoningBrake v0.3
Lime · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
AP
Apriel 1.6 15b Thinker
Apriel · ServiceNow-AI
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningTool useVision
OM
OmniDimen v2.5 4B Emotion
Omnidimen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
QW
ReSearch Qwen 32B
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
SE
SenseNova MARS 32B
Sensenova · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
Tool use
QO
QoQ Med VL 7B
Qoq · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
LL
HarmBench Llama 2 13b Cls
Llama · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B KAYLA
DeepSeek · mradermacher
Params8.19B
Context500K
Q4_K_M5.0 GB
ReasoningTool use
PY
Pyrz 8B Instruct Uncensored
Pyrz · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
PH
Phi 3 medium 128k instruct
Phi · gaianet
Params14B
Context128K
Q4_K_M8.6 GB
Coding
DE
DeepSeek V4 Flash
DeepSeek · vultr
Params284B
Context1024K
Smallest5.7 GB
GGUF
RI
Ring Lite
Ring · mradermacher
Params16.8B
Context32K
Q4_K_M11.2 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
OP
OpenBioLLm Derm
Openbiollm · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Kartik Kundli Ai
Qwen · UX4567
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
QW
UnifiedReward 2.0 Qwen35 9b
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
QO
QoQ Med VL 32B
Qoq · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
QW
Qwen3 Next 448E Abliterated Instruct
Qwen · mradermacher
Params70B
Context256K
Q4_K_M42.6 GB
Tool use
OM
OmniDimen 2.5 9B Emotion
Omnidimen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision

Keep browsing