GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
BG
bge m3
BGE · KimChen
Params567M
Context8K
Q4_K_M0.4 GB
Embedding
ME
MelloGPT i1
Mellogpt · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
SenecaLLM x Qwen2.5 7B CyberSecurity i1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
GL
Huihui ai.GLM Z1 9B 0414 Abliterated
GLM · DevQuasar-12
Params9.4B
Context32K
Q4_K_M6.2 GB
Tool use
HU
Huihui MiroThinker v1.0 72B Abliterated
Huihui · mradermacher
Params72.7B
Context256K
Q4_K_M47.4 GB
Tool use
GE
gemma-3-27b-it-codeforces-SFT
Gemma · BasedAGI
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · gaianet
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
KU
Kuvera 14B v0.1.0
Kuvera · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
GL
Melinoe GLM 30B A3B Thinking
GLM · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
ReasoningTool use
RI
inclusionAI.Ring Flash 2.0
Ring · DevQuasar-11
Params103B
Context32K
Q4_K_M62.4 GB
GGUF
LI
Ling 3.0 Tiny
Ling · Mike0021
Params7.89B
Context128K
Q4_K_M4.8 GB
ReasoningTool use
DE
Deepseek-R1-0528-Qwen3-8B
DeepSeek · XythicK
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
PH
Torchlight Phi4 Mini
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
LL
CoSER Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama_8B_Explainer
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
OR
Ornith 1.0 35B
Ornith · tashfene
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
QW
wt neko instruct
Qwen · Trina-QwQ
Params4.02B
Context256K
Smallest2.5 GB
ReasoningTool use
ST
Stable DiffCoder 8B Base
Stable · mradermacher
Params8.25B
Context8K
Q4_K_M5.1 GB
Coding
BG
bge-large-zh-v1.5
BGE · CompendiumLabs
Params324M
Context512
Q4_K_M0.2 GB
Embedding
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
ZE
Zephyr 7b Beta Absolute Heresy
Zephyr · mradermacher
Params7.24B
Context64K
Q4_K_M4.4 GB
GGUF
QW
qwen2.5 3b instruct.Q4 K M
Qwen · r1r21nb
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
MI
MiniMax M2 THRIFT 55 i1
Minimax · mradermacher
Params106B
Context192K
Smallest0.2 GB
GGUF
AP
Apriel 1.6 15b Thinker Magic_alpha decensored_MPOA
Apriel · mradermacher
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningTool use
DE
DeepSWE Preview
Deepswe · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
ReasoningTool use
KA
kappa 3 phi abliterated
Kappa · afrideva
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
DE
Cogito-V2-Preview-Deepseek-671B-Moe
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.9 GB
ReasoningTool use
FR
FrogBoss 32B 2510
Frogboss · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
ReasoningTool use
DE
DeepSeek R1 Qwen 32B Uncensored
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
Reasoning
QW
Qwen3 Embedding Giga Embeddings 0826 480M
Qwen · ai-babai
Params484M
Context8K
Q4_K_M0.3 GB
Embedding

Keep browsing