GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
BG
bge m3
BGE · KimChen
Params567M
Context8K
Q4_K_M0.4 GB
ME
MelloGPT i1
Mellogpt · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
SenecaLLM x Qwen2.5 7B CyberSecurity i1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GL
Huihui ai.GLM Z1 9B 0414 Abliterated
GLM · DevQuasar-12
Params9.4B
Context32K
Q4_K_M6.2 GB
HU
Huihui MiroThinker v1.0 72B Abliterated
Huihui · mradermacher
Params72.7B
Context256K
Q4_K_M47.4 GB
GE
gemma-3-27b-it-codeforces-SFT
Gemma · BasedAGI
Params27B
Context128K
Q4_K_M16.5 GB
PH
Phi 3 Mini 128k Instruct
Phi · gaianet
Params3.82B
Context128K
Q4_K_M2.4 GB
KU
Kuvera 14B v0.1.0
Kuvera · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GL
Melinoe GLM 30B A3B Thinking
GLM · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
RI
inclusionAI.Ring Flash 2.0
Ring · DevQuasar-11
Params103B
Context32K
Q4_K_M62.4 GB
LI
Ling 3.0 Tiny
Ling · Mike0021
Params7.89B
Context128K
Q4_K_M4.8 GB
DE
Deepseek-R1-0528-Qwen3-8B
DeepSeek · XythicK
Params8.19B
Context128K
Q4_K_M5.0 GB
PH
Torchlight Phi4 Mini
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
LL
CoSER Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama_8B_Explainer
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
OR
Ornith 1.0 35B
Ornith · tashfene
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
wt neko instruct
Qwen · Trina-QwQ
Params4.02B
Context256K
Smallest2.5 GB
ST
Stable DiffCoder 8B Base
Stable · mradermacher
Params8.25B
Context8K
Q4_K_M5.1 GB
BG
bge-large-zh-v1.5
BGE · CompendiumLabs
Params324M
Context512
Q4_K_M0.2 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ZE
Zephyr 7b Beta Absolute Heresy
Zephyr · mradermacher
Params7.24B
Context64K
Q4_K_M4.4 GB
QW
qwen2.5 3b instruct.Q4 K M
Qwen · r1r21nb
Params3.09B
Context32K
Q4_K_M1.9 GB
MI
MiniMax M2 THRIFT 55 i1
Minimax · mradermacher
Params106B
Context192K
Smallest0.2 GB
AP
Apriel 1.6 15b Thinker Magic_alpha decensored_MPOA
Apriel · mradermacher
Params14.4B
Context256K
Q4_K_M8.8 GB
DE
DeepSWE Preview
Deepswe · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
KA
kappa 3 phi abliterated
Kappa · afrideva
Params3.82B
Context4K
Q4_K_M2.4 GB
DE
Cogito-V2-Preview-Deepseek-671B-Moe
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.9 GB
FR
FrogBoss 32B 2510
Frogboss · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
DE
DeepSeek R1 Qwen 32B Uncensored
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
QW
Qwen3 Embedding Giga Embeddings 0826 480M
Qwen · ai-babai
Params484M
Context8K
Q4_K_M0.3 GB