GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
PH
phi4 mm
Phi · Swicked86
Params3.84B
Context128K
Q4_K_M2.5 GB
XC
XCurOS OCR
Xcuros · mradermacher
Params891M
Context128K
Q4_K_M0.5 GB
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · therickcain
Params1.68B
Context1024K
Smallest0.6 GB
DE
DeepSeek V4 Flash 0731 heretic abliterated v2 GGUF lora
DeepSeek · MorinoNushi
Params—
Context—
Smallest0.0 GB
GE
Gemma SEA LION Guard v2 E2B
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
FR
FRIDA
Frida · evilfreelancer
Params823M
Context512
Smallest0.4 GB
DE
Deepseek Paraphrase
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ZE
Zephyr 7b Beta Abliterated
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
UM
CENTAURUS Engine v1
Uma · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AR
Arc Decide 0.4b v0.2
Arc · mradermacher
Params563M
Context32K
Q4_K_M0.4 GB
SE
sense voice
Sense · lovemefan
Params234M
Context—
Smallest0.2 GB
MI
MiMo VL 7B RL
Mimo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GL
GLM 4.6V Flash
GLM · eaddario
Params9.4B
Context128K
Q4_K_M6.2 GB
AG
AgentEye Grounder 0.8B v1
Agenteye · mradermacher
Params773M
Context256K
Q4_K_M0.5 GB
SP
SpydazWeb_AI_LCARS_Humanization_003
Spydazweb · mradermacher
Params7.24B
Context512K
Q4_K_M4.4 GB
MI
MiMo V2 Flash Base
Mimo · mradermacher
Params309B
Context256K
Q4_K_M186.8 GB
LL
selfrag llama2 7b
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
DAT Llama 3 8B Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 VL 7B MM UPT MMR1
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen2.5 Coder 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GL
GLM 4.5 Air
GLM · steampunque
Params120B
Context128K
Smallest63.6 GB
QW
UnifiedReward Edit Qwen 32b
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
QW
NextCoder-7B
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M4.8 GB
MI
MiroThinker v1.5 30B Heretic
Mirothinker · jarradh
Params30.5B
Context256K
Smallest32.5 GB
GL
GLM 5.3 Flash Abliterated LoRA
GLM · GCSA-AiLab
Params144M
Context—
Smallest0.3 GB
QW
AutoGEO_mini_Qwen1.7B
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
QW
Qwen3 8B NSFW JP
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
CO
CodeFuse SVR 8B
Codefuse · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
PH
phi 4 mini instruct 4b usm tau py 0003
Phi · tletai
Params3.84B
Context128K
Q4_K_M2.5 GB
AP
Apriel 1.6 15b Thinker
Apriel · mradermacher
Params14.4B
Context256K
Q4_K_M8.8 GB