GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
phi4 mm
Phi · Swicked86
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool useVision
XC
XCurOS OCR
Xcuros · mradermacher
Params891M
Context128K
Q4_K_M0.5 GB
ReasoningTool useVision
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · therickcain
Params1.68B
Context1024K
Smallest0.6 GB
GGUF
DE
DeepSeek V4 Flash 0731 heretic abliterated v2 GGUF lora
DeepSeek · MorinoNushi
Params—
Context—
Smallest0.0 GB
GGUF
GE
Gemma SEA LION Guard v2 E2B
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
FR
FRIDA
Frida · evilfreelancer
Params823M
Context512
Smallest0.4 GB
Embedding
DE
Deepseek Paraphrase
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
ZE
Zephyr 7b Beta Abliterated
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
UM
CENTAURUS Engine v1
Uma · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AR
Arc Decide 0.4b v0.2
Arc · mradermacher
Params563M
Context32K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
SE
sense voice
Sense · lovemefan
Params234M
Context—
Smallest0.2 GB
GGUF
MI
MiMo VL 7B RL
Mimo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool useVision
GL
GLM 4.6V Flash
GLM · eaddario
Params9.4B
Context128K
Q4_K_M6.2 GB
ReasoningTool useVision
AG
AgentEye Grounder 0.8B v1
Agenteye · mradermacher
Params773M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
SP
SpydazWeb_AI_LCARS_Humanization_003
Spydazweb · mradermacher
Params7.24B
Context512K
Q4_K_M4.4 GB
Coding
MI
MiMo V2 Flash Base
Mimo · mradermacher
Params309B
Context256K
Q4_K_M186.8 GB
Tool use
LL
selfrag llama2 7b
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
DAT Llama 3 8B Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 VL 7B MM UPT MMR1
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool useVision
QW
Qwen2.5 Coder 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
GL
GLM 4.5 Air
GLM · steampunque
Params120B
Context128K
Smallest63.6 GB
ReasoningTool use
QW
UnifiedReward Edit Qwen 32b
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
GGUF
QW
NextCoder-7B
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M4.8 GB
CodingTool use
MI
MiroThinker v1.5 30B Heretic
Mirothinker · jarradh
Params30.5B
Context256K
Smallest32.5 GB
GGUF
GL
GLM 5.3 Flash Abliterated LoRA
GLM · GCSA-AiLab
Params144M
Context—
Smallest0.3 GB
GGUF
QW
AutoGEO_mini_Qwen1.7B
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
QW
Qwen3 8B NSFW JP
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
CO
CodeFuse SVR 8B
Codefuse · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
PH
phi 4 mini instruct 4b usm tau py 0003
Phi · tletai
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
AP
Apriel 1.6 15b Thinker
Apriel · mradermacher
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningTool useVision

Keep browsing