GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gervasio 8b Portuguese Ptpt Decoder
Gervasio · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Coding
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · sensitivecontent
Params284B
Context1024K
Smallest10.9 GB
GGUF
JO
JOSIE 2 4B OSS
Josie · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
Vision
NE
Nemotron SEA LION v4.8 30B A3B
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731
DeepSeek · bartowski
Params284B
Context—
Smallest10.9 GB
GGUF
MI
MiMo VL 7B RL 2508
Mimo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool useVision
QW
DAT Qwen2.5 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
GL
GLM 4.7 Flash Ultra Uncensored Heretic
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
HU
Huihui Fara 7B Abliterated
Huihui · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Uncensored Reasoner
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek V4 Pro
DeepSeek · teamblobfish
Params1570B
Context1024K
Q4_K_M954.6 GB
GGUF
SE
Seed Coder 8B Base
Seed · mradermacher
Params8.25B
Context32K
Q4_K_M5.1 GB
Coding
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
GGUF
PH
dolphin-2.9.2-Phi-3-Medium
Phi · bartowski
Params14B
Context4K
Q4_K_M8.4 GB
CodingTool use
MI
MiroThinker v1.0 30B
Mirothinker · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
GL
Export_Glm47_Flash_Abliteratex
GLM · wangzhang
Params29.9B
Context198K
Smallest31.8 GB
ReasoningTool use
PH
phi3.5 gutenberg 4B
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
GL
GLM 4.5 Air
GLM · auRose94
Params78.8B
Context128K
Smallest78.9 GB
GGUF
PH
Phi 3.1 mini 128k instruct
Phi · lmstudio-community
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
MI
mimo tokenizer
Mimo · cstr
Params649M
Context—
Smallest0.4 GB
GGUF
FR
FrogMini 14B 2510
Frogmini · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
GU
GUI Actor Verifier 2B
Gui · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen3 8B RP v0.1
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningRoleplayTool use
SN
snac 24khz
Snac · cstr
Params13M
Context—
Smallest0.0 GB
GGUF
GL
GLM-5.3-Flash
GLM · taurusduan
Params313B
Context1024K
Smallest117.5 GB
Vision
GL
Zai org.GLM 5
GLM · DevQuasar
Params754B
Context198K
Q4_K_M454.9 GB
ReasoningTool use
SA
SADeepCoder 14B Preview Unsloth v1.0
Sai · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
GL
GLM 5.3 Flash UNCENSORED
GLM · Solstice-AI
Params1.17B
Context1024K
Smallest1.3 GB
ReasoningTool useVision
OR
Ornith 1.5 35B A3B NVFP4 MTP
Ornith · tiyuvta
Params67M
Context—
Smallest0.0 GB
GGUF
BI
bitnet embedding 0.6b
Bitnet · microsoft
Params596M
Context32K
Smallest0.4 GB
Embedding

Keep browsing