GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
GE
Gervasio 8b Portuguese Ptpt Decoder
Gervasio · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · sensitivecontent
Params284B
Context1024K
Smallest10.9 GB
JO
JOSIE 2 4B OSS
Josie · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
NE
Nemotron SEA LION v4.8 30B A3B
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · bartowski
Params284B
Context—
Smallest10.9 GB
MI
MiMo VL 7B RL 2508
Mimo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
DAT Qwen2.5 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GL
GLM 4.7 Flash Ultra Uncensored Heretic
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
HU
Huihui Fara 7B Abliterated
Huihui · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 14B Uncensored Reasoner
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek V4 Pro
DeepSeek · teamblobfish
Params1570B
Context1024K
Q4_K_M954.6 GB
SE
Seed Coder 8B Base
Seed · mradermacher
Params8.25B
Context32K
Q4_K_M5.1 GB
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
PH
dolphin-2.9.2-Phi-3-Medium
Phi · bartowski
Params14B
Context4K
Q4_K_M8.4 GB
MI
MiroThinker v1.0 30B
Mirothinker · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
GL
Export_Glm47_Flash_Abliteratex
GLM · wangzhang
Params29.9B
Context198K
Smallest31.8 GB
PH
phi3.5 gutenberg 4B
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GL
GLM 4.5 Air
GLM · auRose94
Params78.8B
Context128K
Smallest78.9 GB
PH
Phi 3.1 mini 128k instruct
Phi · lmstudio-community
Params3.82B
Context128K
Q4_K_M2.4 GB
MI
mimo tokenizer
Mimo · cstr
Params649M
Context—
Smallest0.4 GB
FR
FrogMini 14B 2510
Frogmini · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GU
GUI Actor Verifier 2B
Gui · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen3 8B RP v0.1
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
SN
snac 24khz
Snac · cstr
Params13M
Context—
Smallest0.0 GB
GL
GLM-5.3-Flash
GLM · taurusduan
Params313B
Context1024K
Smallest117.5 GB
GL
Zai org.GLM 5
GLM · DevQuasar
Params754B
Context198K
Q4_K_M454.9 GB
SA
SADeepCoder 14B Preview Unsloth v1.0
Sai · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GL
GLM 5.3 Flash UNCENSORED
GLM · Solstice-AI
Params1.17B
Context1024K
Smallest1.3 GB
OR
Ornith 1.5 35B A3B NVFP4 MTP
Ornith · tiyuvta
Params67M
Context—
Smallest0.0 GB
BI
bitnet embedding 0.6b
Bitnet · microsoft
Params596M
Context32K
Smallest0.4 GB