GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
GL
GLM 4.7 Flash Coder
GLM · ali-sys-1370
Params29.9B
Context198K
Q4_K_M18.1 GB
DE
DeepSeek R1 0528 Qwen3 8B KAYLA1.1
DeepSeek · mradermacher
Params8.19B
Context500K
Q4_K_M5.0 GB
ZE
Zeta 4.5
Zeta · mradermacher
Params464M
Context32K
Q4_K_M0.3 GB
VI
Vision Matters 7B
Vision · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GL
glm 5.2
GLM · antirez
Params754B
Context1024K
Smallest211.1 GB
PH
TaliML PHI3 128K ITA V.1.0.FINAL i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
MI
Mixtral BioMedical i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NA
NatureLM 8x7B Inst
Naturelm · mradermacher
Params46.8B
Context32K
Q4_K_M28.5 GB
GA
GaMS3 12B Multimodal
Gams · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
OR
Ornith 1.5 35B A3B APEX
Ornith · Myric
Params35.5B
Context256K
Smallest12.6 GB
AP
Apriel 1.6 15b Thinker
Apriel · eaddario
Params14.4B
Context256K
Q4_K_M8.8 GB
LL
Maestro R1 Llama 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 2 70b Chat Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
MI
mistral orpo capybara 7k
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
LightThinker Plus Qwen3 30B A3B
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
NU
NuExtract 2.0 2B
Nuextract · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
TwinFlow Qwen Image v1.0 diffusers
Qwen · smthem
Params20.4B
Context—
Smallest9.0 GB
GL
GLM-4.6V-Flash
GLM · Mungert
Params9.4B
Context128K
Q4_K_M6.6 GB
CH
Chocolatine 14B Instruct 4k DPO
Chocolatine · tensorblock
Params14B
Context4K
Smallest5.1 GB
LI
Ring Flash 2.0
Ling · redponike
Params103B
Context32K
Q4_K_M62.4 GB
QW
CoReward Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ST
StructLM 13B
Structlm · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
CH
Chocolatine 2 14B Instruct v2.0b2 i1
Chocolatine · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
VI
vibevoice-7b
Vibevoice · cstr
Params9.34B
Context—
Smallest6.2 GB
FU
functionary small v3.2
Functionary · second-state
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLM AI Server
Llm · mmkurodan
Params2M
Context128
Q4_K_M0.0 GB
GL
AutoGLM-Phone-9B
GLM · Mungert
Params9.4B
Context64K
Q4_K_M6.6 GB
CH
ChatFrame
Chatframe · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
MiroThinker v1.5 30B Heretic
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
PL
Planium 4B
Planium · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB