GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
MU
multilingual e5 small gguf q8 0
Multilingual · keisuke-miyako
Params118M
Context512
Smallest0.1 GB
RI
Ring Mini 2.0
Ring · mradermacher
Params16.3B
Context32K
Q4_K_M9.9 GB
PH
Phi 3 medium 128k instruct imatrix
Phi · hermes42
Params14B
Context128K
Q4_K_M8.6 GB
DE
Deepseek-R1-0528-Qwen3-8B
DeepSeek · cecloud33
Params8.19B
Context128K
Q4_K_M5.0 GB
SA
Sarashina2.2 1b
Sarashina · mradermacher
Params1.41B
Context8K
Q4_K_M0.9 GB
NA
Naive N0.5 Flash Mixed Quant
Naive · AMAImedia
Params—
Context—
Smallest0.7 GB
OM
Omni R1 Zero
Omni · mradermacher
Params7.01B
Context10K
Q4_K_M4.3 GB
PH
phi3.5 gutenberg 4B
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
MA
MAmmoTH2-8x7B-Plus
Mammoth · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
PI
piper en US lessac medium
Piper · cstr
Params16M
Context—
Smallest0.0 GB
DE
DeepSeek V3.1 Terminus
DeepSeek · bartowski
Params671B
Context160K
Q4_K_M409.2 GB
OR
Ornith 1.5 122B
Ornith · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
LO
Lotus 1
Lotus · yashsutorichat
Params34.7B
Context256K
Q4_K_M21.2 GB
KI
Kimi Dev 72B
Kimi · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
OR
Ornith 1.5 35B A3B Heretic Ja
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
MiMo V2.6 Distill Qwen 9B
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
OR
Ornith 1.5 122B NVFP4
Ornith · prithivMLmods
Params125B
Context256K
Smallest80.9 GB
OR
Ornith 1.5 35B A3B
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
YI
Faro Yi 9B DPO
Yi · QuantFactory
Params8.83B
Context32K
Q4_K_M5.3 GB
LL
Llama 3.1 8B Base Instruct SLERP
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MI
Nexus IKM Hermes 2 Pro Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AU
AutoGLM Phone 9B Multilingual
Autoglm · mradermacher
Params9.4B
Context64K
Q4_K_M6.2 GB
LI
Ling 3.0 Tiny Heretic
Ling · mradermacher
Params7.89B
Context128K
Q4_K_M4.8 GB
OR
Ornith 1.5 9B Abliterated
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
JE
Jevos v4
Jevos · feder-cr
Params882M
Context128K
Q4_K_M0.6 GB
MI
MiMo V2.6 Flash RL
Mimo · TrevorJS
Params310B
Context1024K
Smallest2.2 GB
FU
functionary small v3.1
Functionary · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GL
AutoGLM-Phone-9B-Multilingual
GLM · Mungert
Params9.4B
Context64K
Q4_K_M6.6 GB
GL
GLM-4.7-Flash-Uncensored-HauhauCS-Balanced
GLM · Unrestricted
Params30B
Context198K
Q4_K_M18.1 GB
AP
Apriel-1.5-15b-Thinker
Apriel · Mungert
Params14.4B
Context256K
Q4_K_M9.2 GB