GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
MU
multilingual e5 small gguf q8 0
Multilingual · keisuke-miyako
Params118M
Context512
Smallest0.1 GB
GGUF
RI
Ring Mini 2.0
Ring · mradermacher
Params16.3B
Context32K
Q4_K_M9.9 GB
Reasoning
PH
Phi 3 medium 128k instruct imatrix
Phi · hermes42
Params14B
Context128K
Q4_K_M8.6 GB
CodingTool use
DE
Deepseek-R1-0528-Qwen3-8B
DeepSeek · cecloud33
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
SA
Sarashina2.2 1b
Sarashina · mradermacher
Params1.41B
Context8K
Q4_K_M0.9 GB
GGUF
NA
Naive N0.5 Flash Mixed Quant
Naive · AMAImedia
Params—
Context—
Smallest0.7 GB
GGUF
OM
Omni R1 Zero
Omni · mradermacher
Params7.01B
Context10K
Q4_K_M4.3 GB
Reasoning
PH
phi3.5 gutenberg 4B
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
MA
MAmmoTH2-8x7B-Plus
Mammoth · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
PI
piper en US lessac medium
Piper · cstr
Params16M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V3.1 Terminus
DeepSeek · bartowski
Params671B
Context160K
Q4_K_M409.2 GB
ReasoningTool use
OR
Ornith 1.5 122B
Ornith · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
ReasoningTool useVision
LO
Lotus 1
Lotus · yashsutorichat
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningRoleplayTool use
KI
Kimi Dev 72B
Kimi · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
CodingTool use
OR
Ornith 1.5 35B A3B Heretic Ja
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
MiMo V2.6 Distill Qwen 9B
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingTool use
OR
Ornith 1.5 122B NVFP4
Ornith · prithivMLmods
Params125B
Context256K
Smallest80.9 GB
ReasoningTool useVision
OR
Ornith 1.5 35B A3B
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
YI
Faro Yi 9B DPO
Yi · QuantFactory
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
LL
Llama 3.1 8B Base Instruct SLERP
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Nexus IKM Hermes 2 Pro Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
AU
AutoGLM Phone 9B Multilingual
Autoglm · mradermacher
Params9.4B
Context64K
Q4_K_M6.2 GB
GGUF
LI
Ling 3.0 Tiny Heretic
Ling · mradermacher
Params7.89B
Context128K
Q4_K_M4.8 GB
ReasoningTool use
OR
Ornith 1.5 9B Abliterated
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
JE
Jevos v4
Jevos · feder-cr
Params882M
Context128K
Q4_K_M0.6 GB
ReasoningTool use
MI
MiMo V2.6 Flash RL
Mimo · TrevorJS
Params310B
Context1024K
Smallest2.2 GB
ReasoningTool use
FU
functionary small v3.1
Functionary · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GL
AutoGLM-Phone-9B-Multilingual
GLM · Mungert
Params9.4B
Context64K
Q4_K_M6.6 GB
Vision
GL
GLM-4.7-Flash-Uncensored-HauhauCS-Balanced
GLM · Unrestricted
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
AP
Apriel-1.5-15b-Thinker
Apriel · Mungert
Params14.4B
Context256K
Q4_K_M9.2 GB
Reasoning

Keep browsing