GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
IN
Indian law chat minor project
Indian · varma007ut
Params6.74B
Context4K
Smallest7.2 GB
FI
Fireship GPT v1 i1
Fireship · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OR
Ornith 1.5 9B Uncensored
Ornith · bowmanslayer
Params9.2B
Context256K
Q4_K_M5.8 GB
PH
Phi 3 mini 4k grammar correction
Phi · afrideva
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3 medium 128k instruct
Phi · RDson
Params14B
Context128K
Q4_K_M8.6 GB
DE
Fathom-R1-14B
DeepSeek · Mungert
Params14.8B
Context128K
Q4_K_M9.1 GB
DE
DeepSeek R1 Distill Qwen 14B Japanese Chat
DeepSeek · flypg
Params14.8B
Context128K
Q4_K_M9.0 GB
GL
GLM 5.2 0.8B A0.8B
GLM · mradermacher
Params850M
Context1024K
Q4_K_M0.6 GB
GL
GLM 5.3 Flash
GLM · PaoAI
Params321B
Context1024K
Smallest77.1 GB
GL
Huihui GLM 4.7 Flash Abliterated
GLM · cs2764
Params29.9B
Context198K
Smallest24.6 GB
LL
Diffusion Llama 3 8B Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
AT
Athena 1 14B i1
Athena · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
SA
Saul 7B Instruct v1 i1
Saul · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
Phi 4 o1 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
MI
SciPhi Mistral 7B 32k Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
XiaomiMiMo.MiMo V2 Flash
Mimo · DevQuasar
Params309B
Context256K
Q4_K_M186.8 GB
LL
Lebanese Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
PH
Phi 4 Mini Reasoning
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
MI
MiMo-V2.6-Pro-MOPD
Mimo · pcuenq
Params1020B
Context1024K
Smallest2.1 GB
BL
Q3.5 BlueStar 27B
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
PH
phi 3.5 AI Vtuber json
Phi · Navpy
Params3.82B
Context128K
Q4_K_M2.3 GB
US
UserRepGen 4B
Userrepgen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
OR
Ornith-1.5-35B
Ornith · poisonxa
Params35.5B
Context256K
Smallest19.6 GB
QW
PAPO G H Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
PH
shisa v1 phi3 14b
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
CA
cat-v1.0-13b
Cat · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
RE
ReForm SFT 0.5B
Reform · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
CH
Chocolatine 14B Instruct DPO v1.3 i1
Chocolatine · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GU
GUI Owl 1.5 32B Instruct
Gui · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
AR
LiberalMind_v1.5
Arctic · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB