GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
LL
SEVENLLM-Llama2-7B-CoT
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GL
GLM Z1 Rumination 32B 0414
GLM · bartowski
Params33.1B
Context128K
Q4_K_M20.0 GB
FR
FrogNano 4B 2609
Frognano · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
DE
DeepSeek R1 0528 Qwen3 8B Heretic
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
GL
GLM 4 32B Base 32K
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
PH
Phi 3 Mini 4k Instruct
Phi · SanctumAI
Params3.82B
Context4K
Q4_K_M2.4 GB
PE
Peach 2.0 9B 8k Roleplay
Peach · fengpeisheng1
Params8.83B
Context16K
Smallest4.8 GB
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS MXFP8 Engram
DeepSeek · Starw1
Params197B
Context1024K
Smallest138.6 GB
GL
cerebras/GLM-4.7-REAP-218B-A32B
GLM · unsloth
Params218B
Context198K
Q4_K_M132.0 GB
GL
GLM 4 9B 0414
GLM · lmstudio-community
Params9.4B
Context32K
Q4_K_M6.2 GB
DE
DeepSeek V4.1 Flash 1017 dsx ud
DeepSeek · lxe
Params—
Context—
Smallest303.6 GB
GL
GLM 4.7 Flash
GLM · evilfreelancer
Params29.9B
Context198K
Q4_K_M18.1 GB
FA
Fara 7B
Fara · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
TR
TRELLIS image large
Trellis · LocalAI-io
Params74M
Context—
Smallest0.1 GB
VI
vibevoice asr bitnet
Vibevoice · cstr
Params2.24B
Context—
Smallest0.0 GB
DE
Deepseek ai.DeepSeek V3.2 BF16
DeepSeek · DevQuasar
Params670B
Context160K
Q4_K_M404.5 GB
DO
Dots.Mocr
Dots · prithivMLmods
Params1.78B
Context128K
Q4_K_M1.1 GB
GP
Gpt2 Large
Gpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
LI
Ling-3.0-tiny-base-30T
Ling · FriskyFennec
Params8.2B
Context8K
Q4_K_M5.0 GB
IR
Irbis-7b-v0.1
Irbis · mradermacher
Params7.47B
Context32K
Q4_K_M4.5 GB
GL
Huihui GLM 4.6V Flash Abliterated
GLM · mradermacher
Params9.4B
Context128K
Q4_K_M6.2 GB
LL
LightGPT 7B Llama2
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GL
GLM 4.5 Iceblink v3 106B A12B
GLM · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB
GP
GPT4chan 8B
Gpt · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
yeen214_llama2_7b_merge_orcafamily
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GR
Grug 35b
Grug · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
DE
deepsex 34b
Deepsex · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GL
GLM 4.6V Flash
GLM · mradermacher
Params9.4B
Context128K
Q4_K_M6.2 GB
GP
openai community gpt2 GGUF smashed
Gpt · PrunaAI
Params124M
Context1K
Q4_K_M0.1 GB
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB