GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
SEVENLLM-Llama2-7B-CoT
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GL
GLM Z1 Rumination 32B 0414
GLM · bartowski
Params33.1B
Context128K
Q4_K_M20.0 GB
GGUF
FR
FrogNano 4B 2609
Frognano · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
Vision
DE
DeepSeek R1 0528 Qwen3 8B Heretic
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
Reasoning
GL
GLM 4 32B Base 32K
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · SanctumAI
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PE
Peach 2.0 9B 8k Roleplay
Peach · fengpeisheng1
Params8.83B
Context16K
Smallest4.8 GB
Roleplay
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS MXFP8 Engram
DeepSeek · Starw1
Params197B
Context1024K
Smallest138.6 GB
GGUF
GL
cerebras/GLM-4.7-REAP-218B-A32B
GLM · unsloth
Params218B
Context198K
Q4_K_M132.0 GB
GGUF
GL
GLM 4 9B 0414
GLM · lmstudio-community
Params9.4B
Context32K
Q4_K_M6.2 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 dsx ud
DeepSeek · lxe
Params—
Context—
Smallest303.6 GB
GGUF
GL
GLM 4.7 Flash
GLM · evilfreelancer
Params29.9B
Context198K
Q4_K_M18.1 GB
ReasoningTool use
FA
Fara 7B
Fara · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
TR
TRELLIS image large
Trellis · LocalAI-io
Params74M
Context—
Smallest0.1 GB
GGUF
VI
vibevoice asr bitnet
Vibevoice · cstr
Params2.24B
Context—
Smallest0.0 GB
GGUF
DE
Deepseek ai.DeepSeek V3.2 BF16
DeepSeek · DevQuasar
Params670B
Context160K
Q4_K_M404.5 GB
GGUF
DO
Dots.Mocr
Dots · prithivMLmods
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingVision
GP
Gpt2 Large
Gpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
LI
Ling-3.0-tiny-base-30T
Ling · FriskyFennec
Params8.2B
Context8K
Q4_K_M5.0 GB
GGUF
IR
Irbis-7b-v0.1
Irbis · mradermacher
Params7.47B
Context32K
Q4_K_M4.5 GB
GGUF
GL
Huihui GLM 4.6V Flash Abliterated
GLM · mradermacher
Params9.4B
Context128K
Q4_K_M6.2 GB
Vision
LL
LightGPT 7B Llama2
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GL
GLM 4.5 Iceblink v3 106B A12B
GLM · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB
Roleplay
GP
GPT4chan 8B
Gpt · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
yeen214_llama2_7b_merge_orcafamily
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
GR
Grug 35b
Grug · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
CodingReasoningTool use
DE
deepsex 34b
Deepsex · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
Roleplay
GL
GLM 4.6V Flash
GLM · mradermacher
Params9.4B
Context128K
Q4_K_M6.2 GB
ReasoningTool useVision
GP
openai community gpt2 GGUF smashed
Gpt · PrunaAI
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF

Keep browsing