GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
TempNet LLaMA2 Chat 13B v0.1
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GL
GLM 4.6V
GLM · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB
ReasoningTool useVision
DE
DeepSeek-R1-Distill-Qwen-1.5B
DeepSeek · Mungert
Params1.78B
Context128K
Q4_K_M1.2 GB
ReasoningTool use
KW
KwaiCoder 23B A4B v1
Kwaicoder · mradermacher
Params23.3B
Context4K
Q4_K_M15.4 GB
Coding
QW
Qwen3 Next 352E Abliterated Instruct
Qwen · mradermacher
Params55.5B
Context256K
Q4_K_M33.8 GB
Tool use
CA
CapyberaHermesYi 34B ChatML 200K i1
Capyberahermesyi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
Tool use
PH
Phi 4 Model Stock i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · qtum
Params284B
Context1024K
Smallest63.1 GB
GGUF
GL
GLM 5.2 ewaste edition
GLM · SixVolts
Params754B
Context1024K
Smallest243.6 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash
DeepSeek · ktobik
Params755B
Context—
Smallest365.7 GB
GGUF
GP
Gpt Nyc
Gpt · mradermacher
Params356M
Context1K
Q4_K_M0.2 GB
GGUF
AP
Apriel R1P
Apriel · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
Tool use
PH
Phi 4 Uncensored
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
VI
ImageQuality R1 v1
Visualquality · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningTool use
QW
Qwen3.6 35B A3B DFlash
Qwen · lym00
Params386M
Context256K
Smallest0.4 GB
ReasoningTool use
RH
Rho Math 1b Interpreter v0.1
Rho · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
GL
ArliAI GLM 4.5 Air Derestricted REAP50 Creative
GLM · Koshkasa
Params57B
Context128K
Smallest60.6 GB
GGUF
QW
Qwen3 32b Geminized Experimental
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
ReasoningTool use
LL
Llama 3 Base 8B DICE Iter2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PY
Pyrut 8B Instruct Uncensored
Pyrex · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
AL
ALMA 7B Pretrain
Alma · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LU
Lumina-14M
Lumina · jacopof
Params14M
Context256
Smallest0.1 GB
Coding
QW
LUFFY Qwen Instruct 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
NE
Apriel Nemotron 15b Thinker Magic_decensored v2_MPOA
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
ReasoningTool use
OP
OpenForecaster 8B
Openforecaster · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
DE
dspark DeepSeek V4 Pro 0813
DeepSeek · pokey2025
Params77.5B
Context1024K
Smallest30.8 GB
GGUF
GL
GLM 4.7 Flash
GLM · axteam
Params31.2B
Context198K
Q4_K_M18.9 GB
ReasoningTool use
MI
Mimo-Vl-7B-Rl
Mimo · akpsahan
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
BI
Bitnet_B1_58 Large
Bitnet · mradermacher
Params729M
Context2K
Q4_K_M0.5 GB
GGUF
GP
Gpt2 Xl
Gpt · mradermacher
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF

Keep browsing