GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
LL
TempNet LLaMA2 Chat 13B v0.1
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GL
GLM 4.6V
GLM · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB
DE
DeepSeek-R1-Distill-Qwen-1.5B
DeepSeek · Mungert
Params1.78B
Context128K
Q4_K_M1.2 GB
KW
KwaiCoder 23B A4B v1
Kwaicoder · mradermacher
Params23.3B
Context4K
Q4_K_M15.4 GB
QW
Qwen3 Next 352E Abliterated Instruct
Qwen · mradermacher
Params55.5B
Context256K
Q4_K_M33.8 GB
CA
CapyberaHermesYi 34B ChatML 200K i1
Capyberahermesyi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
PH
Phi 4 Model Stock i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · qtum
Params284B
Context1024K
Smallest63.1 GB
GL
GLM 5.2 ewaste edition
GLM · SixVolts
Params754B
Context1024K
Smallest243.6 GB
DE
DeepSeek V4.1 Flash
DeepSeek · ktobik
Params755B
Context—
Smallest365.7 GB
GP
Gpt Nyc
Gpt · mradermacher
Params356M
Context1K
Q4_K_M0.2 GB
AP
Apriel R1P
Apriel · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
PH
Phi 4 Uncensored
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
VI
ImageQuality R1 v1
Visualquality · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen3.6 35B A3B DFlash
Qwen · lym00
Params386M
Context256K
Smallest0.4 GB
RH
Rho Math 1b Interpreter v0.1
Rho · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GL
ArliAI GLM 4.5 Air Derestricted REAP50 Creative
GLM · Koshkasa
Params57B
Context128K
Smallest60.6 GB
QW
Qwen3 32b Geminized Experimental
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
LL
Llama 3 Base 8B DICE Iter2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
PY
Pyrut 8B Instruct Uncensored
Pyrex · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
AL
ALMA 7B Pretrain
Alma · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
LU
Lumina-14M
Lumina · jacopof
Params14M
Context256
Smallest0.1 GB
QW
LUFFY Qwen Instruct 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
NE
Apriel Nemotron 15b Thinker Magic_decensored v2_MPOA
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
OP
OpenForecaster 8B
Openforecaster · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
DE
dspark DeepSeek V4 Pro 0813
DeepSeek · pokey2025
Params77.5B
Context1024K
Smallest30.8 GB
GL
GLM 4.7 Flash
GLM · axteam
Params31.2B
Context198K
Q4_K_M18.9 GB
MI
Mimo-Vl-7B-Rl
Mimo · akpsahan
Params7.62B
Context125K
Q4_K_M4.7 GB
BI
Bitnet_B1_58 Large
Bitnet · mradermacher
Params729M
Context2K
Q4_K_M0.5 GB
GP
Gpt2 Xl
Gpt · mradermacher
Params1.64B
Context1K
Q4_K_M1.2 GB