GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
PH
Phi Lthy4
Phi · bartowski
Params11.9B
Context16K
Q4_K_M7.3 GB
GL
GLM 4 9B 0414 Abliterated
GLM · Melvin56
Params9.4B
Context32K
Q4_K_M6.2 GB
FU
functionary medium v3.2
Functionary · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
TE
TEA ASR 1.1 Fmt
Tea · mradermacher
Params1.72B
Context64K
Q4_K_M1.1 GB
AL
AllwissenGPT 7B
Allwissengpt · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
TheStageAI/gemma-4-E4B-it-qat-GGUF-M
Gemma · TheStageAI
Params7.46B
Context128K
Smallest4.0 GB
PH
torchlight phi4 mini
Phi · samadpls
Params3.84B
Context128K
Q4_K_M2.5 GB
BI
BioQwen-0.5B
Bioqwen · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
FI
fietje 2 i1
Fietje · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
MI
Prox-MistralHermes-7B
Mistral · Mungert
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
DeepSeek R1 Distill Qwen 7B Uncensored Reasoner
DeepSeek · mradermacher
Params7.61B
Context128K
Q4_K_M4.7 GB
GP
gpt oss 504
gpt-oss · Exorn
Params120B
Context128K
Smallest0.0 GB
MI
Bangla Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GL
Pwdz 1 Uncensored
GLM · pwdz
Params313B
Context1024K
Smallest137.1 GB
PH
Phi 3.1 mini 128k instruct
Phi · GPT4All-Community
Params3.82B
Context128K
Smallest2.2 GB
DI
Dimensity-3B
Dimensity · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
PH
parsak phi 2 code instruct
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
CA
CapyberaHermesYi 34B ChatML 200K
Capyberahermesyi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
BG
bge reranker large Q8 0
BGE · Astralyra
Params560M
Context512
Smallest0.6 GB
LI
Ling Lite Base 1.5
Ling · mradermacher
Params16.8B
Context32K
Q4_K_M11.2 GB
ST
Stable DiffCoder 8B Instruct
Stable · mradermacher
Params8.25B
Context8K
Q4_K_M5.1 GB
QW
SvS Qwen Code 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
LaSER Qwen3 4B
Qwen · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
DE
RM R1 DeepSeek Distilled Qwen 14B
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
TI
TinyBalls 110M V1
Tinyballs · mradermacher
Params113M
Context32K
Q4_K_M0.1 GB
DE
deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
DeepSeek · featherless-ai-quants
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
qwen2.5 coder
Qwen · cortexso
Params14.8B
Context32K
Q4_K_M9.0 GB
CE
Cecilia 2b Instruct v1
Cecilia · mradermacher
Params2.25B
Context8K
Q4_K_M1.5 GB
LL
R1 1776 Distill Llama 70b Abliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB