GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
PH
Phi 3.5 mini ITA
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
LL
LlamaForecaster 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
EM
Emollama 7b i1
Emollama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
SenecaLLM x Llama3.1 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
PO
polka 1.1b chat
Polka · mradermacher
Params1.15B
Context4K
Q4_K_M0.7 GB
RU
ruGPT-3.5-13B
Rugpt · oblivious
Params13.1B
Context2K
Q4_K_M8.4 GB
ZE
Zephyr 7b Beta
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3.5 2B Ideal TSUNDERE Loli Girl Japanese v1
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
DE
nova deepseek r1 abliterated 7b qwen distill
DeepSeek · VelvetVibe
Params7.6B
Context128K
Q4_K_M4.7 GB
SP
speecht5 tts
Speecht · cstr
Params157M
Context—
Smallest0.3 GB
EI
Eikos 27B
Eikos · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
KI
Kimi Linear 48B A3B Base
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
CA
Carrot-Ko-2B-Instruct
Carrot · mradermacher
Params2.34B
Context32K
Q4_K_M1.5 GB
PH
Phi 4 14B
Phi · EasierAI
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi-4-mini-reasoning
Phi · Mungert
Params3.84B
Context128K
Q4_K_M2.5 GB
PA
MS3.2 PaintedFantasy v4.1 24B Ultra Uncensored Heretic v2
Paintedfantasy · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GL
GLM 5.3 Flash
GLM · Yyyssd
Params321B
Context1024K
Smallest93.1 GB
DE
DeepCoder 14B Preview
Deepcoder · Joumdane
Params14.8B
Context128K
Q4_K_M9.0 GB
YA
yaoi v1 instruct
Yaoi · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
OR
Ornith-1.5-35B
Ornith · LuffyTheFox
Params35.5B
Context256K
Smallest26.5 GB
OP
Openhands Lm 32b v0.1
Openhands · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
GL
GLM 4.7 Flash Grande Heretic UNCENSORED 42B A3B
GLM · DavidAU
Params42B
Context198K
Q4_K_M25.8 GB
AL
Alpha Ophiuchi mini 128k v0.1
Alpha · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
NE
ServiceNow AI Apriel Nemotron 15b Thinker Chatml
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
GL
GLM 5.3 Flash
GLM · Petyx123
Params321B
Context1024K
Smallest93.1 GB
OR
Ornith 1.5 35B A3B MXFP4 MOE Hybrid Imatrix
Ornith · jashepp
Params34.7B
Context—
Smallest0.2 GB
PH
Phi 3.5 Mini Instruct
Phi · legraphista
Params3.82B
Context128K
Smallest0.8 GB
DE
Husky v1 Math Deepseekmath 7b Instruct
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
KO
Koto Small 7B IT
Koto · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen2.5 32B AGI
Qwen · BasedAGI
Params32.8B
Context32K
Q4_K_M19.9 GB