GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3.5 mini ITA
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
LL
LlamaForecaster 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
EM
Emollama 7b i1
Emollama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
SenecaLLM x Llama3.1 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
PO
polka 1.1b chat
Polka · mradermacher
Params1.15B
Context4K
Q4_K_M0.7 GB
GGUF
RU
ruGPT-3.5-13B
Rugpt · oblivious
Params13.1B
Context2K
Q4_K_M8.4 GB
GGUF
ZE
Zephyr 7b Beta
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3.5 2B Ideal TSUNDERE Loli Girl Japanese v1
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
DE
nova deepseek r1 abliterated 7b qwen distill
DeepSeek · VelvetVibe
Params7.6B
Context128K
Q4_K_M4.7 GB
Reasoning
SP
speecht5 tts
Speecht · cstr
Params157M
Context—
Smallest0.3 GB
GGUF
EI
Eikos 27B
Eikos · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
KI
Kimi Linear 48B A3B Base
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
Tool use
CA
Carrot-Ko-2B-Instruct
Carrot · mradermacher
Params2.34B
Context32K
Q4_K_M1.5 GB
GGUF
PH
Phi 4 14B
Phi · EasierAI
Params14.7B
Context16K
Q4_K_M8.9 GB
Coding
PH
Phi-4-mini-reasoning
Phi · Mungert
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoning
PA
MS3.2 PaintedFantasy v4.1 24B Ultra Uncensored Heretic v2
Paintedfantasy · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingRoleplay
GL
GLM 5.3 Flash
GLM · Yyyssd
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
DE
DeepCoder 14B Preview
Deepcoder · Joumdane
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
YA
yaoi v1 instruct
Yaoi · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
OR
Ornith-1.5-35B
Ornith · LuffyTheFox
Params35.5B
Context256K
Smallest26.5 GB
Tool useVision
OP
Openhands Lm 32b v0.1
Openhands · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
GL
GLM 4.7 Flash Grande Heretic UNCENSORED 42B A3B
GLM · DavidAU
Params42B
Context198K
Q4_K_M25.8 GB
ReasoningRoleplay
AL
Alpha Ophiuchi mini 128k v0.1
Alpha · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
NE
ServiceNow AI Apriel Nemotron 15b Thinker Chatml
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
Reasoning
GL
GLM 5.3 Flash
GLM · Petyx123
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
OR
Ornith 1.5 35B A3B MXFP4 MOE Hybrid Imatrix
Ornith · jashepp
Params34.7B
Context—
Smallest0.2 GB
Tool use
PH
Phi 3.5 Mini Instruct
Phi · legraphista
Params3.82B
Context128K
Smallest0.8 GB
Coding
DE
Husky v1 Math Deepseekmath 7b Instruct
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
KO
Koto Small 7B IT
Koto · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
RoleplayTool use
QW
Qwen2.5 32B AGI
Qwen · BasedAGI
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF

Keep browsing