GGUF models: cc-by-sa-4.0 license

501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
AE
L3-Aethora-15B-V2
Aethora · mradermacher
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
AI
Airoboros 3b 3p0
Airoboros · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
RE
ReMask 3B
Remask · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
JI
Hf Jinen v2 Xsmall
Jinen · togatogah
Params36M
Context1K
Q4_K_M0.0 GB
GGUF
OU
OuteTTS 0.3 500M
Outetts · BricksDisplay
Params85M
Context—
Q4_K_M0.1 GB
GGUF
ZE
zenz v3.1 small mixed input
Zenz · motchii709
Params91M
Context1K
Smallest0.1 GB
GGUF
FL
Flora 7B i1
Flora · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OR
Orukeet
Orukeet · handy-computer
Params627M
Context—
Q4_K_M0.5 GB
GGUF
AE
L3-Aethora-15B-V2
Aethora · mradermacher
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
KV
KviGPT 7b Chat i1
Kvigpt · mradermacher
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
VD
VDC Agent 7B
Vdc · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
BL
Blake XTM Arc
Blake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ReasoningTool use
MI
maywell_pivot-10.7b-mistral-v0.2
Mistral · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
SE
Sequential_Helium_6B
Sequential · mradermacher
Params6.3B
Context4K
Q4_K_M3.8 GB
GGUF
LL
Luna AI Llama2 Uncensored
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
SP
Spaetzle v12 7b i1
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
TroyDoesAI Phi 3 Context Obedient RAG
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
HE
Helium 1 2b Pop
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
GGUF
FL
Flora DPO 7B i1
Flora · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LI
LightOnOCR 3 1B Historic German Handwriting
Lightonocr · b-straub
Params596M
Context16K
Smallest0.6 GB
Vision
QW
AutoRefine Qwen2.5 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
ZE
zenz v3.1 small
Zenz · Miwa-Keita
Params95M
Context1K
Smallest0.1 GB
GGUF
DE
natural sql 7b
DeepSeek · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
PH
Phi 3 Context Obedient RAG i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
QW
syrian_qwen_3.5_4B
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
NA
natural sql 7b i1
Natural · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
OU
OuteTTS 0.3 500M
Outetts · OuteAI
Params499M
Context32K
Q4_K_M0.4 GB
GGUF
AS
Astridboros-3B
Astridboros · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
OR
orukeet
Orukeet · cstr
Params627M
Context—
Smallest0.4 GB
GGUF
AS
Astrorocketboros-3B
Astrorocketboros · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF

Keep browsing