GGUF models: cc-by-sa-4.0 license
501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.
AE
L3-Aethora-15B-V2
Aethora · mradermacher
Params15B
Context8K
Q4_K_M9.1 GB
AI
Airoboros 3b 3p0
Airoboros · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
RE
ReMask 3B
Remask · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
JI
Hf Jinen v2 Xsmall
Jinen · togatogah
Params36M
Context1K
Q4_K_M0.0 GB
OU
OuteTTS 0.3 500M
Outetts · BricksDisplay
Params85M
Context—
Q4_K_M0.1 GB
ZE
zenz v3.1 small mixed input
Zenz · motchii709
Params91M
Context1K
Smallest0.1 GB
FL
Flora 7B i1
Flora · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OR
Orukeet
Orukeet · handy-computer
Params627M
Context—
Q4_K_M0.5 GB
AE
L3-Aethora-15B-V2
Aethora · mradermacher
Params15B
Context8K
Q4_K_M9.1 GB
KV
KviGPT 7b Chat i1
Kvigpt · mradermacher
Params3.02B
Context4K
Q4_K_M1.8 GB
VD
VDC Agent 7B
Vdc · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
BL
Blake XTM Arc
Blake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
maywell_pivot-10.7b-mistral-v0.2
Mistral · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
SE
Sequential_Helium_6B
Sequential · mradermacher
Params6.3B
Context4K
Q4_K_M3.8 GB
LL
Luna AI Llama2 Uncensored
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
SP
Spaetzle v12 7b i1
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
TroyDoesAI Phi 3 Context Obedient RAG
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
HE
Helium 1 2b Pop
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
FL
Flora DPO 7B i1
Flora · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LI
LightOnOCR 3 1B Historic German Handwriting
Lightonocr · b-straub
Params596M
Context16K
Smallest0.6 GB
QW
AutoRefine Qwen2.5 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ZE
zenz v3.1 small
Zenz · Miwa-Keita
Params95M
Context1K
Smallest0.1 GB
DE
natural sql 7b
DeepSeek · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
PH
Phi 3 Context Obedient RAG i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
QW
syrian_qwen_3.5_4B
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
NA
natural sql 7b i1
Natural · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
OU
OuteTTS 0.3 500M
Outetts · OuteAI
Params499M
Context32K
Q4_K_M0.4 GB
AS
Astridboros-3B
Astridboros · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
OR
orukeet
Orukeet · cstr
Params627M
Context—
Smallest0.4 GB
AS
Astrorocketboros-3B
Astrorocketboros · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB