GGUF models: cc-by-sa-4.0 license
501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.
AI
Airoboros 3b 3p0
Airoboros · RichardErkhov
Params2.8B
Context4K
Q4_K_M1.7 GB
TR
TRoTR paraphrase multilingual MiniLM L12 v2
Trotr · mradermacher
Params277M
Context512
Q4_K_M0.2 GB
QW
qwen3.5 2b travel en
Qwen · pockettravel
Params1.88B
Context256K
Q4_K_M1.3 GB
ZE
zenz-v3
Zenz · Miwa-Keita
Params95M
Context1K
Smallest0.1 GB
CA
Cammell Twilight v0.2 12B GGUF imatrix
Cammell · Uncanned
Params12.2B
Context1000K
Q4_K_M7.5 GB
HE
Kyutai.Helium 1 2b Life
Helium · DevQuasar
Params2.02B
Context4K
Q4_K_M1.2 GB
UN
L3.3 70B Unrestricted intelligence
Unrestricted · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
IS
IS LM 3B
mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
HE
Kyutai.Helium 1 2b Pop
Helium · DevQuasar
Params2.02B
Context4K
Q4_K_M1.2 GB
UM
IS-LM-3B
Umbrellacorp · UmbrellaCorp
Params2.8B
Context4K
Q4_K_M1.7 GB
RO
RoshidereRP 8B
Roshidererp · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
IN
Indri 0.1 124m Tts
Indri · mradermacher
Params193M
Context1K
Q4_K_M0.1 GB
QW
qwen3.5 0.8b travel en
Qwen · pockettravel
Params752M
Context256K
Q4_K_M0.5 GB
AI
AIFT Ko Orca Plat Yi Ko 6b v1.2 Dpo 2
Aift · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
HE
Kyutai.Helium 1 2b Books
Helium · DevQuasar
Params2.02B
Context4K
Q4_K_M1.2 GB
AI
Yi Ko 6B
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
PH
Phi 3 Context Obedient RAG
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
SQ
sqlcoder 7b
Sqlcoder · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
cecilia 2b v0.1
Salamandra · JorG941
Params2.25B
Context8K
Q4_K_M1.5 GB
AI
Yi Ko 6B
Aift · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
NE
nemotron nano 4b writing style 2epoch
Nemotron · StratumAnalysisGroup
Params4.51B
Context128K
Q4_K_M2.8 GB
NE
nemotron 3.5 asr streaming slovenian
Nemotron · texdata
Params638M
Context—
Smallest1.0 GB
HE
Helium 1 2b Science
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
OU
OuteTTS 0.3 500M
Outetts · mradermacher
Params499M
Context32K
Q4_K_M0.4 GB
QW
qwen3.5 4b travel it
Qwen · pockettravel
Params4.21B
Context256K
Smallest3.1 GB
DA
ResplendentAI/Datura_7B
Datura · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
IS
Islamspecialist 7B
Islamspecialist · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
defog sqlcoder 70b alpha
Defog · RichardErkhov
Params69B
Context16K
Q4_K_M41.4 GB
BA
T5 Base Japanese Question Generation
Base · mradermacher
Params223M
Context512
Q4_K_M0.1 GB
QW
qwen3.5 4b travel en
Qwen · pockettravel
Params4.21B
Context256K
Smallest3.1 GB