GGUF models: cc-by-4.0 license
1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.
GE
GemmaECG Vision
Gemma · yasserrmd
Params4.46B
Context32K
Q4_K_M2.8 GB
NE
OpenMath Nemotron 32B
Nemotron · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.9 GB
SM
smol bruin 7b
Smol · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
MermaidMistral
Mermaidmistraldpo · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
TableLLM DeepseekCoder 7B
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
HA
hammer2.0 7b
Hammer · neopolita
Params7.61B
Context32K
Q4_K_M4.7 GB
AL
Alphacode-AI/AlphaMist7B-slr-v4-slow2
Alphamist · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
Mermaid PythonCoder
Mermaid · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
PH
Stoicism1 Phi3.5 mini instruct i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
EU
euclaise Memphis scribe 3B alpha
Euclaise · RichardErkhov
Params2.8B
Context4K
Q4_K_M1.7 GB
HA
Haruhi Zero 7B 0_3
Haruhi · mradermacher
Params7.72B
Context32K
Q4_K_M4.9 GB
CH
MN Chunky Lotus 12B
Chunky · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GP
Codegpt Oss 20b
gpt-oss · anon-researcher-ua
Params20.9B
Context128K
Q4_K_M15.8 GB
QW
Qwen2.5 1.5B ArtCode
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
KM
kmynas pipiras
Kmynas · DeimantasLT
Params637M
Context—
Smallest0.7 GB
LL
.\Mermaid\
Llama · mradermacher
Params5.41B
Context8K
Q4_K_M3.4 GB
GE
Gemma 7b
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
NE
OpenReasoning Nemotron 1.5B
Nemotron · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
NE
OpenReasoning Nemotron 32B
Nemotron · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
PI
pianissimo sv
Pianissimo · KlangAI
Params627M
Context—
Q4_K_M0.5 GB
AF
AfriqueQwen3.5 4B 50Langs Instruct 20260917
Afriqueqwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
SO
Sonya 7B GGUF IQ Imatrix
Sonya · Lewdiculous
Params7.24B
Context8K
Q4_K_M4.4 GB
BI
SikuRoBERTa_Bronze
Bird · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
AF
AfriqueQwen3.5 0.8B 50Langs
Afriqueqwen · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
GE
D:\Gemma_audio\models\indicconformer_patched.nemo
Gemma · Singla0009
Params129M
Context—
Smallest0.2 GB
GE
Gemma 2b
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
OC
Occam 2B CCoT
Occam · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
CH
FallenMerick/Chunky-Lemon-Cookie-11B
Chunky · featherless-ai-quants
Params10.7B
Context32K
Q4_K_M6.5 GB
MO
Mobile ReasoningLLM v0
Mobile · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
BI
BioMistral v0.2
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB