GGUF models: cc-by-4.0 license
1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.
VE
Neona Dan Slerp
Velvetcafe · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
NE
OpenMath Nemotron 32B
Nemotron · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
NE
OpenReasoning Nemotron 7B
Nemotron · DevQuasar
Params7.62B
Context128K
Q4_K_M4.7 GB
TI
Tiny Lm 8M
Tiny · mradermacher
Params8M
Context256
Q4_K_M0.0 GB
AF
AfriqueQwen3.5 4B 50Langs Instruct v1
Afriqueqwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
NE
Fast OpenMath Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
MO
Mocha Sample 7b ex
Mocha · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Herry443/Mistral-7B-KNUT-ref-en
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
CP
CPPO 7B
Cppo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
OP
Openchat 3.5 1210
Openchat · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
TI
TigerCoder 1B
Tigercoder · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
OP
Openchat 3.5 1210
Openchat · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
NE
OpenMath Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
OpenMath Nemotron 14B Kaggle
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CA
canary 1b v2 loom
Canary · loom-ai-org
Params973M
Context—
Smallest3.9 GB
GI
GIANTS 4B
Giants · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
QW
One Shot CFT Math Qwen 1.5B
Qwen · mradermacher
Params1.54B
Context4K
Q4_K_M1.0 GB
CO
L3.2 8x3B Codexus v1
Codexus · mradermacher
Params18B
Context128K
Q4_K_M11.1 GB
GE
Gemma 2b
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
RA
RAIF DeepScaleR 1.5B
Raif · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
OpenReasoning-Nemotron-7B
Qwen · Mungert
Params7.62B
Context128K
Q4_K_M4.8 GB
SQ
Sqlcoder 34b
Sqlcoder · DevQuasar-13
Params33.7B
Context16K
Q4_K_M20.2 GB
PY
C2S Pythia 410m Diverse Single And Multi Cell Tasks
Pythia · mradermacher
Params405M
Context8K
Q4_K_M0.3 GB
MI
mistral 28B instruct v0.2
Mistral · mradermacher
Params28.2B
Context32K
Q4_K_M17.1 GB
NE
OpenReasoning Nemotron 32B
Nemotron · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.9 GB
CP
CPPO 7B
Cppo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
OM
OmniUI 3B
Omniui · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
QW
OpenMath-Nemotron-1.5B
Qwen · Mungert
Params1.54B
Context128K
Q4_K_M1.0 GB
NE
OpenReasoning Nemotron 1.5B
Nemotron · lmstudio-community
Params1.54B
Context128K
Q4_K_M1.0 GB
ME
.\Mermaid\
Mermaid · mradermacher
Params12B
Context4K
Q4_K_M7.2 GB