GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
VE
Neona Dan Slerp
Velvetcafe · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
NE
OpenMath Nemotron 32B
Nemotron · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
NE
OpenReasoning Nemotron 7B
Nemotron · DevQuasar
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
TI
Tiny Lm 8M
Tiny · mradermacher
Params8M
Context256
Q4_K_M0.0 GB
GGUF
AF
AfriqueQwen3.5 4B 50Langs Instruct v1
Afriqueqwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
NE
Fast OpenMath Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
MO
Mocha Sample 7b ex
Mocha · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Herry443/Mistral-7B-KNUT-ref-en
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CP
CPPO 7B
Cppo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
OP
Openchat 3.5 1210
Openchat · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
TI
TigerCoder 1B
Tigercoder · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
Coding
OP
Openchat 3.5 1210
Openchat · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
NE
OpenMath Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
NE
OpenMath Nemotron 14B Kaggle
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
CA
canary 1b v2 loom
Canary · loom-ai-org
Params973M
Context—
Smallest3.9 GB
GGUF
GI
GIANTS 4B
Giants · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
ReasoningTool use
QW
One Shot CFT Math Qwen 1.5B
Qwen · mradermacher
Params1.54B
Context4K
Q4_K_M1.0 GB
Tool use
CO
L3.2 8x3B Codexus v1
Codexus · mradermacher
Params18B
Context128K
Q4_K_M11.1 GB
Tool use
GE
Gemma 2b
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
RA
RAIF DeepScaleR 1.5B
Raif · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
QW
OpenReasoning-Nemotron-7B
Qwen · Mungert
Params7.62B
Context128K
Q4_K_M4.8 GB
CodingReasoning
SQ
Sqlcoder 34b
Sqlcoder · DevQuasar-13
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
PY
C2S Pythia 410m Diverse Single And Multi Cell Tasks
Pythia · mradermacher
Params405M
Context8K
Q4_K_M0.3 GB
GGUF
MI
mistral 28B instruct v0.2
Mistral · mradermacher
Params28.2B
Context32K
Q4_K_M17.1 GB
GGUF
NE
OpenReasoning Nemotron 32B
Nemotron · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
CP
CPPO 7B
Cppo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
OM
OmniUI 3B
Omniui · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
QW
OpenMath-Nemotron-1.5B
Qwen · Mungert
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning
NE
OpenReasoning Nemotron 1.5B
Nemotron · lmstudio-community
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning
ME
.\Mermaid\
Mermaid · mradermacher
Params12B
Context4K
Q4_K_M7.2 GB
GGUF

Keep browsing