GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
AL
AlphaMist7B Slr v4 Slow
Alphamist · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LE
Chewy Lemon Cookie 11B
Lemonaderp · QuantFactory
Params10.7B
Context8K
Q4_K_M6.5 GB
Roleplay
MI
mistral_28B
Mistral · mradermacher
Params28.2B
Context32K
Q4_K_M16.9 GB
GGUF
SI
Silicon-Maid-7B
Silicon · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
NE
OpenMath Nemotron 14B Kaggle
Nemotron · DevQuasar-13
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
PA
parakeet tdt 0.6b v3
Parakeet · scholzmx
Params627M
Context—
Q4_K_M0.6 GB
GGUF
LL
juungwon/Llama-3-instruction-constructionsafety
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IS
Ishigaki AEC 9B
Ishigaki · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
GGUF
NE
OpenReasoning Nemotron 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoning
TI
TildeOpen 30b
Tildeopen · mradermacher
Params30.7B
Context64K
Q4_K_M18.5 GB
GGUF
MI
MineMA 8B v4 Heretic
Minema · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SC
C2S Scale Pythia 1b Pt
Scale · mradermacher
Params1.01B
Context8K
Q4_K_M0.7 GB
GGUF
SO
DT EQ SOLAR 10.7B v0.1
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
PA
Parakeet Ultra
Parakeet · Serveurperso
Params627M
Context—
Q4_K_M0.4 GB
GGUF
QW
OpenReasoning-Nemotron-14B
Qwen · Mungert
Params14.8B
Context128K
Q4_K_M9.2 GB
CodingReasoning
AF
AfriqueQwen3.5 4B
Afriqueqwen · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool useVision
CU
Cucumber 7b 10k
Cucumber · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TR
Tropicals T1
Tropicals · mradermacher
Params102M
Context512
Q4_K_M0.1 GB
Embedding
AL
Alphacode-MALI-11B
Alphacode · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
UN
Underdog Bark 3.0
Underdog · joshthomasdev
Params627M
Context—
Smallest0.7 GB
GGUF
CO
Codeqwen3 14b
Codeqwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
CodingReasoningTool use
DA
danskgpt v4 12b
Danskgpt · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
OP
Openchat 3.5 1210
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
QW
OpenReasoning-Nemotron-32B
Qwen · Mungert
Params32.8B
Context128K
Q4_K_M20.1 GB
CodingReasoning
NE
OpenReasoning Nemotron 7B
Nemotron · gabriellarson
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoning
NE
OpenReasoning Nemotron 32B
Nemotron · gabriellarson
Params32.8B
Context128K
Q4_K_M19.9 GB
CodingReasoning
QW
Qwen2.5 3B blog key points
Qwen · ncls-p
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
SO
DT EQ SOLAR 10.7B v0.1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SM
smol bruin 7b i1
Smol · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 8B Medical Reasoning
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use

Keep browsing