GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
VE
MN VelvetCafe RP 12B V2
Velvetcafe · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
BI
Big-Lemon-Cookie-11B
Big · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay
VE
Neona Dan Slerp
Velvetcafe · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
NE
OpenMath Nemotron 14B
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
GE
GEITje 7b Ultra Heretic
Geitje · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
Medusa0.1Line 9B
Medusa · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
OU
OuteTTS 0.1 350M Hf
Outetts · OuteAI
Params362M
Context4K
Q4_K_M0.3 GB
GGUF
QW
HumanBrain Pollard H01
Qwen · PollardWeights
Params494M
Context32K
Smallest0.3 GB
Tool use
MA
Manaca 1b Base
Manaca · mradermacher
Params1.72B
Context4K
Q4_K_M1.1 GB
GGUF
CR
MN Crimson Cafe 12B
Crimson · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
AF
AfriqueQwen 8B
Afriqueqwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use
PA
parakeet redux
Parakeet · cstr
Params627M
Context—
Smallest0.4 GB
GGUF
PA
parakeet-tdt_ctc-0.6b-ja
Parakeet · sakasegawa
Params619M
Context—
Smallest0.4 GB
GGUF
CH
Chewy-Lemon-Cookie-11B
Chewy · backyardai
Params10.7B
Context8K
Q4_K_M6.5 GB
Roleplay
TI
TigerCoder 12B
Tigercoder · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
CodingVision
LE
LemonadeRP-4.5.3
Lemonaderp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
CH
Chunky-Lemon-Cookie-11B
Chunky · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay
XD
xDAN-L1-Chat-RL-v1
Xdan · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Reasoning
TI
TigerLLM 12B It
Tigerllm · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
WE
wespeaker resnet34 lm
Wespeaker · cstr
Params7M
Context—
Smallest0.0 GB
GGUF
ME
Mega Destroyer 8x7B
Mega · Artefact2
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
HA
Haruhi Zero 7B 0_3
Haruhi · mradermacher
Params7.72B
Context32K
Q4_K_M4.9 GB
GGUF
AF
AfriqueQwen 14B
Afriqueqwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
ST
stt fr fastconformer hybrid ctc large
Stt · cstr
Params109M
Context—
Smallest0.1 GB
GGUF
LL
VersatiLlama Llama 3.2 3B Instruct Abliterated
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
VI
MN Chunky Lotus 12B
Violet · QuantFactory
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
LL
LLMBG Llama 3.1 8B BG Reasoning v0.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
CO
L3.2 8x3B Codexus v1
Codexus · mradermacher
Params18B
Context128K
Q4_K_M11.1 GB
Tool use
EV
Everyone Coder 4x7b Base
Everyone · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
Coding
QW
One Shot CFT Math Qwen 7B
Qwen · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
Tool use

Keep browsing