GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
HO
Honey Yuzu 13B
Honey · backyardai
Params12.5B
Context8K
Q4_K_M7.5 GB
Roleplay
ME
TroyDoesAI/Mermaid-Solar
Mermaid · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
Dionysus Mistral M3 v5
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HA
Half NSFW Noromaid 7b
Half · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
OG
OGSQL 7B
Ogsql · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
BL
Blitz v0.2 i1
Blitz · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SI
Sina Loki 7b Merge
Sina · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
UN
underdog bark 3.0 pro
Underdog · scholzmx
Params627M
Context—
Smallest0.4 GB
GGUF
QW
Amaru VL 3B
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
ST
stt en fastconformer ctc xxlarge
Stt · cstr
Params1.06B
Context—
Smallest0.7 GB
GGUF
PO
pocket tts q8
Pocket · inklight-app
Params100M
Context—
Smallest0.1 GB
GGUF
PI
piccolo 8x7b
Piccolo · macadeliccc
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
QW
Privoid Bangla Translate Qwen3.5 2B
Qwen · Privoid-ai
Params1.94B
Context256K
Smallest2.1 GB
CodingReasoningTool use
QW
FlyBrain Pollard VL CNSv1
Qwen · PollardWeights
Params1.54B
Context32K
Smallest0.8 GB
Vision
QW
One Shot CFT Logic Qwen 7B CausalUnderstanding
Qwen · mradermacher
Params7.62B
Context8K
Q4_K_M4.7 GB
GGUF
EV
EVO SOLAR 10.7B v0.1
Evo · RichardErkhov
Params10.3B
Context4K
Q4_K_M6.2 GB
GGUF
PH
WasamiKirua Samantha2.0 Phi 3.5 mini ITA
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
ME
MermaidMixtral 3x7b
Mermaidmixtral · mradermacher
Params18.5B
Context32K
Q4_K_M11.2 GB
GGUF
RI
Rio_2_14B
Rio · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
QW
Amaru VL 3B
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
PA
.parakeet-ctc-1.1b.q8_0.gguf
Parakeet · CollectionStudio
Params1.07B
Context—
Smallest1.2 GB
GGUF
IS
Ishigaki AEC 9B
Ishigaki · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
QW
Qwen2.5 7B Instruct_Johnny_Silverhand_Merged
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
ME
Meiya 13B
Meiya · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
PA
Parakeet RNN-T 1.1B
Parakeet · myflow-ai
Params1.07B
Context—
Smallest0.9 GB
GGUF
ER
Erosumika 7B v2 GGUF IQ Imatrix
Erosumika · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
TI
TigerLLM 9B It
Tigerllm · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
PI
Klang Pianissimo (Danish)
Pianissimo · KlangAI
Params627M
Context—
Q4_K_M0.5 GB
GGUF
DR
DRA GRPO
Dra · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
OP
Openchat 3.5 1210
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF

Keep browsing