GGUF models: cc-by-4.0 license
1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.
HO
Honey Yuzu 13B
Honey · backyardai
Params12.5B
Context8K
Q4_K_M7.5 GB
ME
TroyDoesAI/Mermaid-Solar
Mermaid · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
Dionysus Mistral M3 v5
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HA
Half NSFW Noromaid 7b
Half · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
OG
OGSQL 7B
Ogsql · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
BL
Blitz v0.2 i1
Blitz · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SI
Sina Loki 7b Merge
Sina · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
UN
underdog bark 3.0 pro
Underdog · scholzmx
Params627M
Context—
Smallest0.4 GB
QW
Amaru VL 3B
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
ST
stt en fastconformer ctc xxlarge
Stt · cstr
Params1.06B
Context—
Smallest0.7 GB
PO
pocket tts q8
Pocket · inklight-app
Params100M
Context—
Smallest0.1 GB
PI
piccolo 8x7b
Piccolo · macadeliccc
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
Privoid Bangla Translate Qwen3.5 2B
Qwen · Privoid-ai
Params1.94B
Context256K
Smallest2.1 GB
QW
FlyBrain Pollard VL CNSv1
Qwen · PollardWeights
Params1.54B
Context32K
Smallest0.8 GB
QW
One Shot CFT Logic Qwen 7B CausalUnderstanding
Qwen · mradermacher
Params7.62B
Context8K
Q4_K_M4.7 GB
EV
EVO SOLAR 10.7B v0.1
Evo · RichardErkhov
Params10.3B
Context4K
Q4_K_M6.2 GB
PH
WasamiKirua Samantha2.0 Phi 3.5 mini ITA
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
ME
MermaidMixtral 3x7b
Mermaidmixtral · mradermacher
Params18.5B
Context32K
Q4_K_M11.2 GB
RI
Rio_2_14B
Rio · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Amaru VL 3B
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
PA
.parakeet-ctc-1.1b.q8_0.gguf
Parakeet · CollectionStudio
Params1.07B
Context—
Smallest1.2 GB
IS
Ishigaki AEC 9B
Ishigaki · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Qwen2.5 7B Instruct_Johnny_Silverhand_Merged
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ME
Meiya 13B
Meiya · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
PA
Parakeet RNN-T 1.1B
Parakeet · myflow-ai
Params1.07B
Context—
Smallest0.9 GB
ER
Erosumika 7B v2 GGUF IQ Imatrix
Erosumika · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
TigerLLM 9B It
Tigerllm · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
PI
Klang Pianissimo (Danish)
Pianissimo · KlangAI
Params627M
Context—
Q4_K_M0.5 GB
DR
DRA GRPO
Dra · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
OP
Openchat 3.5 1210
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB