GGUF models: cc-by-4.0 license
1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.
LL
Doktor-Llama-3-8b
Llama · mradermacher
Params6.84B
Context4K
Q4_K_M4.2 GB
CH
Chunky-Lemon-Cookie-11B
Chunky · backyardai
Params10.7B
Context32K
Q4_K_M6.5 GB
GE
C2S-Scale-Gemma-2-27B
Gemma · Mungert
Params27.2B
Context8K
Q4_K_M16.7 GB
SU
Susanoo 10.7B
Susanoo · mradermacher
Params10.7B
Context32K
Q4_K_M6.6 GB
NE
OpenReasoning Nemotron 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
AF
AfriqueQwen3.5 9B 50Langs
Afriqueqwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
NE
OpenMath Nemotron 14B Kaggle
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
SP
TitaNet-Large
Speakerverification · cstr
Params22M
Context—
Smallest0.0 GB
VI
MN Violet Lotus 12B
Violet · backyardai
Params12.2B
Context128K
Q4_K_M7.5 GB
TA
tabcnn
Tabcnn · cstr
Params—
Context—
Smallest0.0 GB
MO
Mocha Dare 7b ex
Mocha · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
HO
Honey Yuzu 13B
Honey · mradermacher
Params12.5B
Context8K
Q4_K_M7.5 GB
PA
parakeet ultra
Parakeet · cstr
Params627M
Context—
Smallest0.4 GB
QW
story_generation_Qwen3_8B_RL
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
LL
Doktor-Llama-8b
Llama · mradermacher
Params6.84B
Context4K
Q4_K_M4.2 GB
PA
Parakeet TDT 0.6B v3
Parakeet · vibe-app
Params627M
Context—
Q4_K_M0.5 GB
ST
Kyutai-STT
Stt · cstr
Params1.05B
Context—
Smallest0.7 GB
MO
Moko DARE
Moko · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
PO
pocket tts
Pocket · EryriLabs
Params80M
Context4K
Smallest0.2 GB
XD
xDAN-L1-Chat-RL-v1
Xdan · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
OpenReasoning Nemotron 32B
Nemotron · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
PA
parakeet tdt ctc 1.1b
Parakeet · cstr
Params1.07B
Context—
Smallest0.7 GB
ME
MermaidMixtral 2x7b
Mermaidmixtral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
FO
FoxEngineAi Mega Destroyer 8x7B
Foxengineai · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Typhon Mixtral v1 iMat
Mistral · InferenceIllusionist
Params46.7B
Context32K
Smallest12.6 GB
LL
Mermaid-Llama-6.7B-RAG-Code-Instruct
Llama · afrideva
Params6.74B
Context16K
Q4_K_M4.1 GB
VE
MN VelvetCafe RP 12B V2
Velvetcafe · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
NE
OpenReasoning Nemotron 1.5B
Nemotron · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
ER
Erosumika 7B v3 0.2 GGUF IQ Imatrix
Erosumika · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
UN
una xaberius 34b v1beta
Una · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB