GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Doktor-Llama-3-8b
Llama · mradermacher
Params6.84B
Context4K
Q4_K_M4.2 GB
GGUF
CH
Chunky-Lemon-Cookie-11B
Chunky · backyardai
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay
GE
C2S-Scale-Gemma-2-27B
Gemma · Mungert
Params27.2B
Context8K
Q4_K_M16.7 GB
GGUF
SU
Susanoo 10.7B
Susanoo · mradermacher
Params10.7B
Context32K
Q4_K_M6.6 GB
Roleplay
NE
OpenReasoning Nemotron 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
AF
AfriqueQwen3.5 9B 50Langs
Afriqueqwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
NE
OpenMath Nemotron 14B Kaggle
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
SP
TitaNet-Large
Speakerverification · cstr
Params22M
Context—
Smallest0.0 GB
GGUF
VI
MN Violet Lotus 12B
Violet · backyardai
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
TA
tabcnn
Tabcnn · cstr
Params—
Context—
Smallest0.0 GB
GGUF
MO
Mocha Dare 7b ex
Mocha · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
HO
Honey Yuzu 13B
Honey · mradermacher
Params12.5B
Context8K
Q4_K_M7.5 GB
Roleplay
PA
parakeet ultra
Parakeet · cstr
Params627M
Context—
Smallest0.4 GB
GGUF
QW
story_generation_Qwen3_8B_RL
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningRoleplayTool use
LL
Doktor-Llama-8b
Llama · mradermacher
Params6.84B
Context4K
Q4_K_M4.2 GB
GGUF
PA
Parakeet TDT 0.6B v3
Parakeet · vibe-app
Params627M
Context—
Q4_K_M0.5 GB
GGUF
ST
Kyutai-STT
Stt · cstr
Params1.05B
Context—
Smallest0.7 GB
GGUF
MO
Moko DARE
Moko · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
PO
pocket tts
Pocket · EryriLabs
Params80M
Context4K
Smallest0.2 GB
Vision
XD
xDAN-L1-Chat-RL-v1
Xdan · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Reasoning
NE
OpenReasoning Nemotron 32B
Nemotron · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
PA
parakeet tdt ctc 1.1b
Parakeet · cstr
Params1.07B
Context—
Smallest0.7 GB
GGUF
ME
MermaidMixtral 2x7b
Mermaidmixtral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
FO
FoxEngineAi Mega Destroyer 8x7B
Foxengineai · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Typhon Mixtral v1 iMat
Mistral · InferenceIllusionist
Params46.7B
Context32K
Smallest12.6 GB
GGUF
LL
Mermaid-Llama-6.7B-RAG-Code-Instruct
Llama · afrideva
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
VE
MN VelvetCafe RP 12B V2
Velvetcafe · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
NE
OpenReasoning Nemotron 1.5B
Nemotron · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning
ER
Erosumika 7B v3 0.2 GGUF IQ Imatrix
Erosumika · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
UN
una xaberius 34b v1beta
Una · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF

Keep browsing