GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Dionysus Mistral M3 v5
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
qwen2 0.5b numina math instruct
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
PO
pocket tts en mix precision
Pocket · Arm
Params76M
Context1K
Smallest0.3 GB
GGUF
IS
Ishigaki IDS 8B
Ishigaki · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
story_generation_Qwen3_8B_RL
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningRoleplayTool use
GI
GIANTS 4B
Giants · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
ReasoningTool use
NE
OpenMath Nemotron 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
QW
OpenMath-Nemotron-32B
Qwen · Mungert
Params32.8B
Context128K
Q4_K_M20.1 GB
Reasoning
NE
OpenReasoning Nemotron 1.5B
Nemotron · DevQuasar
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning
EV
EVO SOLAR 10.7B v0.1
Evo · mradermacher
Params10.3B
Context4K
Q4_K_M6.2 GB
GGUF
AI
aixsatoshi calm2 7b chat 7b moe
Aixsatoshi · mmnga
Params11.3B
Context32K
Q4_K_M6.9 GB
GGUF
LL
Mermaid-Llama-3-5B-Pruned
Llama · afrideva
Params5.41B
Context8K
Q4_K_M3.4 GB
GGUF
GE
gemma 4 E2B vietnam personas
Gemma · LeNgocTu
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningRoleplayTool use
PI
piccolo 8x7b
Piccolo · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
MineMA 8B v4 Heretic
Minema · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ED
Eduardo 27b
Eduardo · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
CH
MN Chunky Lotus 12B
Chunky · backyardai
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
EV
Everyone Coder 4x7b Base
Everyone · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
Coding
LL
Llama 3 Instruction Constructionsafety
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
KO
Komt Solar 10.7b Sft v3
Komt · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
AF
AfriqueGemma 4B
Afriquegemma · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
Vision
AF
AfriqueQwen3.5 4B 50Langs Instruct v1
Afriqueqwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
MI
Mistral Astronomy 7b v0.1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 8B Omnibus 1 PL v01 INSTRUCT i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
qwen3 4b dotnet specialist
Qwen · rodrigoramosrs
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
AL
Alphacode MALI 9B i1
Alphacode · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
SP
Spivavtor Large
Spivavtor · mradermacher
Params1.23B
Context512
Q4_K_M0.8 GB
GGUF
NE
OpenMath Nemotron 1.5B
Nemotron · DevQuasar-13
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
QW
One Shot CFT Math Qwen 7B
Qwen · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
Tool use
GE
C2S Scale Gemma 2 27B
Gemma · MarselM
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF

Keep browsing