GGUF models: cc-by-4.0 license
1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.
MI
Dionysus Mistral M3 v5
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
qwen2 0.5b numina math instruct
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
PO
pocket tts en mix precision
Pocket · Arm
Params76M
Context1K
Smallest0.3 GB
IS
Ishigaki IDS 8B
Ishigaki · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
story_generation_Qwen3_8B_RL
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GI
GIANTS 4B
Giants · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
NE
OpenMath Nemotron 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
OpenMath-Nemotron-32B
Qwen · Mungert
Params32.8B
Context128K
Q4_K_M20.1 GB
NE
OpenReasoning Nemotron 1.5B
Nemotron · DevQuasar
Params1.54B
Context128K
Q4_K_M1.0 GB
EV
EVO SOLAR 10.7B v0.1
Evo · mradermacher
Params10.3B
Context4K
Q4_K_M6.2 GB
AI
aixsatoshi calm2 7b chat 7b moe
Aixsatoshi · mmnga
Params11.3B
Context32K
Q4_K_M6.9 GB
LL
Mermaid-Llama-3-5B-Pruned
Llama · afrideva
Params5.41B
Context8K
Q4_K_M3.4 GB
GE
gemma 4 E2B vietnam personas
Gemma · LeNgocTu
Params4.65B
Context128K
Q4_K_M3.4 GB
PI
piccolo 8x7b
Piccolo · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
MineMA 8B v4 Heretic
Minema · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
ED
Eduardo 27b
Eduardo · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
CH
MN Chunky Lotus 12B
Chunky · backyardai
Params12.2B
Context128K
Q4_K_M7.5 GB
EV
Everyone Coder 4x7b Base
Everyone · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
LL
Llama 3 Instruction Constructionsafety
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
KO
Komt Solar 10.7b Sft v3
Komt · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
AF
AfriqueGemma 4B
Afriquegemma · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
AF
AfriqueQwen3.5 4B 50Langs Instruct v1
Afriqueqwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
MI
Mistral Astronomy 7b v0.1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 8B Omnibus 1 PL v01 INSTRUCT i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
qwen3 4b dotnet specialist
Qwen · rodrigoramosrs
Params4.02B
Context256K
Q4_K_M2.5 GB
AL
Alphacode MALI 9B i1
Alphacode · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB
SP
Spivavtor Large
Spivavtor · mradermacher
Params1.23B
Context512
Q4_K_M0.8 GB
NE
OpenMath Nemotron 1.5B
Nemotron · DevQuasar-13
Params1.54B
Context128K
Q4_K_M1.0 GB
QW
One Shot CFT Math Qwen 7B
Qwen · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
GE
C2S Scale Gemma 2 27B
Gemma · MarselM
Params27.2B
Context8K
Q4_K_M16.6 GB