GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
DA
DAVinCI Yi Ko 6B v0.8
Davinci · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
SO
SOLAR 10.7B Merge Dpo_V1
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
HA
Hammer2.1 1.5b
Hammer · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
RO
RoMistral-7b-Instruct
Romistral · legraphista
Params7.24B
Context32K
Q4_K_M4.4 GB
UN
UndiMix v4 13B i1
Undimix · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
AI
airoboros 33b gpt4 m2.0 i1
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
MI
MiquMaid v2 70B
Miqumaid · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
CO
C4Ai Command R Plus 08 2024
Command R · lmstudio-community
Params104B
Context128K
Q4_K_M62.8 GB
AI
Airoboros 13b Gpt4 1.4
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
PR
proxy lite 3b i1
Proxy · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
LU
Lumimaid v0.2 12B i1
Lumimaid · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
TI
CohereLabs.tiny Aya Global
Tiny · DevQuasar
Params3.35B
Context488K
Q4_K_M2.1 GB
GE
GEITje 7B ultra i1
Geitje · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LO
Loyal Macaroni Maid 7B i1
Loyal · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
OC
octopus planning i1
Octopus · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GE
Gemmasutra Pro 27B V1F
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
CR
Creative Writer 35b Preview 01 2025
Creative · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
DA
DataVortexS 10.7B Dpo v1.10
Datavortexs · mradermacher
Params10.9B
Context2K
Q4_K_M6.5 GB
CL
CleverMommy mix 20b
Clevermommy · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
CA
CATA-LimaRP-Zloss-DT-TaskArithmetic-8x7B
Cata · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
TE
Teuken 7B Base v0.6
Teuken · shahzeb171
Params8.48B
Context4K
Smallest3.8 GB
AC
AceInstruct 1.5B
Aceinstruct · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
NE
Neeto 1.0 8b
Neeto · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
IA
Iambe RP DARE 20b DENSE i1
Iambe · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
AL
AlphaMonarch 7B
Alphamonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
cloudyu Mixtral 7Bx2 MoE 13B
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
ML
MLewd L2 13B i1
Mlewd · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LY
MN 12B Lyra v3
Lyra · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
INFIndo Qwen3 32B Preview
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
LL
LDCC Instruct Llama 2 Ko 13B v4.1.8
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB