GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
LL
Llama-3-Refueled
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
L3-8B-Stheno-v3.3-32K
Stheno · mradermacher
Params8B
Context32K
Q4_K_M4.9 GB
NE
NeuralMarcoro14 7B i1
Neuralmarcoro · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
meerkat 7b v1.0
Meerkat · mradermacher
Params7.24B
Context32K
Q4_K_M4.8 GB
PI
piano-medley-7b
Piano · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
sao10k_sensualize-mixtral-bf16
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
XW
Xwin MLewd 13B v0.2
Xwin · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
EL
eleusis 7b alpha
Eleusis · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
DR
dragonwar 7b orpo
Dragonwar · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
BI
Bielik 7B Instruct v0.1
Bielik · QuantFactory
Params7.24B
Context4K
Q4_K_M4.4 GB
MI
Noromaid v0.4 Mixtral Instruct 8x7b Zloss i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.9 GB
AY
Aya Expanse 8b
Aya · matrixportalx
Params8B
Context8K
Q4_K_M5.1 GB
AY
Aya Expanse 32b Ungated
Aya · RichardErkhov
Params32.3B
Context8K
Q4_K_M19.8 GB
TO
TowerInstruct 7B v0.2
Towerinstruct · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 3 ChocoLlama 8B instruct i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
FL
Flammen Kunoichi 7B
Flammen · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
CO
c4ai-command-r-v01
Command R · qwp4w3hyb
Params35B
Context128K
Q4_K_M21.5 GB
HE
Hemmingway 1 VL
Hemmingway · darrellbest
Params27.3B
Context256K
Q4_K_M16.8 GB
MI
voxtral 4b tts
Mistral · cstr
Params4B
Context—
Smallest2.4 GB
LL
llama-3-Nephilim-v3-8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
SO
SOLAR 10.7B Instruct v1.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
EC
Echidna 13B v0.3
Echidna · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
WI
Winterreise-m7
Winterreise · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
AlphaMonarch laser i1
Alphamonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
NeuralDaredevil 7B
Neuraldaredevil · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
CatNyanster 34b
Catnyanster · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
IA
Iambe Storyteller 20B
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
MA
NeuralMarcoro14 7B
Marcoro · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
K2S3 Mistral 7b v1.48
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
NI
L3-8B-Niitama-v1
Niitama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB