GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
LL
Meta Llama 3 8b Instruct Hf
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
KU
Kunoichi DPO v2 7B
Kunoichi · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
ST
L3 8B Stheno v3.3 32K
Stheno · RichardErkhov
Params8.03B
Context32K
Q4_K_M4.9 GB
NE
NeuralPearlBeagle
Neuralpearlbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
TH
L3.1 TheGreenLion 8b SFT v0.1.2 i1
Thegreenlion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
AL
AlphaMonarch laser
Alphamonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
L3-8B-Stheno-v3.2
Stheno · linuu1
Params8.03B
Context8K
Q4_K_M4.9 GB
CR
Creative Writer v0.2 Delta 35b
Creative · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
OP
OpenHermes 2.5 Nebula v2 7B
Openhermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AY
Aya Expanse 8b Orthogonal Heretic
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
SK
SkunkApe 16b i1
Skunkape · mradermacher
Params16B
Context4K
Q4_K_M9.6 GB
SA
saishf Aura Uncensored OAS 8B L3
Saishf · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
IC
IceAbsintheRP 7b i1
Iceabsintherp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenMia Indo Mistral 7b v3
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
QW
Qwen1.5 7B Dutch Chat
Qwen · mradermacher
Params7.72B
Context32K
Q4_K_M4.8 GB
LL
Llama 3 8B EGO iMat
Llama · Quant-Cartel
Params8.03B
Context8K
Q4_K_M4.9 GB
SO
SOLAR 10.7B v1.5
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
MI
MiniusLight 24B v2
Miniuslight · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mistral 7B Merge 14 v0.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
command r
Command R · cortexso
Params32.3B
Context128K
Q4_K_M19.8 GB
DA
DAVinCI Yi Ko 6B v0.61 Ff E1
Davinci · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
IC
Ice0.15 02.10 RP
Icewhiskeyrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
IceCoffeeRP 7b i1
Icecoffeerp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
KA
Kallamni 2.6b v1
Kallamni · mradermacher
Params2.57B
Context125K
Q4_K_M1.6 GB
IC
IceMoonshineRP 7b
Icemoonshinerp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DA
Daredevil 7B
Daredevil · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
TH
TheDrummer Smegmma Deluxe 9B v1
Thedrummer · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
BY
ByteGPT r1
Bytegpt · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
AI
airoboros 33b 2.1 i1
Airoboros · mradermacher
Params32.5B
Context4K
Q4_K_M19.6 GB