GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Meta Llama 3 8b Instruct Hf
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
KU
Kunoichi DPO v2 7B
Kunoichi · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ST
L3 8B Stheno v3.3 32K
Stheno · RichardErkhov
Params8.03B
Context32K
Q4_K_M4.9 GB
GGUF
NE
NeuralPearlBeagle
Neuralpearlbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TH
L3.1 TheGreenLion 8b SFT v0.1.2 i1
Thegreenlion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AL
AlphaMonarch laser
Alphamonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
ST
L3-8B-Stheno-v3.2
Stheno · linuu1
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
CR
Creative Writer v0.2 Delta 35b
Creative · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
OP
OpenHermes 2.5 Nebula v2 7B
Openhermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
AY
Aya Expanse 8b Orthogonal Heretic
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
SK
SkunkApe 16b i1
Skunkape · mradermacher
Params16B
Context4K
Q4_K_M9.6 GB
GGUF
SA
saishf Aura Uncensored OAS 8B L3
Saishf · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IC
IceAbsintheRP 7b i1
Iceabsintherp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenMia Indo Mistral 7b v3
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
QW
Qwen1.5 7B Dutch Chat
Qwen · mradermacher
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
LL
Llama 3 8B EGO iMat
Llama · Quant-Cartel
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SO
SOLAR 10.7B v1.5
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
MI
MiniusLight 24B v2
Miniuslight · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Mistral 7B Merge 14 v0.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
CO
command r
Command R · cortexso
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
DA
DAVinCI Yi Ko 6B v0.61 Ff E1
Davinci · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
IC
Ice0.15 02.10 RP
Icewhiskeyrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
IC
IceCoffeeRP 7b i1
Icecoffeerp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KA
Kallamni 2.6b v1
Kallamni · mradermacher
Params2.57B
Context125K
Q4_K_M1.6 GB
Tool use
IC
IceMoonshineRP 7b
Icemoonshinerp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DA
Daredevil 7B
Daredevil · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Embedding
TH
TheDrummer Smegmma Deluxe 9B v1
Thedrummer · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
BY
ByteGPT r1
Bytegpt · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
EmbeddingReasoningTool use
AI
airoboros 33b 2.1 i1
Airoboros · mradermacher
Params32.5B
Context4K
Q4_K_M19.6 GB
GGUF

Keep browsing