GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mixtral 11Bx2 MoE 19B i1
Mistral · mradermacher
Params19.2B
Context4K
Q4_K_M11.6 GB
GGUF
LL
Llama 3 8B Kolon ITD 5 v1.0
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Venomia 1.1 m7 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RE
reader lm 0.5b i1
Reader · mradermacher
Params494M
Context250K
Q4_K_M0.4 GB
GGUF
KU
Kuwutu 7B CYOA v2
Kuwutu · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Roleplay
SK
SkunkApe 14b i1
Skunkape · mradermacher
Params14.2B
Context8K
Q4_K_M8.6 GB
GGUF
NL
nllb 200 distilled 600M
Nllb · JaydeepGupta
Params616M
Context1K
Smallest1.0 GB
GGUF
AY
Aya23 8b
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
OP
norquinal_opencai-7b
Opencai · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AT
Athena v2
Athena · IkariDev
Params13B
Context4K
Smallest7.4 GB
GGUF
TI
Tiny Pirate 1.1b v0.1 i1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
QW
Z Image Engineer V6 DFlash b16
Qwen · pottokao
Params537M
Context40K
Q4_K_M0.3 GB
CodingReasoningTool use
CO
C4Ai Command R7B 12 2024
Command R · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
Tool use
AI
Airoboros 33b Gpt4 2.0
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
ML
MLewd L2 13B v2 3 i1
Mlewd · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AI
Airoboros 7b Gpt4 1.4
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
TH
L3 TheSpice 8b v0.8.3 i1
Thespice · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Stheno v3.4
Llama · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 Aloe Beta 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ON
SOLAR 10.7B
Ons · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
MO
Monika 122B
Monika · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
ReasoningRoleplayTool use
AR
Arsenic Shahrazad 12B Rlvr
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
TH
TherapyLlama 8B v1
Therapyllama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
MistralDarwin 7b v0.1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
ChatWaifu_2.0_vision
Chatwaifu · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplayVision
JI
Jina Embeddings v4 Vllm Retrieval
Jina · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
EmbeddingVision
QW
Qwen 2.5 Coder Arctic ExCoT 32B
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingTool use
EH
EHR R1 8B
Ehr · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
MI
BagelMIsteryTour 8x7B
Mistral · ycros
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
NI
Ninja v1 RP
Ninja · Aratako
Params7.24B
Context4K
Q4_K_M4.4 GB
Roleplay

Keep browsing