GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
CO
C4Ai Command R v01
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
LL
LLaMA2 13B Estopia
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
AY
aya-23-8B
Aya · bartowski
Params8B
Context8K
Q4_K_M5.1 GB
CY
Cybil-13B
Cybil · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
QU
quantumaikr_quantum-v0.01
Quantum · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
NemoAurora RP 12B
Nemoaurora · Aratako
Params12.2B
Context1000K
Q4_K_M7.5 GB
NO
Noromaid-7B-0.4-DPO
Noromaid · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
RE
reader lm 1.5b IMat
Reader · legraphista
Params1.54B
Context250K
Smallest0.4 GB
MI
Miqu MS 70B i1
Miqu · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
AC
Acolyte 22B iMat
Acolyte · Quant-Cartel
Params22.2B
Context128K
Q4_K_M13.3 GB
ES
MN 12B Estrella v2.2 i1
Estrella · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
IC
icefog72 IceLemonTeaRP 32k 7b
Icefog · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
MN BackyardAI Party 12B v1
Backyardai · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
KU
kunoichi-lemon-royale-v2-32K-7B
Kunoichi · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
TH
TherapyLlama 8B v1
Therapyllama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
MA
maldv winter garden 7b delta
Maldv · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Darwin 7b v0.1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HA
Hammer2.1 7b GGUF
Hammer · eaddario
Params7.61B
Context32K
Q4_K_M4.2 GB
CO
c4ai-command-r-plus
Command R · mmnga
Params104B
Context128K
Smallest23.2 GB
BI
Bielik SOLAR LIKE 10.7B Instruct v0.1
Bielik · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
AI
airoboros-65b-gpt4-2.0
Airoboros · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
JI
Jina Embeddings v4 Vllm Retrieval
Jina · mradermacher
Params3.1B
Context125K
Q4_K_M1.9 GB
NA
NaruMOE-3x7B-v2
Narumoe · mradermacher
Params18.5B
Context32K
Q4_K_M11.2 GB
HO
Holo4 27B GSQ RCO
Holo · lavendercomputing
Params26.9B
Context256K
Smallest10.1 GB
TE
TeTO MS 8x7b iMat
Teto · Quant-Cartel
Params46.7B
Context32K
Q4_K_M28.4 GB
XL
xLAM 1b fc r
Xlam · QuantFactory
Params1.35B
Context16K
Q4_K_M0.9 GB
QW
rokot omr 2b
Qwen · rokotmidi
Params1.72B
Context256K
Smallest1.8 GB
XL
xLAM 8x22b R
Xlam · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
LU
Lumimaid v0.2 8B
Lumimaid · Lewdiculous
Params8B
Context128K
Q4_K_M4.9 GB
AL
Alphacode AI AlphaMist7B slr v3
Alphacode · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB