GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
C4Ai Command R v01
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
LL
LLaMA2 13B Estopia
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AY
aya-23-8B
Aya · bartowski
Params8B
Context8K
Q4_K_M5.1 GB
GGUF
CY
Cybil-13B
Cybil · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QU
quantumaikr_quantum-v0.01
Quantum · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
NemoAurora RP 12B
Nemoaurora · Aratako
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
NO
Noromaid-7B-0.4-DPO
Noromaid · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RE
reader lm 1.5b IMat
Reader · legraphista
Params1.54B
Context250K
Smallest0.4 GB
GGUF
MI
Miqu MS 70B i1
Miqu · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
GGUF
AC
Acolyte 22B iMat
Acolyte · Quant-Cartel
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
ES
MN 12B Estrella v2.2 i1
Estrella · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
IC
icefog72 IceLemonTeaRP 32k 7b
Icefog · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BA
MN BackyardAI Party 12B v1
Backyardai · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
KU
kunoichi-lemon-royale-v2-32K-7B
Kunoichi · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TH
TherapyLlama 8B v1
Therapyllama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MA
maldv winter garden 7b delta
Maldv · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Darwin 7b v0.1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HA
Hammer2.1 7b GGUF
Hammer · eaddario
Params7.61B
Context32K
Q4_K_M4.2 GB
Tool use
CO
c4ai-command-r-plus
Command R · mmnga
Params104B
Context128K
Smallest23.2 GB
GGUF
BI
Bielik SOLAR LIKE 10.7B Instruct v0.1
Bielik · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
AI
airoboros-65b-gpt4-2.0
Airoboros · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
GGUF
JI
Jina Embeddings v4 Vllm Retrieval
Jina · mradermacher
Params3.1B
Context125K
Q4_K_M1.9 GB
Embedding
NA
NaruMOE-3x7B-v2
Narumoe · mradermacher
Params18.5B
Context32K
Q4_K_M11.2 GB
Roleplay
HO
Holo4 27B GSQ RCO
Holo · lavendercomputing
Params26.9B
Context256K
Smallest10.1 GB
ReasoningTool useVision
TE
TeTO MS 8x7b iMat
Teto · Quant-Cartel
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
XL
xLAM 1b fc r
Xlam · QuantFactory
Params1.35B
Context16K
Q4_K_M0.9 GB
Tool use
QW
rokot omr 2b
Qwen · rokotmidi
Params1.72B
Context256K
Smallest1.8 GB
Vision
XL
xLAM 8x22b R
Xlam · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
Tool use
LU
Lumimaid v0.2 8B
Lumimaid · Lewdiculous
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
AL
Alphacode AI AlphaMist7B slr v3
Alphacode · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing