GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
NE
Turdus 7B
Neuralmarcoro · adamksn
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.1 Nemotron 8B UltraLong 1M Instruct i1
Llama · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
OP
OpenLLM Ro RoMistral 7b Instruct
Openllm · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
UN
Unbabel TowerInstruct 13B v0.1
Unbabel · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
CO
C4Ai Command R7B 12 2024
Command R · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
MI
Mistral 7B Instruct v0.1
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Suzume Llama 3 8B Multilingual
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
grimjim Llama 3 Oasis v1 OAS 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
YU
YuE2 3B
Yue · LattifAI
Params3.63B
Context24K
Smallest0.1 GB
NO
Nox Solar 10.7b v4 Kolon All 5 v2.0
Nox · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
AY
aya-23-8B
Aya · backyardai
Params8.03B
Context8K
Q4_K_M5.1 GB
PO
Poppy_Porpoise DADA 8B
Poppy · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
MO
MobileLLM 600M
Mobilellm · RichardErkhov
Params640M
Context2K
Q4_K_M0.5 GB
SP
Spaetzle v31 7b
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
C4Ai Command R Plus
Command R · mradermacher
Params104B
Context128K
Smallest23.2 GB
SO
SOLAR 10.7B v1.2
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
AI
Airoboros 13b
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
BA
BagelMIsteryTour v2 8x7B i1
Bagelmisterytour · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Synatra 7B v0.3 RP Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
K2S3 Mistral 7b v1.43
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
XT
xTower13B
Xtower · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
ME
MedDecider 9B
Meddecider · lion-ai
Params9.2B
Context256K
Smallest0.2 GB
LY
MN 12B Lyra v4
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
CO
C4Ai Command R7B 12 2024
Command R · mmnga
Params8.03B
Context8K
Q4_K_M5.1 GB
SO
K2S3 SOLAR 11b v3.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
KE
kellemar DPO Orca Distilled 7B SLERP i1
Kellemar · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
GeoBox R1
Geobox · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ME
MetaMath Cybertron
Metamath · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
OG
OgnoMonarch 7B
Ognomonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
Alphacode AI AlphaMist7B slr v4 slow
Alphacode · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB