GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
NE
NeuBeagle 7B
Neuralneubeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PU
pulpie orange small
Pulpie · Mike0021
Params212M
Context8K
Q4_K_M0.2 GB
RE
jinaai/reader-lm-0.5b
Reader · featherless-ai-quants
Params494M
Context250K
Q4_K_M0.4 GB
SO
SOLAR math 2x10.7b v0.2
Solar · mradermacher
Params19.2B
Context4K
Q4_K_M11.6 GB
LL
ChocoLlama/Llama-3-ChocoLlama-8B-instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
OP
OpenJev
Openjev · inference-snaps
Params26.9B
Context256K
Q4_K_M19.0 GB
MO
Monika 9B
Monika · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
UT
UtopiaXL 13B i1
Utopiaxl · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
AY
Aya Medikal
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
TO
TowerInstruct 7B v0.1
Towerinstruct · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
EM
EmertonBeagle 7B dpo
Emertonbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
etri-xainlp/SOLAR-10.7B-merge-dpo
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
DA
DanTagGen gamma
Dantaggen · mradermacher
Params393M
Context512
Q4_K_M0.2 GB
LL
Llama 3.1 8B UltraLong 2M Instruct
Llama · lmstudio-community
Params8.04B
Context2096K
Q4_K_M4.9 GB
MI
Mistral 7B Instruct v0.1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llama 3 LewdPlay 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
NO
Gwonny Nox Solar 10.7b v4 Kolon All 5 v3.0
Nox · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
PH
phonon 40m es
Phonon · ldenoue
Params51M
Context—
Smallest0.1 GB
CH
ChatWaifu_v1.4
Chatwaifu · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Asclepius Llama2 13B Pretraining Only
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
WE
Weyaxi SauerkrautLM UNA SOLAR Instruct
Weyaxi · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
KU
SanjiWatsuki/Kunoichi-DPO-7B
Kunoichi · featherless-ai-quants
Params7.24B
Context8K
Q4_K_M4.4 GB
WI
WinterGoddess 1.4x 70B L2 i1
Wintergoddess · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
IC
IceMartiniV1RP 7b
Icemartiniv · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HO
Home 3B v1
Home · acon96
Params2.78B
Context2K
Q4_K_M1.8 GB
MI
Rivermind 24B V1A Workspace
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
UN
UndiMix v3 13B
Undimix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 3 Nephilim v1 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
RE
jinaai/reader-lm-1.5b
Reader · featherless-ai-quants
Params1.54B
Context250K
Q4_K_M1.0 GB
LU
Lumiere-7B
Lumiere · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB