GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
NeuBeagle 7B
Neuralneubeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PU
pulpie orange small
Pulpie · Mike0021
Params212M
Context8K
Q4_K_M0.2 GB
GGUF
RE
jinaai/reader-lm-0.5b
Reader · featherless-ai-quants
Params494M
Context250K
Q4_K_M0.4 GB
GGUF
SO
SOLAR math 2x10.7b v0.2
Solar · mradermacher
Params19.2B
Context4K
Q4_K_M11.6 GB
GGUF
LL
ChocoLlama/Llama-3-ChocoLlama-8B-instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OP
OpenJev
Openjev · inference-snaps
Params26.9B
Context256K
Q4_K_M19.0 GB
ReasoningTool use
MO
Monika 9B
Monika · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplayTool use
UT
UtopiaXL 13B i1
Utopiaxl · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AY
Aya Medikal
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
TO
TowerInstruct 7B v0.1
Towerinstruct · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
EM
EmertonBeagle 7B dpo
Emertonbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SO
etri-xainlp/SOLAR-10.7B-merge-dpo
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
DA
DanTagGen gamma
Dantaggen · mradermacher
Params393M
Context512
Q4_K_M0.2 GB
GGUF
LL
Llama 3.1 8B UltraLong 2M Instruct
Llama · lmstudio-community
Params8.04B
Context2096K
Q4_K_M4.9 GB
Tool use
MI
Mistral 7B Instruct v0.1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Roleplay
LL
Llama 3 LewdPlay 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NO
Gwonny Nox Solar 10.7b v4 Kolon All 5 v3.0
Nox · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
PH
phonon 40m es
Phonon · ldenoue
Params51M
Context—
Smallest0.1 GB
GGUF
CH
ChatWaifu_v1.4
Chatwaifu · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
LL
Asclepius Llama2 13B Pretraining Only
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WE
Weyaxi SauerkrautLM UNA SOLAR Instruct
Weyaxi · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
KU
SanjiWatsuki/Kunoichi-DPO-7B
Kunoichi · featherless-ai-quants
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
WI
WinterGoddess 1.4x 70B L2 i1
Wintergoddess · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
IC
IceMartiniV1RP 7b
Icemartiniv · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HO
Home 3B v1
Home · acon96
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
MI
Rivermind 24B V1A Workspace
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
UN
UndiMix v3 13B
Undimix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 3 Nephilim v1 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RE
jinaai/reader-lm-1.5b
Reader · featherless-ai-quants
Params1.54B
Context250K
Q4_K_M1.0 GB
GGUF
LU
Lumiere-7B
Lumiere · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing