GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
TH
TheSalt-L3-8b-v0.3.2
Thesalt · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
SH
shark tank ai 7b v2
Shark · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GH
ghana voice ga
Ghana · ghanaopenai
Params244M
Context4K
Q4_K_M0.2 GB
SI
simonveitner_seraphmarcoroni-7b
Simonveitner · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MY
X MythoChronos 13B
Mythochronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LI
LilithCore v1 12B
Lilithcore · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
CH
chargoddard loyal piano m7 cdpo
Chargoddard · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
HV
hviske v5 tiny
Hviske · emillykkegrann
Params263M
Context—
Smallest0.2 GB
IC
IceDrinkNameNotFoundRP 7b Model_Stock
Icedrinknamenotfoundrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
recoilme gemma 2 9B v0.4
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GU
Guru 7B
Guru · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
isOCR-0.8B-alpha2
Qwen · carlesonielfa
Params752M
Context256K
Smallest0.8 GB
DR
Draig Fach v0.1
Draig · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Undi95_ReMM Mistral 13B Part1
Mistral · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
ST
Starling Monarch Westlake Garten 7B v0.1
Starling · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
cloudyu Mixtral 7Bx2 MoE
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
AR
Arsenic Shahrazad 12B Rlvr
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
FI
Fimbulvetr 11B v2
Fimbulvetr · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
IC
Ice0.41 22.11 RP i1
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama3 Pirate Talk 8b v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
davranis analizi v1
Qwen · akadirgok
Params1.54B
Context32K
Smallest1.6 GB
CA
Caracal LM
Caracal · mradermacher
Params664M
Context2K
Q4_K_M0.4 GB
LL
Llama 3.3 8B Lumina Reasoning
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
TO
TowerInstruct 13B v0.1 i1
Towerinstruct · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
WO
L3 8B R1 WolfCore
Wolfcore · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LA
gguf LaMini Flan T5 77M
Lamini · Felladrin
Params77M
Context512
Q4_K_M0.1 GB
MO
MobileLLM-350M
Mobilellm · pjh64
Params376M
Context2K
Q4_K_M0.3 GB
HA
HammerHead 7b Q4 k m
Hammer · IntelligentEstate
Params7.61B
Context32K
Q4_K_M4.7 GB
LL
Llama 3SOME 8B v1
Llama · mradermacher
Params8.03B
Context24K
Q4_K_M4.9 GB
CR
Creative Writer 32b Preview
Creative · mradermacher
Params32.3B
Context128K
Q4_K_M19.8 GB