GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
TH
TheSalt-L3-8b-v0.3.2
Thesalt · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SH
shark tank ai 7b v2
Shark · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GH
ghana voice ga
Ghana · ghanaopenai
Params244M
Context4K
Q4_K_M0.2 GB
GGUF
SI
simonveitner_seraphmarcoroni-7b
Simonveitner · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MY
X MythoChronos 13B
Mythochronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LI
LilithCore v1 12B
Lilithcore · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CH
chargoddard loyal piano m7 cdpo
Chargoddard · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HV
hviske v5 tiny
Hviske · emillykkegrann
Params263M
Context—
Smallest0.2 GB
GGUF
IC
IceDrinkNameNotFoundRP 7b Model_Stock
Icedrinknamenotfoundrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
recoilme gemma 2 9B v0.4
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GU
Guru 7B
Guru · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
QW
isOCR-0.8B-alpha2
Qwen · carlesonielfa
Params752M
Context256K
Smallest0.8 GB
ReasoningTool useVision
DR
Draig Fach v0.1
Draig · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Undi95_ReMM Mistral 13B Part1
Mistral · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
Starling Monarch Westlake Garten 7B v0.1
Starling · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
cloudyu Mixtral 7Bx2 MoE
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
AR
Arsenic Shahrazad 12B Rlvr
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
FI
Fimbulvetr 11B v2
Fimbulvetr · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
IC
Ice0.41 22.11 RP i1
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
LL
Llama3 Pirate Talk 8b v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
davranis analizi v1
Qwen · akadirgok
Params1.54B
Context32K
Smallest1.6 GB
Tool useVision
CA
Caracal LM
Caracal · mradermacher
Params664M
Context2K
Q4_K_M0.4 GB
GGUF
LL
Llama 3.3 8B Lumina Reasoning
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
TO
TowerInstruct 13B v0.1 i1
Towerinstruct · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WO
L3 8B R1 WolfCore
Wolfcore · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LA
gguf LaMini Flan T5 77M
Lamini · Felladrin
Params77M
Context512
Q4_K_M0.1 GB
GGUF
MO
MobileLLM-350M
Mobilellm · pjh64
Params376M
Context2K
Q4_K_M0.3 GB
GGUF
HA
HammerHead 7b Q4 k m
Hammer · IntelligentEstate
Params7.61B
Context32K
Q4_K_M4.7 GB
Tool use
LL
Llama 3SOME 8B v1
Llama · mradermacher
Params8.03B
Context24K
Q4_K_M4.9 GB
GGUF
CR
Creative Writer 32b Preview
Creative · mradermacher
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF

Keep browsing