GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
Deacon 3B
Deacon · Aryanne
Params3.43B
Context8K
Smallest2.0 GB
GGUF
AC
AceInstruct 7B
Aceinstruct · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Coding
NI
Nicesse CRAFT 1B
Nicesse · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
HY
HyouKan 3x7B
Hyoukan · mradermacher
Params18.5B
Context8K
Q4_K_M11.4 GB
Roleplay
MI
Synatra v0.3 RP AshhLimaRP Mistral 7B
Mistral · Herman555
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
QW
Qwen2.5 Aloe Beta 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
KI
ReMM S Kimiko v2 13B
Kimi · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
CI
CircleZone 1.0 33M
Circlezone · IAMPOOM
Params34M
Context512
Smallest0.1 GB
GGUF
CR
Creative Writer v0.1 Bravo 35b
Creative · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
AT
Athene 70B
Athene · bullerwins
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
TH
Thespis Krangled 7b v2
Thespis · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
L3 SAO MIX 8B V1
Sao · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QF
QFFT LIMO 7B
Qfft · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
TI
tiny aya kosher 3.3B
Tiny · EMD123
Params3.35B
Context488K
Q4_K_M2.1 GB
GGUF
SU
Sundae v716 Update Direct 8b
Sundae · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
MI
Miqu PlayMaid 70B v0.1
Miqu · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
GGUF
RE
ReMM v2.1 L2 13B
Remm · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
quantum v0.01 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GH
ghana voice akuapem twi
Ghana · ghanaopenai
Params244M
Context4K
Q4_K_M0.2 GB
GGUF
TH
L3 TheGreenLion 8b SFT v0.1.2 i1
Thegreenlion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NO
Novus 7b tr v1
Novus · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
Nemo 12b Humanize SFT v0.2.5 KTO
Nemo · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
RM
RMBG 2.0_briaai
Rmbg · gobeldan
Params220M
Context—
Smallest0.4 GB
GGUF
QW
Hemmingway 1 27B qwen3.8 27B svd lora
Qwen · hotdogs
Params459M
Context—
Smallest0.9 GB
GGUF
WE
WestBeagle 7B
Westbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YU
YuE2 audio tokenizer, the v9 head of Mothersuperior, on MERT-v2-FullSong
Yue · JackKnifeAI
Params632M
Context—
Smallest0.0 GB
GGUF
HO
Home 1B v2
Home · acon96
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
EU
L3 70B Euryale v2.1
Euryale · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
FA
FARE 20B
Fare · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
AI
AISquare Instruct yi ko 6b v0.9.30 i1
Aisquare · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF

Keep browsing