GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
VLAA Thinker Qwen2VL 2B
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Reasoning
NE
RA IT NER Zh 7B
Ner · mradermacher
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
LD
LDCC SOLAR 10.7B
Ldcc · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
SO
SOLAR 10.7b Instruct dpo i1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llama 3 Patronus Lynx 8B Instruct v1.1
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SA
saishf Fett Eris Mix 7B
Saishf · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama4Some-SOVL-4x8B-L3-V1
Llama · mradermacher
Params24.9B
Context8K
Q4_K_M15.2 GB
GGUF
IC
IceLemonMedovukhaRP 7b i1
Icelemonmedovukharp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
XL
xLAM 8x22b R
Xlam · second-state
Params141B
Context64K
Q4_K_M85.6 GB
Tool use
AI
Airoboros 65b Gpt4 1.2
Airoboros · mradermacher
Params65.3B
Context2K
Q4_K_M39.3 GB
GGUF
NO
Nox Solar 10.7b v4 Kolon All 5 v3.0
Nox · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
EC
Echidna-13b-v0.3
Echidna · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3 14B Dawnwhisper
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningRoleplayTool use
PL
PLLuM 8x7B nc instruct
Pllum · Nondzu
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
TH
TherapyBeagle 11B v1
Therapybeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
GU
Guru 7B
Guru · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
AT
Athena v3
Athena · IkariDev
Params13B
Context4K
Smallest7.4 GB
GGUF
LL
Llama 3.1 8B UltraLong 1M Instruct
Llama · lmstudio-community
Params8.04B
Context1048K
Q4_K_M4.9 GB
Tool use
TE
Teuken 7B Instruct v0.6
Teuken · mradermacher
Params7.45B
Context4K
Q4_K_M5.0 GB
GGUF
WE
Starling Monarch Westlake Garten 7B v0.1
Westlake · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EU
Euryale L2 70B i1
Euryale · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
PL
Plamo 13b Instruct Nc
Plamo · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
HE
Hemmingway 1 heretic
Hemmingway · richardyoung
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
OU
OuteTTS 0.2 500M
Outetts · mradermacher
Params499M
Context32K
Q4_K_M0.4 GB
GGUF
RO
RoLlama2 7b Instruct 2024 05 14 i1
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LD
LDCC SOLAR gugutypus 10.7B
Ldcc · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF
SU
Sundae v716 Generate Direct 4b
Sundae · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
AN
Anime Speech Japanese Refiner
Anime · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
ReasoningTool useVision
NE
NeuralOmniWestBeaglake 7B i1
Neuralomniwestbeaglake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WO
L3 8B R1 WolfCore i1
Wolfcore · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use

Keep browsing