GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
CA
CatunaLaserPi
Catunalaserpi · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 1.5B SFT UltraChat
Qwen · ermiaazarkhalili
Params1.54B
Context128K
Q4_K_M1.0 GB
Tool use
TH
TheSpice 7b v0.1.1 i1
Thespice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LY
MN 12B Lyra v4
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
HE
Hemmingway 1 Abliterated Extreme
Hemmingway · markldn
Params27.3B
Context256K
Smallest29.0 GB
ReasoningTool use
TO
TowerInstruct WMT24 Chat 7B
Towerinstruct · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
WO
WoonaAI OmniLing V1 12b experimental
Woonaai · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
HW
hwkwon S SOLAR 10.7B v1.5
Hwkwon · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
lightblue/suzume-llama-3-8B-multilingual-orpo-borda-full
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
EU
Euryale L2 70B
Euryale · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
AU
Augmentasanguis 8x7B
Augmentasanguis · Envoid
Params46.7B
Context32K
Smallest15.6 GB
GGUF
LL
Llama 3 Instruction Constructionsafety
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
XL
Models Salesforce xLAM 7b Fc R
Xlam · MaziyarPanahi
Params6.91B
Context4K
Smallest4.8 GB
Tool use
QW
Nemotron Research Reasoning Qwen 1.5B
Qwen · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
IC
Ice0.147 17.10 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
VE
Vex Amber Fable 2.0
Vex · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
CodingReasoningTool use
GH
ghana voice sehwi
Ghana · ghanaopenai
Params244M
Context4K
Q4_K_M0.2 GB
GGUF
IA
Iambe RP cDPO 20b i1
Iambe · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
Roleplay
XL
xLAM 7b Fc R
Xlam · second-state
Params6.91B
Context4K
Q4_K_M4.2 GB
Tool use
LL
badger mu llama 3 8b i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IC
IceSakeV8RP-7b
Icesakev · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EC
Echo Kinyarwanda Tts
Echo · mradermacher
Params498M
Context32K
Q4_K_M0.4 GB
GGUF
VE
Venomia-1.1-m7
Venomia · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
abideen/gemma-2b-openhermes
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
Tool use
ME
saishf/Merge-Mayhem-L3-V2
Merge · featherless-ai-quants
Params8.03B
Context24K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Lumimaid-8B-v0.1-OAS
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LO
Lonepino 11B
Lonepino · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
SO
solar ko common merged
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
SU
Sundae v716 Generate Direct 4b
Sundae · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
MU
musicgen melody
Musicgen · vokra
Params1.56B
Context—
Smallest6.2 GB
GGUF

Keep browsing