GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
CA
CatunaLaserPi
Catunalaserpi · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 1.5B SFT UltraChat
Qwen · ermiaazarkhalili
Params1.54B
Context128K
Q4_K_M1.0 GB
TH
TheSpice 7b v0.1.1 i1
Thespice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LY
MN 12B Lyra v4
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
HE
Hemmingway 1 Abliterated Extreme
Hemmingway · markldn
Params27.3B
Context256K
Smallest29.0 GB
TO
TowerInstruct WMT24 Chat 7B
Towerinstruct · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
WO
WoonaAI OmniLing V1 12b experimental
Woonaai · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
HW
hwkwon S SOLAR 10.7B v1.5
Hwkwon · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
lightblue/suzume-llama-3-8B-multilingual-orpo-borda-full
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
EU
Euryale L2 70B
Euryale · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
AU
Augmentasanguis 8x7B
Augmentasanguis · Envoid
Params46.7B
Context32K
Smallest15.6 GB
LL
Llama 3 Instruction Constructionsafety
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
XL
Models Salesforce xLAM 7b Fc R
Xlam · MaziyarPanahi
Params6.91B
Context4K
Smallest4.8 GB
QW
Nemotron Research Reasoning Qwen 1.5B
Qwen · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
IC
Ice0.147 17.10 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
VE
Vex Amber Fable 2.0
Vex · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
GH
ghana voice sehwi
Ghana · ghanaopenai
Params244M
Context4K
Q4_K_M0.2 GB
IA
Iambe RP cDPO 20b i1
Iambe · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
XL
xLAM 7b Fc R
Xlam · second-state
Params6.91B
Context4K
Q4_K_M4.2 GB
LL
badger mu llama 3 8b i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
IC
IceSakeV8RP-7b
Icesakev · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
EC
Echo Kinyarwanda Tts
Echo · mradermacher
Params498M
Context32K
Q4_K_M0.4 GB
VE
Venomia-1.1-m7
Venomia · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
abideen/gemma-2b-openhermes
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
ME
saishf/Merge-Mayhem-L3-V2
Merge · featherless-ai-quants
Params8.03B
Context24K
Q4_K_M4.9 GB
LL
Llama-3-Lumimaid-8B-v0.1-OAS
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LO
Lonepino 11B
Lonepino · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
SO
solar ko common merged
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
SU
Sundae v716 Generate Direct 4b
Sundae · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
MU
musicgen melody
Musicgen · vokra
Params1.56B
Context—
Smallest6.2 GB