GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
QW
VLAA Thinker Qwen2VL 2B
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
NE
RA IT NER Zh 7B
Ner · mradermacher
Params7.72B
Context32K
Q4_K_M4.8 GB
LD
LDCC SOLAR 10.7B
Ldcc · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
SO
SOLAR 10.7b Instruct dpo i1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Llama 3 Patronus Lynx 8B Instruct v1.1
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
SA
saishf Fett Eris Mix 7B
Saishf · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama4Some-SOVL-4x8B-L3-V1
Llama · mradermacher
Params24.9B
Context8K
Q4_K_M15.2 GB
IC
IceLemonMedovukhaRP 7b i1
Icelemonmedovukharp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
XL
xLAM 8x22b R
Xlam · second-state
Params141B
Context64K
Q4_K_M85.6 GB
AI
Airoboros 65b Gpt4 1.2
Airoboros · mradermacher
Params65.3B
Context2K
Q4_K_M39.3 GB
NO
Nox Solar 10.7b v4 Kolon All 5 v3.0
Nox · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
EC
Echidna-13b-v0.3
Echidna · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3 14B Dawnwhisper
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
PL
PLLuM 8x7B nc instruct
Pllum · Nondzu
Params46.7B
Context32K
Q4_K_M28.4 GB
TH
TherapyBeagle 11B v1
Therapybeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GU
Guru 7B
Guru · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
AT
Athena v3
Athena · IkariDev
Params13B
Context4K
Smallest7.4 GB
LL
Llama 3.1 8B UltraLong 1M Instruct
Llama · lmstudio-community
Params8.04B
Context1048K
Q4_K_M4.9 GB
TE
Teuken 7B Instruct v0.6
Teuken · mradermacher
Params7.45B
Context4K
Q4_K_M5.0 GB
WE
Starling Monarch Westlake Garten 7B v0.1
Westlake · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
EU
Euryale L2 70B i1
Euryale · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
PL
Plamo 13b Instruct Nc
Plamo · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
HE
Hemmingway 1 heretic
Hemmingway · richardyoung
Params27.3B
Context256K
Q4_K_M16.8 GB
OU
OuteTTS 0.2 500M
Outetts · mradermacher
Params499M
Context32K
Q4_K_M0.4 GB
RO
RoLlama2 7b Instruct 2024 05 14 i1
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LD
LDCC SOLAR gugutypus 10.7B
Ldcc · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
SU
Sundae v716 Generate Direct 4b
Sundae · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
AN
Anime Speech Japanese Refiner
Anime · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
NE
NeuralOmniWestBeaglake 7B i1
Neuralomniwestbeaglake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
WO
L3 8B R1 WolfCore i1
Wolfcore · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB