GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
HE
Hemmingway 1 NVFP4 MLP
Hemmingway · kvallespin
Params27.3B
Context256K
Smallest20.5 GB
NO
Nox Solar 10.7b v4 Kolon All 5
Nox · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
RE
jinaai.ReaderLM v2
Readerlm · DevQuasar-7
Params1.54B
Context501K
Q4_K_M1.0 GB
OM
Omnia2X7B
Omnia · mradermacher
Params12.9B
Context8K
Q4_K_M7.8 GB
AU
Augmentasanguis-8x7B
Augmentasanguis · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mixtral 8x7B MoE RP Story
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
AL
ALoDLM 1.7B
Alodlm · wahidmounir
Params2.03B
Context40K
Smallest2.2 GB
AI
AIFT Yi Ko 6B v1.11
Aift · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
BL
Blind Test
Blind · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
PL
PLLuM 8x7B Nc Base
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
LU
Lumimaid v0.2 12B
Lumimaid · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
ON
oneonlee LDCC SOLAR gugutypus 10.7B
Oneonlee · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
IC
icefog72 IceSakeRP 7b
Icefog · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
NO
Noromaid 7B 0.4 DPO
Noromaid · NeverSleep
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
SOLAR 10.7b Instruct dpo
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
TA
tannedbum L3 Nymeria Maid 8B
Tannedbum · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LU
Lumimaid v0.2 8B
Lumimaid · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
SP
cstr/Spaetzle-v69-7b
Spaetzle · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
FA
FARE 8B
Fare · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
LL
lightblue/suzume-llama-3-8B-multilingual-orpo-borda-top75
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
AN
Anonymizer 0.6B
Anonymizer · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
IC
Ice0.34n 14.11 RP i1
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Fonzie0.1-4B
Qwen · devopsfortunato
Params4.33B
Context256K
Q4_K_M2.8 GB
SH
Shreyansh STEM AI 7B Final
Shreyansh · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
LU
Lumimaid v0.2 12B Heretic
Lumimaid · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Franziska Mixtral v1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
AC
nvidia.AceInstruct 1.5B
Aceinstruct · DevQuasar-7
Params1.78B
Context128K
Q4_K_M1.1 GB
SM
SmolLM 360M Instruct
SmolLM · RichardErkhov
Params362M
Context2K
Q4_K_M0.3 GB
BE
beberik rawr
Beberik · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
LU
NeverSleep/Lumimaid-v0.2-12B
Lumimaid · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB