GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
VA
MusicGen vanya_ai_dnb_0.1
Vanya · thepatch
Params58M
Context—
Q4_K_M0.3 GB
FR
FrankenMonarch 11b
Frankenmonarch · mradermacher
Params10.7B
Context32K
Q4_K_M6.6 GB
AR
Arsenic Shahrazad 12B v4.5
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GA
Galgame Llasa 1B
Galgame · mradermacher
Params1.77B
Context128K
Q4_K_M1.1 GB
NA
Narisumashi 11B v1.5 i1
Narisumashi · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
SA
FL 7B 3.1 Safetensors
Safetensors · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
BU
Buttocks 7B v1.0 i1
Buttocks · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
FI
Fimbulvetr 11B v2 Heretic
Fimbulvetr · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
PS
PsyMedRP v1 13B
Psymedrp · Undi95
Params13B
Context4K
Smallest6.3 GB
ML
mlabonne OmniBeagle 7B
Mlabonne · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
PL
PLLuM 12B Nc Chat
Pllum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
WE
giraffe176/WestLake_Noromaid_OpenHermes_neural-chatv0.1
Westlake · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.1 8B UltraLong 2M Instruct
Llama · mradermacher
Params8.04B
Context2096K
Q4_K_M4.9 GB
MO
cr-model
Model · tastypear
Params14.2B
Context32K
Q4_K_M9.2 GB
MO
Monarch 7B i1
Monarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PL
PLLuM 12B Nc Base
Pllum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
SM
Smegmma 9B v1
Smegmma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
ED
EdgeDecoder JAX
Edgedecoder · Notacape
Params505M
Context1K
Smallest0.5 GB
DA
DataVortexS dpov3 i1
Datavortexs · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
SO
dddsaty/SOLAR-Instruct-ko-Adapter-Attach
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
DA
DaringMaid 20B
Daringmaid · Kooten
Params20B
Context4K
Q4_K_M12.0 GB
CO
C4Ai Command R7B 12 2024
Command R · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
MI
Flammen3
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
mOrpheus_3B 1Base_early_preview v1 25000
Morpheus · KoljaB
Params3.3B
Context128K
Q4_K_M2.1 GB
TO
TowerInstruct WMT24 Chat 7B i1
Towerinstruct · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
DA
DataVortexS 10.7B Dpo v1.7
Datavortexs · RichardErkhov
Params10.9B
Context2K
Q4_K_M6.5 GB
MA
maldv winter garden 7b beta
Maldv · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mii llm maestrale chat v0.4 beta
Mii · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
airoboros 33b gpt4 m2.0
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
AY
Aya Expanse 32b Abliterated
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB