GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
VA
MusicGen vanya_ai_dnb_0.1
Vanya · thepatch
Params58M
Context—
Q4_K_M0.3 GB
GGUF
FR
FrankenMonarch 11b
Frankenmonarch · mradermacher
Params10.7B
Context32K
Q4_K_M6.6 GB
GGUF
AR
Arsenic Shahrazad 12B v4.5
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
GA
Galgame Llasa 1B
Galgame · mradermacher
Params1.77B
Context128K
Q4_K_M1.1 GB
Tool use
NA
Narisumashi 11B v1.5 i1
Narisumashi · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
Roleplay
SA
FL 7B 3.1 Safetensors
Safetensors · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
BU
Buttocks 7B v1.0 i1
Buttocks · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FI
Fimbulvetr 11B v2 Heretic
Fimbulvetr · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
PS
PsyMedRP v1 13B
Psymedrp · Undi95
Params13B
Context4K
Smallest6.3 GB
GGUF
ML
mlabonne OmniBeagle 7B
Mlabonne · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PL
PLLuM 12B Nc Chat
Pllum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
WE
giraffe176/WestLake_Noromaid_OpenHermes_neural-chatv0.1
Westlake · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LL
Llama 3.1 8B UltraLong 2M Instruct
Llama · mradermacher
Params8.04B
Context2096K
Q4_K_M4.9 GB
Tool use
MO
cr-model
Model · tastypear
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
MO
Monarch 7B i1
Monarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PL
PLLuM 12B Nc Base
Pllum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
SM
Smegmma 9B v1
Smegmma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
ED
EdgeDecoder JAX
Edgedecoder · Notacape
Params505M
Context1K
Smallest0.5 GB
Coding
DA
DataVortexS dpov3 i1
Datavortexs · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
SO
dddsaty/SOLAR-Instruct-ko-Adapter-Attach
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
DA
DaringMaid 20B
Daringmaid · Kooten
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
CO
C4Ai Command R7B 12 2024
Command R · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
Tool use
MI
Flammen3
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
mOrpheus_3B 1Base_early_preview v1 25000
Morpheus · KoljaB
Params3.3B
Context128K
Q4_K_M2.1 GB
Tool use
TO
TowerInstruct WMT24 Chat 7B i1
Towerinstruct · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.7
Datavortexs · RichardErkhov
Params10.9B
Context2K
Q4_K_M6.5 GB
GGUF
MA
maldv winter garden 7b beta
Maldv · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mii llm maestrale chat v0.4 beta
Mii · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
airoboros 33b gpt4 m2.0
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
AY
Aya Expanse 32b Abliterated
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF

Keep browsing