GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MO
mOrpheus_3B 1Base_early_preview v1 25000
Morpheus · joyoh
Params3.3B
Context128K
Q4_K_M2.1 GB
Tool use
MI
cloudyu Mixtral 13Bx2 MOE 22B
Mistral · RichardErkhov
Params21.5B
Context4K
Q4_K_M13.0 GB
GGUF
KU
kunoichi lemon royale v2 32K 7B
Kunoichi · grimjim
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KA
Himitsui/Kaiju-11B
Kaiju · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llama 3.1 8B Stheno v3.4
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
GGUF
ST
StartLux Decision v1 2B BF16
Startlux · startlux-models
Params1.88B
Context256K
Smallest3.8 GB
ReasoningTool use
AR
Arsenic Shahrazad 12B v4
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
QW
Qwen1.5-7B-Dutch-Chat
Qwen · robinsmits
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
SI
Silicon Alice 7B
Silicon · LakoMoor
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
RO
RoLlama2 7b Instruct 2024 05 14
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
UN
UndiMix v4 13B
Undimix · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
GE
atom v1 preview 4b
Gemma · vanta-research
Params3.88B
Context128K
Smallest7.8 GB
ReasoningVision
LL
Llama 3 Refueled
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
RI
Rivermind 24B v1
Rivermind · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
AI
Airoboros 65b Gpt4 1.3
Airoboros · mradermacher
Params65.3B
Context2K
Q4_K_M39.3 GB
GGUF
CR
Creative Writer v0.1 Bravo 35b
Creative · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
ST
Studybuddyv2.1
Studybuddyv · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
NE
Nemo 12b TheSpice V0.9 All v2
Nemo · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
AI
AIFT Yi Ko 6B v1.11
Aift · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
QW
isOCR-0.8B-alpha4
Qwen · carlesonielfa
Params752M
Context256K
Smallest0.8 GB
ReasoningTool useVision
MI
MiquMaid v2 70B
Miqumaid · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
GH
ghana voice avatime
Ghana · ghanaopenai
Params244M
Context4K
Q4_K_M0.2 GB
GGUF
GH
ghana voice bassar
Ghana · ghanaopenai
Params244M
Context4K
Q4_K_M0.2 GB
GGUF
QW
bhai qwen35 4b lora
Qwen · eyupyilmaz
Params21M
Context—
Smallest0.0 GB
GGUF
ZE
Zebrafish 7B
bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DR
maldv/dragonwar-7b-alpha
Dragonwar · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RO
RoLlama3.1 8b Instruct DPO 2024 10 09
Rollama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CA
Canary Tts 0.5b
Canary · mradermacher
Params793M
Context8K
Q4_K_M0.5 GB
Tool use
KU
Kuwutu-7B-CYOA
Kuwutu · KeinNiemand
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
TE
TeeZee Buttocks 7B v1.1
Teezee · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing