GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
MO
mOrpheus_3B 1Base_early_preview v1 25000
Morpheus · joyoh
Params3.3B
Context128K
Q4_K_M2.1 GB
MI
cloudyu Mixtral 13Bx2 MOE 22B
Mistral · RichardErkhov
Params21.5B
Context4K
Q4_K_M13.0 GB
KU
kunoichi lemon royale v2 32K 7B
Kunoichi · grimjim
Params7.24B
Context32K
Q4_K_M4.4 GB
KA
Himitsui/Kaiju-11B
Kaiju · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Llama 3.1 8B Stheno v3.4
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
ST
StartLux Decision v1 2B BF16
Startlux · startlux-models
Params1.88B
Context256K
Smallest3.8 GB
AR
Arsenic Shahrazad 12B v4
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen1.5-7B-Dutch-Chat
Qwen · robinsmits
Params7.72B
Context32K
Q4_K_M4.8 GB
SI
Silicon Alice 7B
Silicon · LakoMoor
Params7.24B
Context8K
Q4_K_M4.4 GB
RO
RoLlama2 7b Instruct 2024 05 14
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
UN
UndiMix v4 13B
Undimix · tensorblock
Params13B
Context4K
Smallest4.9 GB
GE
atom v1 preview 4b
Gemma · vanta-research
Params3.88B
Context128K
Smallest7.8 GB
LL
Llama 3 Refueled
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
RI
Rivermind 24B v1
Rivermind · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
AI
Airoboros 65b Gpt4 1.3
Airoboros · mradermacher
Params65.3B
Context2K
Q4_K_M39.3 GB
CR
Creative Writer v0.1 Bravo 35b
Creative · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
ST
Studybuddyv2.1
Studybuddyv · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
NE
Nemo 12b TheSpice V0.9 All v2
Nemo · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
AI
AIFT Yi Ko 6B v1.11
Aift · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
QW
isOCR-0.8B-alpha4
Qwen · carlesonielfa
Params752M
Context256K
Smallest0.8 GB
MI
MiquMaid v2 70B
Miqumaid · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GH
ghana voice avatime
Ghana · ghanaopenai
Params244M
Context4K
Q4_K_M0.2 GB
GH
ghana voice bassar
Ghana · ghanaopenai
Params244M
Context4K
Q4_K_M0.2 GB
QW
bhai qwen35 4b lora
Qwen · eyupyilmaz
Params21M
Context—
Smallest0.0 GB
ZE
Zebrafish 7B
bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
DR
maldv/dragonwar-7b-alpha
Dragonwar · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
RO
RoLlama3.1 8b Instruct DPO 2024 10 09
Rollama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CA
Canary Tts 0.5b
Canary · mradermacher
Params793M
Context8K
Q4_K_M0.5 GB
KU
Kuwutu-7B-CYOA
Kuwutu · KeinNiemand
Params7.62B
Context32K
Q4_K_M4.7 GB
TE
TeeZee Buttocks 7B v1.1
Teezee · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB