GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
LL
Asclepius-Llama3-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
SO
SOLARC MOE 10.7Bx4
Solarc · TheBloke
Params36B
Context4K
Q4_K_M20.4 GB
MP
Mpt 7b 8k Chat
Mpt · mradermacher
Params6.65B
Context8K
Q4_K_M4.3 GB
QW
Qwen3 Next 80B A3B Thinking GRPO Uncensored
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.5 GB
MP
Mpt 7b 8k Chat
Mpt · mradermacher
Params6.65B
Context8K
Q4_K_M4.3 GB
DR
DRT O1 14B
Drt · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
MP
Mpt 30b Chat
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
GR
KV Ground 8B BaseGuiOwl1.5 0315
Ground · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
QW
qwen2.5 coder 7b cadquery
Qwen · yuvit-batra
Params7.6B
Context32K
Q4_K_M4.7 GB
TO
Tower Plus 9B Abliterated Hf Data
Tower · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
SA
Sakura 14B LNovel v0.9b
Sakura · SakuraLLM
Params14.2B
Context8K
Q4_K_M9.4 GB
RA
RAFT 7B
Raft · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
CA
CarbonBeagle 11B i1
Carbonbeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
FL
Flan T5 Large Grammar Synthesis
Flan · pszemraj
Params780M
Context512
Smallest0.6 GB
ST
stablelm tuned alpha 7b
Stablelm · mradermacher
Params7.87B
Context4K
Q4_K_M5.1 GB
PE
PersianMind v1.0
Persianmind · mradermacher
Params6.8B
Context2K
Q4_K_M4.1 GB
MI
starmpcc Asclepius Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MP
Mpt 7b Chat
Mpt · mradermacher
Params6.65B
Context2K
Q4_K_M4.3 GB
TO
Tower Plus 2B
Tower · DZgas
Params2.61B
Context8K
Q4_K_M1.7 GB
TR
Triplex
Triplex · SciPhi
Params3.82B
Context128K
Q4_K_M2.4 GB
PE
PersianMind v1.0
Persianmind · QuantFactory
Params6.8B
Context2K
Q4_K_M4.1 GB
OU
outetts 0.3 1b
Outetts · cstr
Params1.19B
Context—
Smallest0.1 GB
CL
Claire 7B 0.1
Claire · mradermacher
Params7.22B
Context2K
Q4_K_M5.0 GB
PE
PersianMind v1.0
Persianmind · RichardErkhov
Params6.8B
Context2K
Q4_K_M4.1 GB
TR
Triplex
Triplex · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
OR
orca mini 13b i1
Orca · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
ME
MediX R1 8B
Medix · MBZUAI
Params8.19B
Context256K
Q4_K_M5.0 GB
ME
Merak 7B v4
Merak · mradermacher
Params7.24B
Context32K
Q4_K_M4.8 GB
DR
DRT O1 7B
Drt · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
TO
Tower Plus 9B
Tower · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB