GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
AC
E1 AceReason 14B
Acereason · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CO
Command A Reasoning 08 2025
Command · bartowski
Params111B
Context488K
Q4_K_M67.1 GB
LL
PatronusAI Llama 3 Patronus Lynx 8B Instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
CH
chronos 70b v2 i1
Chronos · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
BE
BeagSake 7B i1
Beagsake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
chargoddard_mixtralnt-4x7b-test
Mistral · TheBloke
Params24.2B
Context32K
Q4_K_M13.6 GB
PA
jackrabbit-110m-ro.f32
Parakeet · surogate
Params122M
Context—
Smallest0.1 GB
OC
Octen WebGR 4B
Octen · mradermacher
Params4.36B
Context32K
Q4_K_M2.8 GB
QW
Qwen2.5 Aloe Beta 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
CO
c4ai command r v01
Command R · andrewcanis
Params35B
Context128K
Q4_K_M21.5 GB
MI
Mira 12b
Mira · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
LL
Llama 3.1 Nemotron 8B UltraLong 4M Instruct i1
Llama · mradermacher
Params8.04B
Context4192K
Q4_K_M4.9 GB
ST
StartLux Decision v1 27B
Startlux · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CR
Crystal 0.8b
Crystal · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
EU
L3 70B Euryale v2.1
Euryale · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Sao10K/Llama-3.1-8B-Stheno-v3.4
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
OR
Ortho-SOVL-8B-L3
Ortho · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
AN
Antares 11b v1 i1
Antares · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
AY
Ayam-2x8B
Ayam · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
GE
gemmaExtract
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
LL
Llama 3.1 8B UltraLong 2M Instruct
Llama · bartowski
Params8.04B
Context2096K
Q4_K_M4.9 GB
LL
Llama DNA 1.0 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
PE
perlthoughts_starling-lm-alpha-8x7b-moe
Perlthoughts · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
OP
OpenLLM Ro RoLlama2 7b Instruct 2024 05 14
Openllm · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
SO
SOVLish-Maid-L3-8B
Sovlish · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
KU
Kunoichi DPO v2 7B
Kunoichi · QuantFactory
Params7.24B
Context8K
Q4_K_M4.4 GB
OU
OuteTTS 0.2 500M
Outetts · BricksDisplay
Params85M
Context—
Q4_K_M0.1 GB
MA
Magrathic 12B
Magrathic · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
TO
undi95_toppy-m-7b
Toppy · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LU
LUNA SOLARkrautLM Instruct i1
Luna · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB