GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
QW
Qwen3.5 4B Singularity Max
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
VE
Vex Amber Fable 2.0
Vex · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
AN
Antares 11b v2 i1
Antares · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
AN
Anime Speech Japanese Captioner
Anime · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
LL
Llama-3-Lumimaid-70B-v0.1
Llama · backyardai
Params70.6B
Context8K
Q4_K_M42.5 GB
GI
Gilded Arsenic 12B i1
Gilded · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Asclepius Llama2 7B Pretraining Only
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
KO
KoSOLAR 10.7B kolon v2.0
Kosolar · mradermacher
Params10.8B
Context4K
Q4_K_M7.0 GB
SO
SOVL-Mega-Mash-V2-L3-8B
Sovl · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
nvidia/Llama-3.1-8B-UltraLong-2M-Instruct
Llama · DevQuasar-13
Params8.04B
Context2096K
Q4_K_M4.9 GB
TI
CohereLabs.tiny Aya Earth
Tiny · DevQuasar
Params3.35B
Context488K
Q4_K_M2.1 GB
TH
TheSpice 7b FT v0.3.1 i1
Thespice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
YU
YuE s1 7B anneal en icl
Yue · tensorblock
Params6.22B
Context16K
Smallest2.4 GB
MO
Monarch 7B
Monarch · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
CH
CHILLGuard 4B
Chillguard · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
MI
K2S3 Mistral 7b v1.42
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
RO
RoLlama3 8b Instruct DPO
Rollama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
NeuralPivot Mistral 13B i1
Mistral · mradermacher
Params13.3B
Context8K
Q4_K_M8.0 GB
AL
AlphaMonarch dora i1
Alphamonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
AlphaMonarch dora
Alphamonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3.5 4B Singularity Max
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ST
Sao10K.L3 8B Stheno v3.2
Stheno · DevQuasar
Params8.03B
Context8K
Q4_K_M4.9 GB
OP
OpenCAI 13B
Opencai · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
NO
Nox Solar 10.7b v4 Kolon ITD 5 v1.0
Nox · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
AY
Aya Expanse 8b Ungated
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
RE
ReaderLM v2 i1
Readerlm · mradermacher
Params1.54B
Context501K
Q4_K_M1.0 GB
SO
SOLAR 10.7B Instruct v1.0 128k
Solar · RichardErkhov
Params10.7B
Context128K
Q4_K_M6.5 GB
TI
Tiny Pirate 1.1b v0.2
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
NL
Nllb 200 3.3B
Nllb · acceldium
Params3.87B
Context1K
Smallest7.8 GB
MI
Rivermind 12B V1B Workspace
Mistral · TheDrummer
Params12.2B
Context128K
Q4_K_M7.5 GB