GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 4B Singularity Max
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
VE
Vex Amber Fable 2.0
Vex · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
CodingReasoningTool use
AN
Antares 11b v2 i1
Antares · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
AN
Anime Speech Japanese Captioner
Anime · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
ReasoningTool use
LL
Llama-3-Lumimaid-70B-v0.1
Llama · backyardai
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
GI
Gilded Arsenic 12B i1
Gilded · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
LL
Asclepius Llama2 7B Pretraining Only
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
KO
KoSOLAR 10.7B kolon v2.0
Kosolar · mradermacher
Params10.8B
Context4K
Q4_K_M7.0 GB
GGUF
SO
SOVL-Mega-Mash-V2-L3-8B
Sovl · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
nvidia/Llama-3.1-8B-UltraLong-2M-Instruct
Llama · DevQuasar-13
Params8.04B
Context2096K
Q4_K_M4.9 GB
Tool use
TI
CohereLabs.tiny Aya Earth
Tiny · DevQuasar
Params3.35B
Context488K
Q4_K_M2.1 GB
GGUF
TH
TheSpice 7b FT v0.3.1 i1
Thespice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YU
YuE s1 7B anneal en icl
Yue · tensorblock
Params6.22B
Context16K
Smallest2.4 GB
GGUF
MO
Monarch 7B
Monarch · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
CHILLGuard 4B
Chillguard · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
MI
K2S3 Mistral 7b v1.42
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
RO
RoLlama3 8b Instruct DPO
Rollama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
NeuralPivot Mistral 13B i1
Mistral · mradermacher
Params13.3B
Context8K
Q4_K_M8.0 GB
GGUF
AL
AlphaMonarch dora i1
Alphamonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
AL
AlphaMonarch dora
Alphamonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
QW
Qwen3.5 4B Singularity Max
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
ST
Sao10K.L3 8B Stheno v3.2
Stheno · DevQuasar
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OP
OpenCAI 13B
Opencai · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NO
Nox Solar 10.7b v4 Kolon ITD 5 v1.0
Nox · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
AY
Aya Expanse 8b Ungated
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
RE
ReaderLM v2 i1
Readerlm · mradermacher
Params1.54B
Context501K
Q4_K_M1.0 GB
GGUF
SO
SOLAR 10.7B Instruct v1.0 128k
Solar · RichardErkhov
Params10.7B
Context128K
Q4_K_M6.5 GB
GGUF
TI
Tiny Pirate 1.1b v0.2
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
NL
Nllb 200 3.3B
Nllb · acceldium
Params3.87B
Context1K
Smallest7.8 GB
GGUF
MI
Rivermind 12B V1B Workspace
Mistral · TheDrummer
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use

Keep browsing