GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
MI
openaudio
Mini · calcuis
Params695M
Context—
Q4_K_M1.0 GB
ST
Stablelm Tuned Alpha 7b
Stablelm · mradermacher
Params7.87B
Context4K
Q4_K_M5.1 GB
EV
EventLens 4B
Eventlens · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
QW
Qwen3 VL 8B Instruct Minecraft MT En Zh
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen3 4B Thinking 2507 SFT Uncensored
Qwen · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
NO
NorLlama 3B
Norllama · RichardErkhov
Params3.07B
Context2K
Q4_K_M3.0 GB
DP
DPO Think 1.5B
Dpo · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
KU
Kurugai EEVE v1.1 i1
Kurugai · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
CA
Cartinoe5930 KoRAE 13b
Cartinoe · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
QW
Parlzstar_X_Merged
Qwen · JGZYES
Params4.02B
Context40K
Smallest2.5 GB
KO
KoRAE 13b
Korae · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
CU
Custom KoLLM 13B v8 i1
Custom · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
LL
Llama-3-Soliloquy-8B-v2
Llama · backyardai
Params8.03B
Context24K
Q4_K_M4.9 GB
RA
RAFT 7B
Raft · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
CA
calm3 22b RP v2
Calm · Aratako
Params22.5B
Context16K
Q4_K_M13.6 GB
RA
RAFT 1.5B
Raft · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
SO
solar 10.7b merged v0.1 i1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
DA
datascience coder 1.3b
Datascience · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
CH
Mr.Chatterbox 2.7B Chat
Chatterbox · tventurella
Params2.71B
Context2K
Smallest2.9 GB
MI
splade disco human mistral i1
Mistral · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
RA
RAFT 14B
Raft · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GR
Grammar Synthesis Base V2
Grammar · mradermacher
Params248M
Context512
Q4_K_M0.2 GB
ST
Stable Platypus2 13B
Stable · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
OR
orca mini 7b i1
Orca · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
MI
Mistral nemo ja rp v0.2
Mistral · ascktgcc
Params12.2B
Context1000K
Smallest7.1 GB
TE
T.E 8.1 i1
mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
SA
Sakura SOLAR
Sakura · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
ROLEPL AI v2 Qwen2.5 7B
Qwen · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
ME
Merak 7B v4
Merak · Ichsan2895
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
Stablelm Tuned Alpha 3b
Stablelm · mradermacher
Params3.64B
Context4K
Q4_K_M2.3 GB