GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
openaudio
Mini · calcuis
Params695M
Context—
Q4_K_M1.0 GB
GGUF
ST
Stablelm Tuned Alpha 7b
Stablelm · mradermacher
Params7.87B
Context4K
Q4_K_M5.1 GB
GGUF
EV
EventLens 4B
Eventlens · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
Tool useVision
QW
Qwen3 VL 8B Instruct Minecraft MT En Zh
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
QW
Qwen3 4B Thinking 2507 SFT Uncensored
Qwen · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
NO
NorLlama 3B
Norllama · RichardErkhov
Params3.07B
Context2K
Q4_K_M3.0 GB
GGUF
DP
DPO Think 1.5B
Dpo · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingReasoningTool use
KU
Kurugai EEVE v1.1 i1
Kurugai · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
CA
Cartinoe5930 KoRAE 13b
Cartinoe · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
QW
Parlzstar_X_Merged
Qwen · JGZYES
Params4.02B
Context40K
Smallest2.5 GB
CodingReasoningTool use
KO
KoRAE 13b
Korae · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
CU
Custom KoLLM 13B v8 i1
Custom · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
LL
Llama-3-Soliloquy-8B-v2
Llama · backyardai
Params8.03B
Context24K
Q4_K_M4.9 GB
GGUF
RA
RAFT 7B
Raft · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
CA
calm3 22b RP v2
Calm · Aratako
Params22.5B
Context16K
Q4_K_M13.6 GB
Roleplay
RA
RAFT 1.5B
Raft · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingReasoningTool use
SO
solar 10.7b merged v0.1 i1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
DA
datascience coder 1.3b
Datascience · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
CH
Mr.Chatterbox 2.7B Chat
Chatterbox · tventurella
Params2.71B
Context2K
Smallest2.9 GB
GGUF
MI
splade disco human mistral i1
Mistral · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
GGUF
RA
RAFT 14B
Raft · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
GR
Grammar Synthesis Base V2
Grammar · mradermacher
Params248M
Context512
Q4_K_M0.2 GB
GGUF
ST
Stable Platypus2 13B
Stable · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OR
orca mini 7b i1
Orca · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MI
Mistral nemo ja rp v0.2
Mistral · ascktgcc
Params12.2B
Context1000K
Smallest7.1 GB
RoleplayTool use
TE
T.E 8.1 i1
mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
SA
Sakura SOLAR
Sakura · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
QW
ROLEPL AI v2 Qwen2.5 7B
Qwen · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
RoleplayTool use
ME
Merak 7B v4
Merak · Ichsan2895
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
Stablelm Tuned Alpha 3b
Stablelm · mradermacher
Params3.64B
Context4K
Q4_K_M2.3 GB
GGUF

Keep browsing