GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
ME
MediX R1 8B
Medix · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool useVision
BA
BatchOnline GRPO 14B
Batchonline · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
GR
KV Ground 8B BaseGuiOwl1.5 0315
Ground · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
Tool use
QW
dolus v3 ep1 instruct
Qwen · bingbangboom
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
DR
DRT 14B i1
Drt · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
QW
English Document OCR Qwen3.5 0.8B
Qwen · loay
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
MI
RAG KO Mixtral 7Bx2 v1.1
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
ME
MediX R1 30B
Medix · MBZUAI
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool useVision
ME
Merak 7B v3 Mini Orca Indo
Merak · asyafiqe
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama-3-Soliloquy-8B-v2
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
QW
dolas zh finetuned
Qwen · ChisatoY
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
PL
Platypus2 70B
Platypus · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MK
MKLLM 7B Instruct i1
Mkllm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PL
Platypus2 13B
Platypus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
MiraTTS
Miratts · Mungert
Params507M
Context32K
Q4_K_M0.4 GB
Tool use
GA
garage bAInd Stable Platypus2 13B
Garage · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TR
Triplex i1
Triplex · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
WA
Ditto
Wan · vantagewithai
Params3.05B
Context—
Q4_K_M2.0 GB
GGUF
DR
DRT 7B i1
Drt · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LL
CoT llama 2k 7b i1
Llama · mradermacher
Params6.86B
Context2K
Q4_K_M4.2 GB
GGUF
TR
Triplex
Triplex · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
GE
AriannaV6
Gemma · SurgeFF
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
XU
Xuhuo 7b v3b
XuhuoRenxian
Params7.5B
Context256K
Smallest6.2 GB
GGUF
QW
Sakura 32B Qwen2beta v0.9
Qwen · SakuraLLM
Params32.5B
Context32K
Smallest12.2 GB
GGUF
KO
Kosy Platypus2 13B i1
Kosy · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
IN
UI Ins 7B
Ins · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
DP
DPO Think 14B
Dpo · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
SA
Sakura SOLRCA Math Instruct DPO v1
Sakura · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
BI
BiMediX Bi i1
Bimedix · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
LL
pub llama 13B v6 i1
Llama · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF

Keep browsing