GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
ME
MediX R1 8B
Medix · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
BA
BatchOnline GRPO 14B
Batchonline · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GR
KV Ground 8B BaseGuiOwl1.5 0315
Ground · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
QW
dolus v3 ep1 instruct
Qwen · bingbangboom
Params4.02B
Context256K
Q4_K_M2.5 GB
DR
DRT 14B i1
Drt · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
English Document OCR Qwen3.5 0.8B
Qwen · loay
Params752M
Context256K
Q4_K_M0.5 GB
MI
RAG KO Mixtral 7Bx2 v1.1
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
ME
MediX R1 30B
Medix · MBZUAI
Params30.5B
Context256K
Q4_K_M18.6 GB
ME
Merak 7B v3 Mini Orca Indo
Merak · asyafiqe
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama-3-Soliloquy-8B-v2
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
dolas zh finetuned
Qwen · ChisatoY
Params4.02B
Context256K
Q4_K_M2.5 GB
PL
Platypus2 70B
Platypus · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MK
MKLLM 7B Instruct i1
Mkllm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PL
Platypus2 13B
Platypus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
MiraTTS
Miratts · Mungert
Params507M
Context32K
Q4_K_M0.4 GB
GA
garage bAInd Stable Platypus2 13B
Garage · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
TR
Triplex i1
Triplex · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
WA
Ditto
Wan · vantagewithai
Params3.05B
Context—
Q4_K_M2.0 GB
DR
DRT 7B i1
Drt · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
CoT llama 2k 7b i1
Llama · mradermacher
Params6.86B
Context2K
Q4_K_M4.2 GB
TR
Triplex
Triplex · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GE
AriannaV6
Gemma · SurgeFF
Params11.9B
Context256K
Q4_K_M7.4 GB
XU
Xuhuo 7b v3b
XuhuoRenxian
Params7.5B
Context256K
Smallest6.2 GB
QW
Sakura 32B Qwen2beta v0.9
Qwen · SakuraLLM
Params32.5B
Context32K
Smallest12.2 GB
KO
Kosy Platypus2 13B i1
Kosy · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
IN
UI Ins 7B
Ins · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
DP
DPO Think 14B
Dpo · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
SA
Sakura SOLRCA Math Instruct DPO v1
Sakura · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
BI
BiMediX Bi i1
Bimedix · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
LL
pub llama 13B v6 i1
Llama · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB