GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3 8B Heretic
Qwen · saidutta69
Params8.19B
Context40K
Q4_K_M5.0 GB
KR
Krea 2 Raw
Krea · vantagewithai
Params12.9B
Context—
Q4_K_M7.5 GB
QW
Dongfangshuo Qwen3.8 27B NSFW v4
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
MI
Codestral-22B-v0.1
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
TI
TIPO 200M Ft
Tipo · KBlueLeaf
Params203M
Context2K
Smallest0.4 GB
HU
HunyuanVideo
Hunyuanvideo · city96
Params12.8B
Context—
Q4_K_M7.9 GB
LF
LFM2 350M
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
RO
Rocinante 12B v1.1
Rocinante · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
RO
Rocinante 12B v1.1
Rocinante · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
OpenYourMind_Minimax M3 Abliterated Clean
Minimax · Sica-Quants-2
Params426B
Context1024K
Smallest155.0 GB
FA
FastH3 V2 GGUFs
Fastvideo · realrebelai
Params35B
Context—
Q4_K_M14.6 GB
YI
brucethemoose_yi-34b-200k-dare-megamerge-v8
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GE
Nz Gemma4 12B LTX25
Gemma · Rootport
Params13.1B
Context—
Q4_K_M9.2 GB
LF
LFM2.5 Embedding 350M
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
IN
IndexTTS 2.5
Indextts · Richasy
Params—
Context—
Smallest7.9 GB
ST
stable code 3b
Stable · stabilityai
Params2.8B
Context16K
Smallest2.0 GB
DE
deepseek llm 7B chat
DeepSeek · TheBloke
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
deepseek-ai_deepseek-coder-5.7bmqa-base
DeepSeek · TheBloke
Params5.7B
Context16K
Q4_K_M3.4 GB
QW
Qwen3.5 27B WebNovel Writer Zh
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
CO
Cotype Nano
Cotype · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Swift Qwen3.8 Flash Next
Qwen · bartowski
Params177B
Context256K
Q4_K_M125.6 GB
ME
Medgemma-27B-It
Medgemma · unsloth
Params27B
Context128K
Q4_K_M16.5 GB
GL
glm-4-9b-chat
GLM · legraphista
Params9.4B
Context128K
Smallest4.0 GB
QW
Agnes 3.0 Qwen
Qwen · bartowski
Params180B
Context1024K
Q4_K_M127.1 GB
QW
Qwen2.5 Vl 7b Cam Motion
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Llama 8B Heretic
DeepSeek · saidutta69
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · lmstudio-community
Params3.09B
Context32K
Q4_K_M1.9 GB
FL
krea
Flux · calcuis
Params11.9B
Context—
Q4_K_M7.1 GB
QW
JiRackDeltaNet 180b
Qwen · CMSManhattan
Params177B
Context256K
Q4_K_M119.2 GB
ME
Medgemma 27b It
Medgemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB