GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
GR
Granite 8b Code Instruct 4k
Granite · RichardErkhov
Params8.05B
Context4K
Q4_K_M4.9 GB
QW
Qwen3 VL 32B Instruct Ultra Uncensored Heretic
Qwen · llmfan46
Params32.8B
Context256K
Q4_K_M19.8 GB
HY
HyperNova 60B
Hypernova · mradermacher
Params58.7B
Context128K
Q4_K_M40.7 GB
QW
WhereOPD Qwen3.5 4B
Qwen · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ST
L3-8B-Stheno-v3.2
Stheno · DavidAU
Params8B
Context8K
Q4_K_M4.9 GB
OP
openthaigpt 1.0.0 beta 13B chat
Openthaigpt · TheBloke
Params13.1B
Context4K
Q4_K_M7.9 GB
DE
DeepNarra-Paham-Experimental
Deepnarra · DeepNarra
Params952M
Context2K
Smallest0.3 GB
DE
Qwen3 30B A3B Deepseek Distill Instruct 2507
DeepSeek · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.6 27B abliterated
Qwen · wangzhang
Params27B
Context256K
Q4_K_M16.5 GB
MI
MiniCPM5-2B-Claude-Fable5-1-Thinking
MiniCPM · GnLOLot
Params2.52B
Context128K
Q4_K_M1.6 GB
QW
Qwen3 4B
Qwen · enacimie
Params4.02B
Context40K
Q4_K_M5.0 GB
HO
Sakura K2 Horizon 7B
Horizon · webmp3
Params9B
Context512K
Smallest3.8 GB
MI
MixTaoTruthful-13B-slerp
Mixtaotruthful · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
DE
Qwen2.5 MOE 2X1.5B DeepSeek Uncensored Censored 4B
DeepSeek · DavidAU
Params4.1B
Context128K
Q4_K_M2.5 GB
QW
dnotitia_Smoothie Qwen3 4B
Qwen · Alcoft
Params4B
Context40K
Q4_K_M2.4 GB
QW
DPO Trained Qwen2.5 Python Coder 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
MO
nightmare moss image
Moss · AbrahamPJ
Params5.08B
Context—
Smallest3.2 GB
QW
DarkIdol Qwen3.8 27B v1.1
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.5 2B Uncensored Zero Refusal SOMA
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen3 Coder Next Uncensored Heretic
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
DE
Deacon-34B
Deacon · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
DA
Dark Scarlett 27B v2.0
Dark · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
MI
models--mistralai--Mixtral-8x22B-Instruct-v0.1
Mistral · MaziyarPanahi
Params141B
Context64K
Q4_K_M85.6 GB
CO
Yi Coder 1.5B
Coder · lmstudio-community
Params1.48B
Context128K
Q4_K_M1.0 GB
RE
REBEL-OpenChat-3.5
Rebel · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
Sakura MiniCPM V 4.7 1B Uncensored
MiniCPM · webmp3
Params1.01B
Context256K
Q4_K_M0.7 GB
MU
Muse Glimmer 30B AZ Focus
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3 14B NSFW FDA
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3 1.7B
Qwen · rippertnt
Params2.03B
Context40K
Q4_K_M1.3 GB