GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
QW
Qwen3 30B A3B Gemini Pro High Reasoning 2507 ABLITERATED UNCENSORED
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Huihui Qwen3 VL 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
MI
Mistral7B-PairRM-SPPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
FR
FrogNano 4B 2609 GGUF jang imatrix
Frognano · roman220220
Params4.33B
Context256K
Smallest0.6 GB
MI
Nous-Hermes-2-Mixtral-8x7B-DPO
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
Qwen3.5 4B Abliterated
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GP
Huihui Gpt Oss 20b BF16 Abliterated v2
gpt-oss · huihui-ai
Params20.9B
Context128K
Smallest12.9 GB
KN
KnowLine 4B Gen5.5
Knowline · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
MA
Mage VL
Mage · JohnTdi
Params21M
Context256K
Q4_K_M2.7 GB
GU
Guanaco 13B Uncensored
Guanaco · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
OP
openchat_openchat_3.5
Openchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
Llama3.2 30B A3B II Dark Champion INSTRUCT Heretic Abliterated Uncensored
Llama · mradermacher
Params30B
Context128K
Q4_K_M18.4 GB
QW
Qwen2.5.1 Coder 1.5B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen3.8 27B Fable Distill
Qwen · TeichAI
Params27.3B
Context256K
Q4_K_M17.4 GB
LL
Llama 3.1 1 million cxt Dark Planet 8B
Llama · DavidAU
Params8B
Context1048K
Q4_K_M4.9 GB
QW
Qwen3.6 35B A3B DFlash
Qwen · magnitudedev
Params386M
Context40K
Smallest0.4 GB
MI
MiniCPM5 2B Claude Fable5 heretic
MiniCPM · saidutta69
Params2.52B
Context128K
Q4_K_M1.6 GB
QW
Qwen3 TTS 12Hz 0.6B Base
Qwen · mradermacher
Params600M
Context32K
Q4_K_M0.4 GB
QW
Qwen3.6 35B A3B DSV4Pro SFT GPT56Sol RL Agent
Qwen · nerkyor
Params34.7B
Context256K
Smallest14.3 GB
EU
Eurus 70b sft fixed i1
Eurus · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
QW
Qwen3.8 2B
Qwen · piskle
Params1.94B
Context256K
Q4_K_M1.3 GB
WA
Wan2.1 I2V 14B FusionX
Wan · QuantStack
Params16.4B
Context—
Q4_K_M10.8 GB
QW
Qwythos 9B v2
Qwythos · bartowski
Params9.2B
Context1024K
Q4_K_M6.0 GB
QW
Imperum CybersecurityLLM v1.0
Qwen · IMPERUM
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
Hermes 2 Pro Mistral 7B
Mistral · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
LI
H2O Lightning 4b
Lightning · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
CA
CAJAL 4B Merged 16bit
Cajal · Agnuxo
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.5 0.8B Japanese SFT v2
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
LL
llava 1.6
LLaVA · cmp-nct
Params7.24B
Context32K
Smallest4.4 GB
SM
SmolLM2 135M Instruct
SmolLM · lmstudio-community
Params135M
Context8K
Q4_K_M0.1 GB