GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.5 9B Uncensored HauhauCS Aggressive MTP GGUF NVFP4
Qwen · AIconjured
Params456M
Context256K
Smallest6.3 GB
NE
Nemotron Cascade 8B Thinking
Nemotron · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
LF
Lfm2.5 2.6b Fable5 Coding Agent Heretic
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
DE
Deepseek Coder 6.7b Instruct
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
CO
Cosmos Reason2 2b
Cosmos · apolo13x
Params2.03B
Context256K
Q4_K_M1.3 GB
QW
Qwen2.5 7B Instruct Heretic
Qwen · saidutta69
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
dolphin 2.9 llama3 8b
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
AU
Audar ASR V1 Turbo
Audar · audarai
Params2.03B
Context64K
Q4_K_M1.3 GB
QW
Qwen2.5 VL 72B Instruct
Qwen · lmstudio-community
Params72.7B
Context125K
Q4_K_M47.4 GB
AU
Audar TTS V1 Turbo
Audar · audarai
Params1.64B
Context32K
Q4_K_M1.1 GB
MY
MythoLogic Mini 7B
Mythologic · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
NE
Nemotron 3 Super 120B A12B
Nemotron · lmstudio-community
Params121B
Context1024K
Q4_K_M86.1 GB
YI
01-ai_yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
WI
monero_wizardlm-uncensored-supercot-storytelling-30b
Wizardlm · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
DR
drama-3
Drama · pentacoxian-dev
Params—
Context—
Smallest22.5 GB
OP
openbuddy-zen-56b-v21.2-32k
Openbuddy · mradermacher
Params56.7B
Context128K
Q4_K_M34.0 GB
MI
Mistral Medium 3.5 128B Eschaton Uncensored
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
ST
stable-code-instruct-3b
Stable · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
QW
Qwen Image 2.1 Turbo
Qwen · molbal
Params7.12B
Context—
Q4_K_M4.5 GB
QW
Qwen2.5-Vl-72B-Instruct
Qwen · unsloth
Params72.7B
Context125K
Q4_K_M47.4 GB
PA
Palmyra Fin 70B 32K
Palmyra · legraphista
Params70.6B
Context32K
Smallest15.3 GB
QW
Qwen3.8 Flash Next
Qwen · AnonimousA
Params132B
Context256K
Smallest61.5 GB
FA
Falcon3 10B Instruct
Falcon · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
RY
RynnUnify Agentic Reasoner
Rynnunify · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
AS
asclepius-13b
Asclepius · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
OP
openPangu 2.0 Flash
Openpangu · mrexodia
Params91.6B
Context512K
Q4_K_M55.3 GB
LT
LTX 2.5 Distilled
Ltx · FenomAI
Params21B
Context—
Q4_K_M15.7 GB
MI
Trinity 2 Codestral 22B v0.2
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
FL
FLUX.1 dev
Flux · second-state
Params123M
Context—
Smallest0.1 GB
AN
Anima base v1.0
Anima · Abiray
Params2.09B
Context—
Q4_K_M1.4 GB