GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 9B Uncensored HauhauCS Aggressive MTP GGUF NVFP4
Qwen · AIconjured
Params456M
Context256K
Smallest6.3 GB
Vision
NE
Nemotron Cascade 8B Thinking
Nemotron · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
Reasoning
LF
Lfm2.5 2.6b Fable5 Coding Agent Heretic
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
Tool use
DE
Deepseek Coder 6.7b Instruct
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
CO
Cosmos Reason2 2b
Cosmos · apolo13x
Params2.03B
Context256K
Q4_K_M1.3 GB
ReasoningVision
QW
Qwen2.5 7B Instruct Heretic
Qwen · saidutta69
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LL
dolphin 2.9 llama3 8b
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
CodingTool use
AU
Audar ASR V1 Turbo
Audar · audarai
Params2.03B
Context64K
Q4_K_M1.3 GB
CodingVision
QW
Qwen2.5 VL 72B Instruct
Qwen · lmstudio-community
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
AU
Audar TTS V1 Turbo
Audar · audarai
Params1.64B
Context32K
Q4_K_M1.1 GB
GGUF
MY
MythoLogic Mini 7B
Mythologic · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
NE
Nemotron 3 Super 120B A12B
Nemotron · lmstudio-community
Params121B
Context1024K
Q4_K_M86.1 GB
GGUF
YI
01-ai_yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
WI
monero_wizardlm-uncensored-supercot-storytelling-30b
Wizardlm · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
DR
drama-3
Drama · pentacoxian-dev
Params—
Context—
Smallest22.5 GB
GGUF
OP
openbuddy-zen-56b-v21.2-32k
Openbuddy · mradermacher
Params56.7B
Context128K
Q4_K_M34.0 GB
GGUF
MI
Mistral Medium 3.5 128B Eschaton Uncensored
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
Reasoning
ST
stable-code-instruct-3b
Stable · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
QW
Qwen Image 2.1 Turbo
Qwen · molbal
Params7.12B
Context—
Q4_K_M4.5 GB
GGUF
QW
Qwen2.5-Vl-72B-Instruct
Qwen · unsloth
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
PA
Palmyra Fin 70B 32K
Palmyra · legraphista
Params70.6B
Context32K
Smallest15.3 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · AnonimousA
Params132B
Context256K
Smallest61.5 GB
GGUF
FA
Falcon3 10B Instruct
Falcon · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
RY
RynnUnify Agentic Reasoner
Rynnunify · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool use
AS
asclepius-13b
Asclepius · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
OP
openPangu 2.0 Flash
Openpangu · mrexodia
Params91.6B
Context512K
Q4_K_M55.3 GB
GGUF
LT
LTX 2.5 Distilled
Ltx · FenomAI
Params21B
Context—
Q4_K_M15.7 GB
GGUF
MI
Trinity 2 Codestral 22B v0.2
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
FL
FLUX.1 dev
Flux · second-state
Params123M
Context—
Smallest0.1 GB
GGUF
AN
Anima base v1.0
Anima · Abiray
Params2.09B
Context—
Q4_K_M1.4 GB
GGUF

Keep browsing