GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen Image 2.1 Uncensored
Qwen · basileleuwa
Params7.12B
Context—
Q4_K_M4.6 GB
FA
Falcon H1 34B Instruct
Falcon · tiiuae
Params33.6B
Context256K
Q4_K_M20.3 GB
NE
Nemotron 3.5 Lightning 30B A3B Heretic Uncensored Q4 K M
Nemotron · mlasli
Params31.6B
Context1024K
Q4_K_M24.5 GB
BA
bagel dpo 20b v04 i1
Bagel · mradermacher
Params19.9B
Context32K
Q4_K_M12.7 GB
AI
airoboros l2 7b gpt4 1.4.1
Airoboros · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
Models Mistralai Mistral Large Instruct 2407
Mistral · MaziyarPanahi
Params123B
Context32K
Q4_K_M73.2 GB
LF
LFM2 VL 450M
Lfm · LiquidAI
Params354M
Context125K
Smallest0.2 GB
LL
saiga_llama3_8b
Llama · IlyaGusev
Params8B
Context8K
Smallest3.2 GB
MI
FastVideo FastH3 8 Step V2 ComfyUI
Minimax · vantagewithai
Params22B
Context—
Q4_K_M13.6 GB
QW
Swift 1.5 Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
LF
LFM2.5-24B-A2B
Lfm · mudler
Params24B
Context128K
Smallest7.7 GB
ZA
Zarafusionex 1.1 L2 7B
Zarafusionex · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
SU
Sulphur 2 distilled Q4 K M
Sulphur · coolthor
Params21B
Context—
Q4_K_M14.2 GB
QU
QuartetAnemoi-70B-t0.0001
Quartetanemoi · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
EH
ehartford_wizardlm-13b-v1.0-uncensored
Ehartford · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
AN
Anima
Anima · Bedovyy
Params2.09B
Context—
Q4_K_M1.4 GB
LF
LFM2.5 24B A2B Nyquant Q4 preview
Lfm · XGeorgeCostanzaX
Params24B
Context128K
Smallest12.0 GB
VI
Vietnamese 4B Chat abliterated
Vietnamese · N14QM
Params4.2B
Context256K
Q4_K_M2.7 GB
CY
TheDrummer Cydonia 24B v2
Cydonia · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
ST
stable code 3b
Stable · TheBloke
Params2.8B
Context16K
Q4_K_M1.7 GB
LL
Llama-3.1-Nemotron-Nano-8B-V1
Llama · unsloth
Params8B
Context128K
Q4_K_M4.9 GB
TE
Tencent Hy MT2 30B A3B
litigerking
Params30B
Context256K
Q4_K_M18.2 GB
NX
Nxcode-CQ-7B-orpo
Nxcode · legraphista
Params7.25B
Context64K
Smallest2.4 GB
KR
Kroma v0.3.1 Turbo OPD
Kroma · Abiray
Params12.8B
Context—
Q4_K_M8.8 GB
NE
Nemotron 3.5 Bolt 74B A9B CRACK 24GB
Nemotron · dealignai
Params74B
Context256K
Smallest1.0 GB
MI
Mistral Medium 3.5 128B
Mistral · bartowski
Params125B
Context256K
Q4_K_M78.4 GB
ST
stable-code-3b
Stable · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
MA
Magicoder S DS 6.7B
Magicoder · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
rombos Llama3 8B Instruct Replete Adapted i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB