GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen Image 2.1 Uncensored
Qwen · wazimondo
Params7.12B
Context—
Q4_K_M4.6 GB
LL
toxicqa Llama2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
NE
Newton 7B i1
Newton · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
QW
Qwen Image 2.1 SYCL Turbo
Qwen · Frosty40
Params7.12B
Context—
Smallest5.1 GB
TU
turbcat instruct 72b i1
Turbcat · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
FA
Falcon3 10B Instruct
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
MI
minicpm5 1B GLM 5.2 Agentic v8
MiniCPM · hudsongouge
Params1.08B
Context128K
Q4_K_M0.7 GB
CO
Cookie 7B i1
Cookie · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
ZA
Zarablend MX L2 7B
Zarablend · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Meta Llama 3 70B Instruct GGUF v2
Llama · QuantFactory
Params70.6B
Context8K
Q4_K_M42.5 GB
LF
LFM2.5 VL 450M heretic
Lfm · saidutta69
Params354M
Context125K
Q4_K_M0.2 GB
HU
Huihui IQuest Coder V1 40B Instruct Abliterated
Huihui · mradermacher
Params39.8B
Context128K
Q4_K_M24.0 GB
KO
Koala 13B HF
Koala · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
FA
fasth3 dense v1 q4 0
Fastvideo · AbrahamPJ
Params20.1B
Context—
Smallest11.6 GB
OP
OpenELM 1_1B Instruct Fix Nan
Openelm · mradermacher
Params1.08B
Context2K
Q4_K_M0.7 GB
NE
AceReason Nemotron 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
LF
LFM2.5 24B A2B Uncensored2
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B NVFP4 LiLiCorr
Nemotron · magnitudedev
Params1.66B
Context1024K
Smallest1.4 GB
QW
Qwen3.5-4B-Abliterated-Claude-4.6-Opus-Reasoning-Distilled
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Einstein-v7-Qwen2-7B
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
OP
openbuddy-zen-56b-v21.2-32k
Openbuddy · mradermacher
Params56.7B
Context128K
Q4_K_M34.0 GB
HY
HyperCLOVAX SEED Omni 8B
Hyperclovax · naver-ellm
Params8.6B
Context8K
Q4_K_M5.3 GB
LL
Llama3 TAIDE LX 8B Chat Alpha1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GI
Gilgamesh 72B
Gilgamesh · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
MI
MiniMax H3
Minimax · myhuggingbb
Params20.1B
Context—
Q4_K_M18.2 GB
EX
EXAONE-Deep-7.8B
Exaone · LGAI-EXAONE
Params7.8B
Context32K
Q4_K_M4.8 GB
QW
Swift1.5-Qwen3.8-Flash-Next
Qwen · poisonxa
Params180B
Context256K
Smallest83.2 GB
ST
stable diffusion v3 5 large
Stable · gpustack
Params13.9B
Context—
Smallest8.3 GB
DE
Delexa-Instruct-V0.1-7b
Delexa · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
EL
EleMo V3
Elemo · Earlychildhoodeducation
Params27B
Context256K
Q4_K_M16.5 GB