GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8 Flash Next Heretic Hybrid q4lean5
Qwen · the-shop
Params177B
Context256K
Smallest4.1 GB
ST
stable diffusion xl 1.0 turbo
Stable · gpustack
Params3.47B
Context—
Smallest3.9 GB
LL
Higgs-Llama-3-70B
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
MA
MagpieLM 4B Chat v0.1
Magpielm · QuantFactory
Params4.51B
Context128K
Q4_K_M2.8 GB
OP
allenai_open-instruct-human-mix-65b
Open · TheBloke
Params65B
Context2K
Q4_K_M39.3 GB
HU
Huihui LFM2.5 8B A1B Abliterated
Huihui · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
QW
Qwen3.8 Flash Next Avalon
Qwen · freriadoc
Params107B
Context256K
Smallest1.5 GB
DE
DeepSeek V2 Lite Chat
DeepSeek · duyntnet
Params15.7B
Context160K
Q4_K_M10.4 GB
EX
EXAONE 4.0 32B
Exaone · bartowski
Params32B
Context128K
Q4_K_M19.3 GB
GR
Grok Oss Revenant 70B
Grok · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
HE
HelpingAI flash
Helpingai · mradermacher
Params2.24B
Context4K
Q4_K_M1.4 GB
MY
MythoLogic-13b
Mythologic · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
AU
Audar ASR V1 Flash
Audar · audarai
Params596M
Context64K
Q4_K_M0.4 GB
FA
Falcon3 3B Instruct Abliterated
Falcon · bartowski
Params3.23B
Context32K
Q4_K_M2.0 GB
DE
Deacon 34B
Deacon · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
QW
Qwen1.5-32B
Qwen · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
LF
LFM2 VL 1.6B
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
LL
Meta-Llama-3-70B-Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
NE
NVIDIA-Nemotron-3.5-Bolt-74B-DERISKED
Nemotron · freakyskittle
Params74B
Context1024K
Q4_K_M46.4 GB
QW
Qwen2.5 3B Instruct
Qwen · RagnarokChan
Params3.09B
Context32K
Q4_K_M1.9 GB
DE
deepseek-coder-6.7b-instruct
DeepSeek · duyntnet
Params6.74B
Context16K
Q4_K_M4.1 GB
SA
Sakura d1 3B HighQuality
webmp3
Params2.7B
Context—
Smallest0.0 GB
HU
Hunyuan A13B Instruct
Hunyuan · bartowski
Params80.4B
Context256K
Q4_K_M49.3 GB
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · QuantFactory
Params15.7B
Context160K
Q4_K_M10.4 GB
RO
Rocinante 12B v1.1 i1
Rocinante · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ME
medalpaca_medalpaca-13b
Medalpaca · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
MI
OpenMath-Mistral-7B-v0.1-hf
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
LT
LTX2.3 10Eros 1.3
Ltx · Abiray
Params21B
Context—
Q4_K_M14.3 GB
LL
Bio Medical MultiModal Llama 3 8B V1 i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
MI
MiniMax M2.7
Minimax · mradermacher
Params230B
Context192K
Q4_K_M138.3 GB