GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 Flash Next Heretic Hybrid q4lean5
Qwen · the-shop
Params177B
Context256K
Smallest4.1 GB
Vision
ST
stable diffusion xl 1.0 turbo
Stable · gpustack
Params3.47B
Context—
Smallest3.9 GB
GGUF
LL
Higgs-Llama-3-70B
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
GGUF
MA
MagpieLM 4B Chat v0.1
Magpielm · QuantFactory
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
OP
allenai_open-instruct-human-mix-65b
Open · TheBloke
Params65B
Context2K
Q4_K_M39.3 GB
GGUF
HU
Huihui LFM2.5 8B A1B Abliterated
Huihui · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
GGUF
QW
Qwen3.8 Flash Next Avalon
Qwen · freriadoc
Params107B
Context256K
Smallest1.5 GB
ReasoningTool use
DE
DeepSeek V2 Lite Chat
DeepSeek · duyntnet
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
EX
EXAONE 4.0 32B
Exaone · bartowski
Params32B
Context128K
Q4_K_M19.3 GB
GGUF
GR
Grok Oss Revenant 70B
Grok · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
HE
HelpingAI flash
Helpingai · mradermacher
Params2.24B
Context4K
Q4_K_M1.4 GB
GGUF
MY
MythoLogic-13b
Mythologic · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
AU
Audar ASR V1 Flash
Audar · audarai
Params596M
Context64K
Q4_K_M0.4 GB
CodingVision
FA
Falcon3 3B Instruct Abliterated
Falcon · bartowski
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
DE
Deacon 34B
Deacon · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
QW
Qwen1.5-32B
Qwen · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
LF
LFM2 VL 1.6B
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
Vision
LL
Meta-Llama-3-70B-Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
NE
NVIDIA-Nemotron-3.5-Bolt-74B-DERISKED
Nemotron · freakyskittle
Params74B
Context1024K
Q4_K_M46.4 GB
Vision
QW
Qwen2.5 3B Instruct
Qwen · RagnarokChan
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
DE
deepseek-coder-6.7b-instruct
DeepSeek · duyntnet
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
SA
Sakura d1 3B HighQuality
webmp3
Params2.7B
Context—
Smallest0.0 GB
GGUF
HU
Hunyuan A13B Instruct
Hunyuan · bartowski
Params80.4B
Context256K
Q4_K_M49.3 GB
GGUF
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · QuantFactory
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
RO
Rocinante 12B v1.1 i1
Rocinante · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ME
medalpaca_medalpaca-13b
Medalpaca · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
MI
OpenMath-Mistral-7B-v0.1-hf
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LT
LTX2.3 10Eros 1.3
Ltx · Abiray
Params21B
Context—
Q4_K_M14.3 GB
GGUF
LL
Bio Medical MultiModal Llama 3 8B V1 i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Vision
MI
MiniMax M2.7
Minimax · mradermacher
Params230B
Context192K
Q4_K_M138.3 GB
GGUF

Keep browsing