GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
FA
Gestura FastH3
Fastvideo · ZawShiShawn
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
ME
Medgemma-1.5-4B-It
Medgemma · unsloth
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
LL
Meta-Llama-3-120B-Instruct
Llama · lmstudio-community
Params122B
Context8K
Q4_K_M73.2 GB
GGUF
QW
Qwen3.8 Flash Next IQ3 S
Qwen · boxrunner
Params177B
Context256K
Smallest2.4 GB
Vision
QW
Qwen3.8 Flash Next IQ4 XS
Qwen · julianmb
Params177B
Context256K
Smallest4.1 GB
GGUF
MI
MiniMax M3.1 Flash Maya
Minimax · peasantsmith
Params426B
Context1024K
Smallest93.0 GB
ReasoningTool use
NE
Nvidia-Nemotron-3-Nano-Omni-30B-A3B-Reasoning
Nemotron · unsloth
Params31.6B
Context1024K
Q4_K_M23.9 GB
ReasoningVision
MI
MiniMax-M3.1-Flash
Minimax · LyJonathan
Params426B
Context1024K
Smallest94.8 GB
ReasoningTool useVision
PO
pony v7 base
Pony · Runware
Params6.86B
Context—
Smallest3.9 GB
GGUF
MI
MiniMax M3.1 Flash
Minimax · unsloth
Params426B
Context1024K
Smallest0.5 GB
GGUF
FL
flux 3 image klein base
Flux · unsloth
Params5.54B
Context—
Q4_K_M3.6 GB
GGUF
FL
flux 3 image klein sd
Flux · Abiray
Params5.55B
Context—
Q4_K_M3.3 GB
GGUF
OM
d1-omni-600M
Omni · LiquidAI
Params381M
Context125K
Smallest0.4 GB
Vision
PH
phi 2
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
Coding
MI
MiniMax H3 Singularity
Minimax · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
QW
qwen image 2.1 comfy
Qwen · t8star
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
LF
LFM2 700M
Lfm · LiquidAI
Params742M
Context125K
Q4_K_M0.5 GB
GGUF
QW
Flashnext Abliterated
Qwen · windowsxp811203
Params177B
Context256K
Q4_K_M119.2 GB
GGUF
FL
FluxDev8AnimeNsfw
Fluxdev · Zuntan
Params11.9B
Context—
Smallest6.8 GB
GGUF
QW
Qwen2.5 Coder 3B Instruct Abliterated
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
LL
Llama-4-Maverick-17B-128E-Instruct
Llama · unsloth
Params400B
Context1024K
Q4_K_M242.8 GB
Vision
LF
LFM2.5-1.2B-Thinking
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
ReasoningTool use
MU
Music Flamingo Hf
Music · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
ReasoningVision
KI
Kimi-K2.5
Kimi · unsloth
Params1030B
Context256K
Q4_K_M621.2 GB
GGUF
MU
Muse Spark Open 816B A42B
Muse · unsloth
Params816B
Context—
Smallest0.8 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · lmstudio-community
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
QW
Qwen3.8 Flash Next Uncensored ik llama
Qwen · ji-farthing
Params177B
Context—
Smallest2.2 GB
GGUF
FL
flux2 klein 4b uncensored text encoder
Flux · ponpoke
Params4B
Context—
Q4_K_M2.5 GB
Coding
GE
gemma4 12b with proj ltx 2.5
Gemma · elix3r
Params13.1B
Context—
Q4_K_M8.4 GB
CodingEmbedding
NV
NVIDIA MagpieTTS multilingual 357M
Nvidia · nvidia
Params284M
Context2K
Smallest0.3 GB
GGUF

Keep browsing