GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B NVFP4 DFlash
Nemotron · magnitudedev
Params833M
Context1024K
Smallest1.2 GB
GGUF
LL
rombos Llama3 8B Instruct Replete Adapted
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
CodingTool use
MI
MiniMax H3
Minimax · Derdisirtlan
Params20.1B
Context—
Smallest11.4 GB
GGUF
CH
chronos hermes 13b v2
Chronos · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
Tool use
LL
llm compiler 7b
Llm · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
NE
Nemotron-3-Nano-30B-A3B
Nemotron · mudler
Params31.6B
Context1024K
Smallest18.8 GB
GGUF
YI
Hyperion 3.0 Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB
Coding
ST
sd3.5 large
Stable · gguf-org
Params695M
Context—
Smallest0.2 GB
GGUF
QW
MANGO Qwen3 Omni 30B A3B Instruct
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
ReasoningTool useVision
QW
Qwen2.5 3B Instruct
Qwen · legraphista
Params3.09B
Context32K
Smallest0.8 GB
Tool use
QW
ThinkingCap Qwen3.8 27B Uncensored Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Reasoning
LF
LFM2.5 Encoder 350M
Lfm · LiquidAI
Params354M
Context125K
Smallest0.2 GB
Coding
NE
Nemotron Cascade 14B Thinking
Nemotron · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Reasoning
QW
14B Qwen2.5 Freya x1
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
FA
Falcon3 3B Base
Falcon · bartowski
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
QW
QwQ 32B
Qwen · duyntnet
Params32.8B
Context40K
Q4_K_M19.9 GB
ReasoningTool use
MA
magnum 32b v2
Magnum · bartowski
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
FL
Hyper FLUX.1 dev
Flux · martintomov
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
LL
colossal llama 2 7b base
Llama · shaowenchen
Params7.04B
Context4K
Smallest3.0 GB
GGUF
NE
Nemotron Cascade 2 30B A3B
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
Reasoning
LF
Lfm2-700M
Lfm · unsloth
Params742M
Context32K
Q4_K_M0.5 GB
GGUF
LL
Llama-3-13B-Instruct-v0.1
Llama · QuantFactory
Params13.3B
Context8K
Q4_K_M8.1 GB
GGUF
QW
MathSmith DS Qwen 7B LongCoT
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
QW
Qwen2.5 72B 0.6x Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
TI
TimeLens 7B
Timelens · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
ER
10Eros Max
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
DU
DuckDB-NSQL-7B-v0.1
Duckdb · duyntnet
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
LL
Llama 4 Scout 17B 16E Instruct
Llama · lmstudio-community
Params108B
Context10240K
Q4_K_M67.5 GB
Vision

Keep browsing