GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B NVFP4 DFlash
Nemotron · magnitudedev
Params833M
Context1024K
Smallest1.2 GB
LL
rombos Llama3 8B Instruct Replete Adapted
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
MI
MiniMax H3
Minimax · Derdisirtlan
Params20.1B
Context—
Smallest11.4 GB
CH
chronos hermes 13b v2
Chronos · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
LL
llm compiler 7b
Llm · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
NE
Nemotron-3-Nano-30B-A3B
Nemotron · mudler
Params31.6B
Context1024K
Smallest18.8 GB
YI
Hyperion 3.0 Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB
ST
sd3.5 large
Stable · gguf-org
Params695M
Context—
Smallest0.2 GB
QW
MANGO Qwen3 Omni 30B A3B Instruct
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
QW
Qwen2.5 3B Instruct
Qwen · legraphista
Params3.09B
Context32K
Smallest0.8 GB
QW
ThinkingCap Qwen3.8 27B Uncensored Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
LF
LFM2.5 Encoder 350M
Lfm · LiquidAI
Params354M
Context125K
Smallest0.2 GB
NE
Nemotron Cascade 14B Thinking
Nemotron · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
14B Qwen2.5 Freya x1
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
FA
Falcon3 3B Base
Falcon · bartowski
Params3.23B
Context32K
Q4_K_M2.0 GB
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context8K
Q4_K_M4.7 GB
QW
QwQ 32B
Qwen · duyntnet
Params32.8B
Context40K
Q4_K_M19.9 GB
MA
magnum 32b v2
Magnum · bartowski
Params32.5B
Context32K
Q4_K_M19.7 GB
FL
Hyper FLUX.1 dev
Flux · martintomov
Params11.9B
Context—
Q4_K_M6.9 GB
LL
colossal llama 2 7b base
Llama · shaowenchen
Params7.04B
Context4K
Smallest3.0 GB
NE
Nemotron Cascade 2 30B A3B
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
LF
Lfm2-700M
Lfm · unsloth
Params742M
Context32K
Q4_K_M0.5 GB
LL
Llama-3-13B-Instruct-v0.1
Llama · QuantFactory
Params13.3B
Context8K
Q4_K_M8.1 GB
QW
MathSmith DS Qwen 7B LongCoT
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen2.5 72B 0.6x Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
TI
TimeLens 7B
Timelens · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
ER
10Eros Max
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
DU
DuckDB-NSQL-7B-v0.1
Duckdb · duyntnet
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama 4 Scout 17B 16E Instruct
Llama · lmstudio-community
Params108B
Context10240K
Q4_K_M67.5 GB