GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
SN
snack models
Snack · TurtletortOS
Params1.73B
Context125K
Smallest1.0 GB
OP
OpenCodeInterpreter-DS-6.7B
Opencodeinterpreter · duyntnet
Params6.74B
Context16K
Q4_K_M4.1 GB
ER
10Eros Max ref2va Beta2
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
TR
Trinity Mini Base Pre Anneal
Trinity · mradermacher
Params26B
Context4K
Q4_K_M15.8 GB
LL
suzume llama 3 8B japanese i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
WA
wan22 fp8 i2v
Wan · wangkanai
Params14.3B
Context—
Smallest8.7 GB
SW
Swift Bonsai 2 27B Katana MTP
Swift · ayshinko
Params27.3B
Context256K
Smallest6.4 GB
QW
Qwen2 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
LL
nkpz_llama2-22b-daydreamer-v2
Llama · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
LL
llama-3-wissenschaft-8B-v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
RE
Reyna CoT 4B v0.1 i1
Reyna · mradermacher
Params3.95B
Context32K
Q4_K_M2.5 GB
SE
Seed X PPO 7B
Seed · Sangto
Params7.51B
Context32K
Smallest8.0 GB
GE
gemma-2b
Gemma · mlabonne
Params2.51B
Context8K
Q4_K_M1.5 GB
FL
PornMaster Klein 9b
Flux · fatangel420
Params8.19B
Context256K
Q4_K_M5.0 GB
MA
Magnum v2 72b
Magnum · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
CA
CaptainErisNebula 12B AOE v1
Captainerisnebula · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
AL
AlphaMonarch 7B imatrix
Alphamonarch · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 3B Instruct
Qwen · Alexs28
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Aether-Qwen2-0.5B-SFT-v0.0.1
Qwen · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
QW
Qwen2.5 Coder 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GE
models--google--gemma-2b
Gemma · MaziyarPanahi
Params2.51B
Context8K
Q4_K_M1.6 GB
SA
Sailor2 20B Chat
Sailor · duyntnet
Params19.2B
Context32K
Q4_K_M11.6 GB
QW
Qwen3.8-Flash-Next
Qwen · vultr
Params177B
Context256K
Q4_K_M131.0 GB
D1
d1 2B
AtomicChat
Params1.73B
Context125K
Q4_K_M1.1 GB
MI
timestral cpp
Mistral · mudler
Params123M
Context32K
Smallest0.0 GB
LL
Einstein-v6.1-Llama3-8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
MU
Muse Spark Open
Muse · AtomicChat
Params820B
Context1024K
Smallest174.9 GB
GO
Golddiamondgold Paperbliteration L33 70b
Golddiamondgold · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen2.5 72B Instruct
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
PO
Poppy Porpoise v0.7 L3 8B i1
Poppy · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB