GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
SN
snack models
Snack · TurtletortOS
Params1.73B
Context125K
Smallest1.0 GB
ReasoningTool useVision
OP
OpenCodeInterpreter-DS-6.7B
Opencodeinterpreter · duyntnet
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
ER
10Eros Max ref2va Beta2
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
TR
Trinity Mini Base Pre Anneal
Trinity · mradermacher
Params26B
Context4K
Q4_K_M15.8 GB
GGUF
LL
suzume llama 3 8B japanese i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
WA
wan22 fp8 i2v
Wan · wangkanai
Params14.3B
Context—
Smallest8.7 GB
GGUF
SW
Swift Bonsai 2 27B Katana MTP
Swift · ayshinko
Params27.3B
Context256K
Smallest6.4 GB
Vision
QW
Qwen2 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
LL
nkpz_llama2-22b-daydreamer-v2
Llama · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
GGUF
LL
llama-3-wissenschaft-8B-v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RE
Reyna CoT 4B v0.1 i1
Reyna · mradermacher
Params3.95B
Context32K
Q4_K_M2.5 GB
Coding
SE
Seed X PPO 7B
Seed · Sangto
Params7.51B
Context32K
Smallest8.0 GB
GGUF
GE
gemma-2b
Gemma · mlabonne
Params2.51B
Context8K
Q4_K_M1.5 GB
GGUF
FL
PornMaster Klein 9b
Flux · fatangel420
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool use
MA
Magnum v2 72b
Magnum · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
CA
CaptainErisNebula 12B AOE v1
Captainerisnebula · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
AL
AlphaMonarch 7B imatrix
Alphamonarch · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · Alexs28
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
QW
Aether-Qwen2-0.5B-SFT-v0.0.1
Qwen · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
Coding
QW
Qwen2.5 Coder 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
GE
models--google--gemma-2b
Gemma · MaziyarPanahi
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
SA
Sailor2 20B Chat
Sailor · duyntnet
Params19.2B
Context32K
Q4_K_M11.6 GB
GGUF
QW
Qwen3.8-Flash-Next
Qwen · vultr
Params177B
Context256K
Q4_K_M131.0 GB
ReasoningTool useVision
D1
d1 2B
AtomicChat
Params1.73B
Context125K
Q4_K_M1.1 GB
ReasoningTool useVision
MI
timestral cpp
Mistral · mudler
Params123M
Context32K
Smallest0.0 GB
GGUF
LL
Einstein-v6.1-Llama3-8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
MU
Muse Spark Open
Muse · AtomicChat
Params820B
Context1024K
Smallest174.9 GB
ReasoningTool useVision
GO
Golddiamondgold Paperbliteration L33 70b
Golddiamondgold · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
QW
Qwen2.5 72B Instruct
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
PO
Poppy Porpoise v0.7 L3 8B i1
Poppy · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing