GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
DE
Deepseek Math 7b Rl
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
QW
Qwen3.8 Flash Next
Qwen · Delgon
Params51.2B
Context—
Smallest28.8 GB
JE
Jev Vision 2B
Jev · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
MI
Mistral NeMo Minitron 8B Base
Mistral · RichardErkhov
Params8.41B
Context8K
Q4_K_M5.1 GB
LL
Llama-3-8B-Instruct-DPO-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LI
lightblue reranker 0.5 cont
Lightblue · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
YO
Youtu VL 4B Instruct
Youtu · tencent
Params4.9B
Context32K
Smallest5.2 GB
LL
openbuddy llama3.1 8b v22.2 131k
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 Nemotron 8B BRRM
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
HA
Hathor Tahsin L3 8B v0.9
Hathor · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
dolphin-2.9.1-llama-3-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen Qwen2.5 3B Instruct
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
NE
KO VoicePersona E4B
Nemotron · ThakiCloud
Params7.52B
Context64K
Q4_K_M5.3 GB
QW
Swift Qwen3.8 27b
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
LF
LFM2 VL 450M
Lfm · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
MI
Mistral Large Instruct 2407
Mistral · mmnga
Params123B
Context32K
Smallest26.0 GB
OP
openchat-3.5-0106
Openchat · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GL
Glm 4 9b Chat
GLM · mradermacher
Params9.4B
Context128K
Q4_K_M6.3 GB
AQ
AquilaChat2 34B
Aquilachat · TheBloke
Params33.7B
Context4K
Q4_K_M20.3 GB
KI
moonshotai.Kimi K2.7 Code
Kimi · DevQuasar
Params1030B
Context256K
Q4_K_M620.6 GB
QW
OPOD Qwen3 Omni 30B A3B
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
QW
Qwen3.8 Flash Next
Qwen · gguf
Params177B
Context256K
Q4_K_M119.6 GB
MI
Mistral Large Instruct 2407
Mistral · RichardErkhov
Params123B
Context128K
Q4_K_M73.2 GB
QW
Qwen Qwen2.5 Coder 14B Instruct
Qwen · sigmanih
Params14.8B
Context32K
Smallest7.3 GB
IN
Infracelestial 7B
Infracelestial · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
SC117 Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · jaromer
Params177B
Context256K
Smallest0.9 GB
LL
meta-llama-65b
Llama · TheBloke
Params65.3B
Context2K
Q4_K_M39.3 GB
QW
Synth v1 Qwen3.5 4b
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
MA
Magnum v2 123b
Magnum · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GL
Glm Edge 1.5b Chat
GLM · mradermacher
Params1.59B
Context2K
Q4_K_M1.0 GB