GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
Deepseek Math 7b Rl
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · Delgon
Params51.2B
Context—
Smallest28.8 GB
GGUF
JE
Jev Vision 2B
Jev · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
MI
Mistral NeMo Minitron 8B Base
Mistral · RichardErkhov
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
LL
Llama-3-8B-Instruct-DPO-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LI
lightblue reranker 0.5 cont
Lightblue · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
EmbeddingTool use
YO
Youtu VL 4B Instruct
Youtu · tencent
Params4.9B
Context32K
Smallest5.2 GB
Vision
LL
openbuddy llama3.1 8b v22.2 131k
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 Nemotron 8B BRRM
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
CodingReasoningTool use
HA
Hathor Tahsin L3 8B v0.9
Hathor · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
dolphin-2.9.1-llama-3-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
QW
Qwen Qwen2.5 3B Instruct
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
Tool use
NE
KO VoicePersona E4B
Nemotron · ThakiCloud
Params7.52B
Context64K
Q4_K_M5.3 GB
ReasoningTool useVision
QW
Swift Qwen3.8 27b
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
LF
LFM2 VL 450M
Lfm · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
Vision
MI
Mistral Large Instruct 2407
Mistral · mmnga
Params123B
Context32K
Smallest26.0 GB
GGUF
OP
openchat-3.5-0106
Openchat · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
GL
Glm 4 9b Chat
GLM · mradermacher
Params9.4B
Context128K
Q4_K_M6.3 GB
Tool use
AQ
AquilaChat2 34B
Aquilachat · TheBloke
Params33.7B
Context4K
Q4_K_M20.3 GB
GGUF
KI
moonshotai.Kimi K2.7 Code
Kimi · DevQuasar
Params1030B
Context256K
Q4_K_M620.6 GB
CodingReasoningTool use
QW
OPOD Qwen3 Omni 30B A3B
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
ReasoningTool use
QW
Qwen3.8 Flash Next
Qwen · gguf
Params177B
Context256K
Q4_K_M119.6 GB
ReasoningTool useVision
MI
Mistral Large Instruct 2407
Mistral · RichardErkhov
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
QW
Qwen Qwen2.5 Coder 14B Instruct
Qwen · sigmanih
Params14.8B
Context32K
Smallest7.3 GB
CodingTool use
IN
Infracelestial 7B
Infracelestial · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Roleplay
QW
SC117 Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · jaromer
Params177B
Context256K
Smallest0.9 GB
GGUF
LL
meta-llama-65b
Llama · TheBloke
Params65.3B
Context2K
Q4_K_M39.3 GB
GGUF
QW
Synth v1 Qwen3.5 4b
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
MA
Magnum v2 123b
Magnum · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
GL
Glm Edge 1.5b Chat
GLM · mradermacher
Params1.59B
Context2K
Q4_K_M1.0 GB
GGUF

Keep browsing