GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mistral-7B-Instruct-v0.3
Mistral · duyntnet
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · zw89
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
LF
LFM2 Audio 1.5B
Lfm · LiquidAI
Params281M
Context—
Smallest0.4 GB
GGUF
LL
llm-compiler-13b
Llm · legraphista
Params13B
Context16K
Smallest2.9 GB
GGUF
FO
Foundation Sec 8B Instruct
Foundation · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Replete-Coder-Llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
RA
raspberry 3B
Raspberry · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
DA
Daredevil 8B abliterated
Daredevil · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GR
Grok Oss Revenant 70B
Grok · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MA
ML2 123B Magnum Diamond
Magnum · Doctor-Shotgun
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
WE
WeMM Embedding 2B
Wemm · DreamBlooms
Params2.39B
Context256K
Q4_K_M1.6 GB
EmbeddingVision
RO
TheDrummer/Rocinante-12B-v1.1
Rocinante · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Llama-3_3-Nemotron-Super-49B-v1_5
Llama · Mungert
Params49.9B
Context128K
Q4_K_M30.6 GB
ReasoningTool use
QU
Quyen Plus v0.1 i1
Quyen · mradermacher
Params7.72B
Context32K
Q4_K_M4.8 GB
Tool use
QW
14B Qwen2.5 Kunou v1 i1
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
DE
Models Deepseek Ai DeepSeek V2.5
DeepSeek · MaziyarPanahi
Params236B
Context160K
Q4_K_M142.5 GB
Tool use
QW
Qwen3.8 Flash Next REAP128 86B Unity OpenCode
Qwen · talhasarac
Params86B
Context256K
Smallest48.9 GB
Tool use
LL
llama2 7b chat uncensored
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
GL
Glm 4 9b Chat
GLM · mradermacher
Params9.4B
Context128K
Q4_K_M6.3 GB
Tool use
CY
Cydonia 24B v2.1 i1
Cydonia · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
GE
gemma en ko 7b v0.1 i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
LF
LFM2 8B A1B Absolute Heresy
Lfm · MuXodious
Params8.34B
Context125K
Q4_K_M5.0 GB
Tool use
PL
Plamo 2 Translate
Plamo · mitmul
Params9.53B
Context10240K
Q4_K_M6.3 GB
GGUF
EU
euclaise_ferret_7b
Euclaise · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B compressed i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LF
LFM2.5 8B A1B Hermes Agentic Coder Abliterated v2
Lfm · DuoNeural
Params8.47B
Context125K
Q4_K_M5.2 GB
CodingTool use
NE
Nera Noctis 12B
Nera · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
qwen2.5 coder 7b pro merged
Qwen · Taimwe
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
LF
LFM2 350M Extract
Lfm · bartowski
Params354M
Context125K
Q4_K_M0.2 GB
Tool use
DR
Drex v1.5
Drex · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use

Keep browsing