GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
Deepseek Coder 6.7b Base
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
EV
rombodawg_everyone-coder-33b-base
Everyone · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
MI
MiniMax-M3.1-Flash
Minimax · AtomicChat
Params426B
Context1024K
Smallest112.2 GB
ReasoningTool useVision
QW
Qwen2.5 0.5B Instruct heretic
Qwen · saidutta69
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · legraphista
Params236B
Context160K
Smallest47.4 GB
Coding
ED
EdgeRock 4B
Edgerock · hkust-aaron
Params4.58B
Context256K
Q4_K_M2.9 GB
Coding
AI
airoboros l2 13B gpt4 1.4.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LF
LFM2.5 1.2B Instruct DSpark Draft v1
Lfm · LiquidAI
Params296M
Context125K
Q4_K_M0.2 GB
GGUF
MU
Muse Spark Open 816B A42B
Muse · ggml-org
Params816B
Context—
Smallest0.8 GB
GGUF
TR
Trinity Nano Preview
Trinity · arcee-ai
Params6.12B
Context128K
Q4_K_M3.8 GB
GGUF
HE
HelpingAI-15B
Helpingai · mradermacher
Params15.3B
Context4K
Q4_K_M9.3 GB
GGUF
OR
Orca 2 7B
Orca · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
WI
ehartford_wizardlm-13b-uncensored
Wizardlm · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
QW
Qwen Image 2.1 Uncensored
Qwen · daddysteven
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
EX
EXAONE 3.5 7.8B Instruct
Exaone · LGAI-EXAONE
Params7.8B
Context32K
Q4_K_M4.8 GB
GGUF
DO
Donnager 70B v1 i1
Donnager · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
QW
Qwen2.5 Math 72B Instruct
Qwen · bartowski
Params72.7B
Context4K
Q4_K_M47.4 GB
GGUF
CO
CodeQwen1.5-7B-Chat
Codeqwen · bartowski
Params7.25B
Context64K
Q4_K_M4.7 GB
GGUF
ST
stable code instruct 3b
Stable · QuantFactory
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
LF
LFM2.5 24B A2B Uncensored Heretic
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
GGUF
MI
Mistral Medium 3.5 128B
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
ReasoningTool useVision
RU
RusMind Malysh 4.7
Rusmind · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
FI
Fibo 2.0 Dev and Edit Turbo ComfyUI
Fibo · vantagewithai
Params8.23B
Context—
Q4_K_M6.2 GB
GGUF
LI
LingBot 30B 3B GGUF ComfyUI
Lingbot · realrebelai
Params30B
Context—
Q4_K_M17.0 GB
GGUF
MI
MiniMax M3
Minimax · bartowski
Params426B
Context1024K
Q4_K_M261.3 GB
Vision
MO
MotionBricks G1 GGML
Motionbricks · LocalAI-io
Params137M
Context—
Smallest0.0 GB
GGUF
LF
LFM2.5 24B A2B
Lfm · WhiskyAKM
Params24B
Context128K
Smallest13.6 GB
GGUF
SO
Solar Open 100B
Solar · mradermacher
Params103B
Context128K
Q4_K_M62.3 GB
GGUF
MA
openaccess-ai-collective_manticore-13b
Manticore · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
WI
Wizard Vicuna 30B Uncensored
Wizard · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF

Keep browsing