GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
DE
Deepseek Coder 6.7b Base
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
EV
rombodawg_everyone-coder-33b-base
Everyone · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
MI
MiniMax-M3.1-Flash
Minimax · AtomicChat
Params426B
Context1024K
Smallest112.2 GB
QW
Qwen2.5 0.5B Instruct heretic
Qwen · saidutta69
Params494M
Context32K
Q4_K_M0.4 GB
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · legraphista
Params236B
Context160K
Smallest47.4 GB
ED
EdgeRock 4B
Edgerock · hkust-aaron
Params4.58B
Context256K
Q4_K_M2.9 GB
AI
airoboros l2 13B gpt4 1.4.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LF
LFM2.5 1.2B Instruct DSpark Draft v1
Lfm · LiquidAI
Params296M
Context125K
Q4_K_M0.2 GB
MU
Muse Spark Open 816B A42B
Muse · ggml-org
Params816B
Context—
Smallest0.8 GB
TR
Trinity Nano Preview
Trinity · arcee-ai
Params6.12B
Context128K
Q4_K_M3.8 GB
HE
HelpingAI-15B
Helpingai · mradermacher
Params15.3B
Context4K
Q4_K_M9.3 GB
OR
Orca 2 7B
Orca · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
WI
ehartford_wizardlm-13b-uncensored
Wizardlm · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
QW
Qwen Image 2.1 Uncensored
Qwen · daddysteven
Params7.12B
Context—
Q4_K_M4.6 GB
EX
EXAONE 3.5 7.8B Instruct
Exaone · LGAI-EXAONE
Params7.8B
Context32K
Q4_K_M4.8 GB
DO
Donnager 70B v1 i1
Donnager · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
QW
Qwen2.5 Math 72B Instruct
Qwen · bartowski
Params72.7B
Context4K
Q4_K_M47.4 GB
CO
CodeQwen1.5-7B-Chat
Codeqwen · bartowski
Params7.25B
Context64K
Q4_K_M4.7 GB
ST
stable code instruct 3b
Stable · QuantFactory
Params2.8B
Context16K
Q4_K_M1.7 GB
LF
LFM2.5 24B A2B Uncensored Heretic
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
MI
Mistral Medium 3.5 128B
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
RU
RusMind Malysh 4.7
Rusmind · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
FI
Fibo 2.0 Dev and Edit Turbo ComfyUI
Fibo · vantagewithai
Params8.23B
Context—
Q4_K_M6.2 GB
LI
LingBot 30B 3B GGUF ComfyUI
Lingbot · realrebelai
Params30B
Context—
Q4_K_M17.0 GB
MI
MiniMax M3
Minimax · bartowski
Params426B
Context1024K
Q4_K_M261.3 GB
MO
MotionBricks G1 GGML
Motionbricks · LocalAI-io
Params137M
Context—
Smallest0.0 GB
LF
LFM2.5 24B A2B
Lfm · WhiskyAKM
Params24B
Context128K
Smallest13.6 GB
SO
Solar Open 100B
Solar · mradermacher
Params103B
Context128K
Q4_K_M62.3 GB
MA
openaccess-ai-collective_manticore-13b
Manticore · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
WI
Wizard Vicuna 30B Uncensored
Wizard · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB