GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LA
calderaai_30b-lazarus
Lazarus · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
MI
MiniMax M2.7
Minimax · dennny123
Params229B
Context192K
Q4_K_M138.3 GB
ReasoningTool use
RY
Ryeta 0
Ryeta · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
CH
ChimeraLlama 3 8B v2 i1
Chimerallama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TE
Teuken 7B instruct research v0.4
Teuken · QuantFactory
Params7.45B
Context4K
Q4_K_M5.0 GB
GGUF
SE
SeaLLM-7B-v2.5
Seallm · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
SE
SeaLLM 7B Chat
Seallm · parinzee
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
GR
Grok Oss Apollyon 8B Heretic
Grok · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SA
Sarvam 2b v0.5
Sarvam · mradermacher
Params2.51B
Context8K
Q4_K_M1.5 GB
GGUF
CA
Nitral AI Captain Eris Violet GRPO v0.420
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Aether-Qwen2-0.5B-SFT-v0.0.2
Qwen · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
Coding
GE
Gemma 3 4b It Heretic
Gemma · saidutta69
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
YA
YandexGPT 5 Lite 8B Instruct
Yandexgpt · mradermacher
Params8.04B
Context32K
Q4_K_M4.9 GB
Tool use
LL
rombos Replete Coder Llama3 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
OP
openNemo 9B abliterated
Opennemo · empero-ai
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
NE
nvidia__NVIDIA Nemotron Nano 9B v2
Nemotron · dominguesm
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
HI
hijin-financial-specialist-lora
Hijin · Aktnyl
Params—
Context—
Smallest0.0 GB
GGUF
IR
Iridium 72B v0.1
Iridium · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
VI
lmsys_vicuna-33b-v1.3
Vicuna · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
FL
Flux2 Klein 9B True V2
Flux · Leon1000
Params9.08B
Context—
Smallest5.7 GB
GGUF
QW
Qwen-Image-2.1-PE-T2I
Qwen · lightx2v
Params8.95B
Context256K
Smallest9.5 GB
ReasoningTool use
ST
stable-code-instruct-3b
Stable · duyntnet
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
RU
RusMind Sokol 4.7
Rusmind · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
ME
MetisRCA E4B
Metisrca · mradermacher
Params7.52B
Context64K
Q4_K_M5.3 GB
ReasoningTool useVision
GR
Grok Oss Apollyon 8B
Grok · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MO
moonshine tiny zh
Moonshine · handy-computer
Params27M
Context—
Smallest0.0 GB
GGUF
BL
calderaai_13b-bluemethod
Bluemethod · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
CA
Captain Eris Twighlight V0.420 12B i1
Captain · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
DE
deepseek math 7b instruct
DeepSeek · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
EX
EXAONE 3.5 2.4B Instruct
Exaone · bartowski
Params2.67B
Context32K
Q4_K_M1.6 GB
GGUF

Keep browsing