GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
LA
calderaai_30b-lazarus
Lazarus · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
MI
MiniMax M2.7
Minimax · dennny123
Params229B
Context192K
Q4_K_M138.3 GB
RY
Ryeta 0
Ryeta · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
CH
ChimeraLlama 3 8B v2 i1
Chimerallama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
TE
Teuken 7B instruct research v0.4
Teuken · QuantFactory
Params7.45B
Context4K
Q4_K_M5.0 GB
SE
SeaLLM-7B-v2.5
Seallm · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
SE
SeaLLM 7B Chat
Seallm · parinzee
Params6.87B
Context4K
Q4_K_M4.2 GB
GR
Grok Oss Apollyon 8B Heretic
Grok · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
SA
Sarvam 2b v0.5
Sarvam · mradermacher
Params2.51B
Context8K
Q4_K_M1.5 GB
CA
Nitral AI Captain Eris Violet GRPO v0.420
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Aether-Qwen2-0.5B-SFT-v0.0.2
Qwen · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
GE
Gemma 3 4b It Heretic
Gemma · saidutta69
Params3.88B
Context128K
Q4_K_M2.5 GB
YA
YandexGPT 5 Lite 8B Instruct
Yandexgpt · mradermacher
Params8.04B
Context32K
Q4_K_M4.9 GB
LL
rombos Replete Coder Llama3 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
OP
openNemo 9B abliterated
Opennemo · empero-ai
Params8.89B
Context1024K
Q4_K_M6.5 GB
NE
nvidia__NVIDIA Nemotron Nano 9B v2
Nemotron · dominguesm
Params8.89B
Context1024K
Q4_K_M6.5 GB
HI
hijin-financial-specialist-lora
Hijin · Aktnyl
Params—
Context—
Smallest0.0 GB
IR
Iridium 72B v0.1
Iridium · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
VI
lmsys_vicuna-33b-v1.3
Vicuna · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
FL
Flux2 Klein 9B True V2
Flux · Leon1000
Params9.08B
Context—
Smallest5.7 GB
QW
Qwen-Image-2.1-PE-T2I
Qwen · lightx2v
Params8.95B
Context256K
Smallest9.5 GB
ST
stable-code-instruct-3b
Stable · duyntnet
Params2.8B
Context16K
Q4_K_M1.7 GB
RU
RusMind Sokol 4.7
Rusmind · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ME
MetisRCA E4B
Metisrca · mradermacher
Params7.52B
Context64K
Q4_K_M5.3 GB
GR
Grok Oss Apollyon 8B
Grok · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
moonshine tiny zh
Moonshine · handy-computer
Params27M
Context—
Smallest0.0 GB
BL
calderaai_13b-bluemethod
Bluemethod · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
CA
Captain Eris Twighlight V0.420 12B i1
Captain · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
DE
deepseek math 7b instruct
DeepSeek · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
EX
EXAONE 3.5 2.4B Instruct
Exaone · bartowski
Params2.67B
Context32K
Q4_K_M1.6 GB