GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
ZY
ZYR3.1MoE
Zyr · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen2.5 72B
Qwen · RichardErkhov
Params72.7B
Context128K
Q4_K_M47.4 GB
MI
cerebras/MiniMax-M2-REAP-162B-A10B
Minimax · bartowski
Params162B
Context192K
Q4_K_M98.2 GB
QW
Niwaki Qwen3.8 Flash Next 141B A6B v4.0
Qwen · neopolita
Params141B
Context256K
Smallest61.7 GB
LF
LFM2.5 1.2B Instruct Uncensored
Lfm · zaakirio
Params1.17B
Context125K
Q4_K_M0.7 GB
SP
Spark X2.6 4B
Spark · ss-lab
Params4.11B
Context1024K
Q4_K_M2.6 GB
ST
stable diffusion 3 medium
Stable · city96
Params2.08B
Context—
Q4_K_M1.3 GB
QW
dolphin-2.9.2-qwen2-72b
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
CO
ContextPilot E4B
Contextpilot · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
AR
katanemo Arch Function Chat 1.5B
Arch · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
SK
Skywork OR1 Math 7B
Skywork · tinyopsec
Params7.62B
Context128K
Q4_K_M4.7 GB
MY
Mythomax L2 13b
Mythomax · DevQuasar-11
Params13B
Context4K
Q4_K_M7.9 GB
BI
Biodecision v2 4b
Biodecision · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
QW
Qwen3 8B
Qwen · gaianet
Params8.19B
Context40K
Q4_K_M5.0 GB
FA
Falcon3 1B Base
Falcon · mradermacher
Params1.67B
Context4K
Q4_K_M1.1 GB
SK
SkillGate 9B
Skillgate · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
PH
PhAI-IDE-72B
Phai · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
LE
Lexi Coder v4.4
Lexi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
QW
Qwen Image 2.1 turbo ComfyUI
Qwen · vantagewithai
Params7.12B
Context—
Q4_K_M4.2 GB
FO
Forgotten Safeword 24B i1
Forgotten · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
Qwen3.5 27B Heretic Marvin V1
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
CL
Cluj Napoca 0.2 i1
Cluj · mradermacher
Params25.5B
Context195K
Q4_K_M15.3 GB
MI
MiniMax M3.1 Flash abliterated
Minimax · orcarouter
Params426B
Context1024K
Smallest0.9 GB
LU
Luna 7B i1
Luna · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
ID
IdeaLens NoParaphrase
Idealens · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
OP
OpenEuroLLM Czech Ollama
Openeurollm · vishinvents
Params12.2B
Context128K
Q4_K_M8.1 GB
IN
InternLM2
InternLM · bartowski
Params7.74B
Context256K
Q4_K_M4.7 GB
QW
Qwen2.5 3B Instruct BE
Qwen · taronaeo
Params3.09B
Context32K
Q4_K_M1.9 GB
CH
Chat_Noir 24b v3
Chat · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MA
Maya 152M Flowers
Maya · mradermacher
Params153M
Context700
Q4_K_M0.1 GB