GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
ZY
ZYR3.1MoE
Zyr · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
QW
Qwen2.5 72B
Qwen · RichardErkhov
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
MI
cerebras/MiniMax-M2-REAP-162B-A10B
Minimax · bartowski
Params162B
Context192K
Q4_K_M98.2 GB
ReasoningTool use
QW
Niwaki Qwen3.8 Flash Next 141B A6B v4.0
Qwen · neopolita
Params141B
Context256K
Smallest61.7 GB
ReasoningTool use
LF
LFM2.5 1.2B Instruct Uncensored
Lfm · zaakirio
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
SP
Spark X2.6 4B
Spark · ss-lab
Params4.11B
Context1024K
Q4_K_M2.6 GB
ReasoningTool use
ST
stable diffusion 3 medium
Stable · city96
Params2.08B
Context—
Q4_K_M1.3 GB
GGUF
QW
dolphin-2.9.2-qwen2-72b
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
CodingTool use
CO
ContextPilot E4B
Contextpilot · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
AR
katanemo Arch Function Chat 1.5B
Arch · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
SK
Skywork OR1 Math 7B
Skywork · tinyopsec
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
MY
Mythomax L2 13b
Mythomax · DevQuasar-11
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
BI
Biodecision v2 4b
Biodecision · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool useVision
QW
Qwen3 8B
Qwen · gaianet
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
FA
Falcon3 1B Base
Falcon · mradermacher
Params1.67B
Context4K
Q4_K_M1.1 GB
GGUF
SK
SkillGate 9B
Skillgate · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
PH
PhAI-IDE-72B
Phai · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
CodingTool use
LE
Lexi Coder v4.4
Lexi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
QW
Qwen Image 2.1 turbo ComfyUI
Qwen · vantagewithai
Params7.12B
Context—
Q4_K_M4.2 GB
GGUF
FO
Forgotten Safeword 24B i1
Forgotten · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
QW
Qwen3.5 27B Heretic Marvin V1
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
CL
Cluj Napoca 0.2 i1
Cluj · mradermacher
Params25.5B
Context195K
Q4_K_M15.3 GB
GGUF
MI
MiniMax M3.1 Flash abliterated
Minimax · orcarouter
Params426B
Context1024K
Smallest0.9 GB
ReasoningTool use
LU
Luna 7B i1
Luna · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ID
IdeaLens NoParaphrase
Idealens · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
OP
OpenEuroLLM Czech Ollama
Openeurollm · vishinvents
Params12.2B
Context128K
Q4_K_M8.1 GB
Vision
IN
InternLM2
InternLM · bartowski
Params7.74B
Context256K
Q4_K_M4.7 GB
GGUF
QW
Qwen2.5 3B Instruct BE
Qwen · taronaeo
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
CH
Chat_Noir 24b v3
Chat · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MA
Maya 152M Flowers
Maya · mradermacher
Params153M
Context700
Q4_K_M0.1 GB
GGUF

Keep browsing