GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
KO
Koala 7B HF
Koala · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
SH
ShutterMuse
Shuttermuse · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
FL
FluidIntelligence
Fluidintelligence · altic-dev
Params4.65B
Context128K
Q4_K_M3.4 GB
GGUF
WI
Wizard Vicuna 13B Uncensored
Wizard · QuantFactory
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
BA
Babel 83B Chat
Babel · bartowski
Params83.2B
Context128K
Q4_K_M54.2 GB
Tool use
HE
HelpingAI 3B hindi
Helpingai · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · QuantFactory
Params12B
Context—
Q4_K_M6.3 GB
GGUF
LL
Replete-Coder-Llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
LF
Exe Turbo S V3
Lfm · exe-ai-harness
Params8.47B
Context125K
Q4_K_M5.2 GB
ReasoningTool use
QW
Qwen2.5 VL 7B Meteorology
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
ZE
zephyr quiklang 3b 4K
Zephyr · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
Tool use
CO
code review decisions
Code · yannelli
Params2.7B
Context32K
Q4_K_M1.7 GB
CodingReasoningTool use
OR
Orca 2 13b
Orca · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3.5 9B Abliterated HSAQ v2
Qwen · mradermacher
Params7.05B
Context256K
Q4_K_M4.7 GB
ReasoningTool use
LL
Dolphin Llama 13b
Llama · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
NE
Nemotron 3.5 Lightning 30B A3B Olympics Reasoning
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
QW
Qwen1.5-1.8B-Chat
Qwen · second-state
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
DE
demodokos foundry tts v4
Demodokos · cmp-nct
Params909M
Context—
Smallest0.0 GB
GGUF
EX
EXAONE 3.5 2.4B Instruct
Exaone · LGAI-EXAONE
Params2.67B
Context32K
Q4_K_M1.6 GB
GGUF
ST
Starling-LM-7B-alpha
Starling · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
VI
Vistral-7B-Chat-DPO
Vistral · duyntnet
Params7.29B
Context32K
Q4_K_M4.4 GB
GGUF
AN
anima aesthetic v1.1
Anima · E-stick
Params2.09B
Context—
Smallest2.2 GB
GGUF
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · cc1244578151
Params177B
Context256K
Smallest0.9 GB
GGUF
DE
DeepSeek V2 Lite Chat Uncensored
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
QW
Huihui Qwen3.8 Flash Next abliterated
Qwen · SUNNYROAM
Params177B
Context256K
Smallest68.2 GB
ReasoningTool useVision
ME
Google_Medgemma 4b It
Medgemma · lmstudio-community
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
QW
MathSmith Qwen3 8B LongCoT
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
Qwen2.5 1.5B Instruct
Qwen · duyntnet
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
SE
Seed X Instruct 7B
Seed · mradermacher
Params7.51B
Context32K
Q4_K_M4.6 GB
GGUF
HA
hassaku-xl-illustrious.fp16.gguf
Hassaku · void-gryph
Params2.57B
Context77
Q4_K_M1.4 GB
GGUF

Keep browsing