GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
KO
Koala 7B HF
Koala · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
SH
ShutterMuse
Shuttermuse · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
FL
FluidIntelligence
Fluidintelligence · altic-dev
Params4.65B
Context128K
Q4_K_M3.4 GB
WI
Wizard Vicuna 13B Uncensored
Wizard · QuantFactory
Params13B
Context2K
Q4_K_M7.9 GB
BA
Babel 83B Chat
Babel · bartowski
Params83.2B
Context128K
Q4_K_M54.2 GB
HE
HelpingAI 3B hindi
Helpingai · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · QuantFactory
Params12B
Context—
Q4_K_M6.3 GB
LL
Replete-Coder-Llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LF
Exe Turbo S V3
Lfm · exe-ai-harness
Params8.47B
Context125K
Q4_K_M5.2 GB
QW
Qwen2.5 VL 7B Meteorology
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ZE
zephyr quiklang 3b 4K
Zephyr · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
CO
code review decisions
Code · yannelli
Params2.7B
Context32K
Q4_K_M1.7 GB
OR
Orca 2 13b
Orca · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3.5 9B Abliterated HSAQ v2
Qwen · mradermacher
Params7.05B
Context256K
Q4_K_M4.7 GB
LL
Dolphin Llama 13b
Llama · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
NE
Nemotron 3.5 Lightning 30B A3B Olympics Reasoning
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
QW
Qwen1.5-1.8B-Chat
Qwen · second-state
Params1.84B
Context32K
Q4_K_M1.2 GB
DE
demodokos foundry tts v4
Demodokos · cmp-nct
Params909M
Context—
Smallest0.0 GB
EX
EXAONE 3.5 2.4B Instruct
Exaone · LGAI-EXAONE
Params2.67B
Context32K
Q4_K_M1.6 GB
ST
Starling-LM-7B-alpha
Starling · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
VI
Vistral-7B-Chat-DPO
Vistral · duyntnet
Params7.29B
Context32K
Q4_K_M4.4 GB
AN
anima aesthetic v1.1
Anima · E-stick
Params2.09B
Context—
Smallest2.2 GB
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · cc1244578151
Params177B
Context256K
Smallest0.9 GB
DE
DeepSeek V2 Lite Chat Uncensored
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
QW
Huihui Qwen3.8 Flash Next abliterated
Qwen · SUNNYROAM
Params177B
Context256K
Smallest68.2 GB
ME
Google_Medgemma 4b It
Medgemma · lmstudio-community
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
MathSmith Qwen3 8B LongCoT
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen2.5 1.5B Instruct
Qwen · duyntnet
Params1.54B
Context32K
Q4_K_M1.0 GB
SE
Seed X Instruct 7B
Seed · mradermacher
Params7.51B
Context32K
Q4_K_M4.6 GB
HA
hassaku-xl-illustrious.fp16.gguf
Hassaku · void-gryph
Params2.57B
Context77
Q4_K_M1.4 GB