GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
EH
ehartford_wizardlm-33b-v1.0-uncensored
Ehartford · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
QW
Swift 1.5 Qwen3.8 27B Uncensored MTP
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
TI
TinyLlama 1.1B Chat v1.0 imatrix
Tinyllama · duyntnet
Params1.1B
Context2K
Q4_K_M0.7 GB
LU
dreamgen lucid v1 nemo
Lucid · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
LL
LLaMA 30b
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
IN
Internlm2 Math 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
FA
Falcon3 1B Instruct
Falcon · bartowski
Params1.67B
Context8K
Q4_K_M1.1 GB
TE
Tess M Creative v1.0
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
OM
Omni Edu 27B
Omni · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
KI
Kimodo-SOMA-SEED-v1.1
Kimodo · LocalAI-io
Params283M
Context—
Smallest1.1 GB
QW
ThinkingCap Qwen3.8 Flash-Next
Qwen · bottlecapai
Params180B
Context256K
Q4_K_M113.2 GB
NE
neutts nano q4
Neutts · neuphonic
Params229M
Context—
Smallest0.2 GB
QW
Qwen Qwen3 32B Heretic
Qwen · ThalisAI
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen2.5 Coder 3B
Qwen · lmstudio-community
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen2.5-3B-Instruct
Qwen · Mungert
Params3.1B
Context32K
Q4_K_M1.9 GB
LL
Upstage Llama1 65B Instruct
Llama · TheBloke
Params65B
Context2K
Q4_K_M39.3 GB
LF
LFM2.5 350M RLCD
Lfm · NANI-Nithin
Params354M
Context125K
Q4_K_M0.2 GB
QW
hamo score 0.6b
Qwen · HamoAI
Params596M
Context40K
Smallest0.6 GB
LF
LFM2 2.6B Exp
Lfm · LiquidAI
Params2.7B
Context125K
Q4_K_M1.6 GB
LF
LFM2.5 8B A1B Uncensored
Lfm · zaakirio
Params8.47B
Context125K
Q4_K_M5.2 GB
MI
Minimax h3 Singularity V2 Pruned
Minimax · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
DE
DeepHat V1 7B imatrix
Deephat · liodon-ai
Params7.62B
Context32K
Q4_K_M4.7 GB
NE
Nemotron 3.5 Bolt E4B Heretic
Nemotron · mradermacher
Params7.52B
Context64K
Q4_K_M5.3 GB
NO
nousresearch_nous-hermes-13b
Nous · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
NI
Nitral AI Eris PrimeV4.20 Vision 32k 7B
Nitral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3.8 Flash Next
Qwen · vcruz305
Params51.2B
Context256K
Q4_K_M2.8 GB
QW
Qwen3.8 Flash Next MTP Strix Halo
Qwen · EasiiX
Params3.88B
Context256K
Smallest4.1 GB
LL
Llama 3.1 Minitron 4B Width Base
Llama · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
MI
Midnight Miqu 70b v1.5
Midnight · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
OR
Orca 2 13B
Orca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB