GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
EH
ehartford_wizardlm-33b-v1.0-uncensored
Ehartford · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
QW
Swift 1.5 Qwen3.8 27B Uncensored MTP
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0 imatrix
Tinyllama · duyntnet
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LU
dreamgen lucid v1 nemo
Lucid · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
LL
LLaMA 30b
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
IN
Internlm2 Math 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
FA
Falcon3 1B Instruct
Falcon · bartowski
Params1.67B
Context8K
Q4_K_M1.1 GB
GGUF
TE
Tess M Creative v1.0
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
OM
Omni Edu 27B
Omni · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
KI
Kimodo-SOMA-SEED-v1.1
Kimodo · LocalAI-io
Params283M
Context—
Smallest1.1 GB
GGUF
QW
ThinkingCap Qwen3.8 Flash-Next
Qwen · bottlecapai
Params180B
Context256K
Q4_K_M113.2 GB
ReasoningTool useVision
NE
neutts nano q4
Neutts · neuphonic
Params229M
Context—
Smallest0.2 GB
GGUF
QW
Qwen Qwen3 32B Heretic
Qwen · ThalisAI
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Qwen2.5 Coder 3B
Qwen · lmstudio-community
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
QW
Qwen2.5-3B-Instruct
Qwen · Mungert
Params3.1B
Context32K
Q4_K_M1.9 GB
GGUF
LL
Upstage Llama1 65B Instruct
Llama · TheBloke
Params65B
Context2K
Q4_K_M39.3 GB
GGUF
LF
LFM2.5 350M RLCD
Lfm · NANI-Nithin
Params354M
Context125K
Q4_K_M0.2 GB
GGUF
QW
hamo score 0.6b
Qwen · HamoAI
Params596M
Context40K
Smallest0.6 GB
GGUF
LF
LFM2 2.6B Exp
Lfm · LiquidAI
Params2.7B
Context125K
Q4_K_M1.6 GB
GGUF
LF
LFM2.5 8B A1B Uncensored
Lfm · zaakirio
Params8.47B
Context125K
Q4_K_M5.2 GB
GGUF
MI
Minimax h3 Singularity V2 Pruned
Minimax · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
DE
DeepHat V1 7B imatrix
Deephat · liodon-ai
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
NE
Nemotron 3.5 Bolt E4B Heretic
Nemotron · mradermacher
Params7.52B
Context64K
Q4_K_M5.3 GB
ReasoningTool use
NO
nousresearch_nous-hermes-13b
Nous · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
Tool use
NI
Nitral AI Eris PrimeV4.20 Vision 32k 7B
Nitral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Vision
QW
Qwen3.8 Flash Next
Qwen · vcruz305
Params51.2B
Context256K
Q4_K_M2.8 GB
GGUF
QW
Qwen3.8 Flash Next MTP Strix Halo
Qwen · EasiiX
Params3.88B
Context256K
Smallest4.1 GB
GGUF
LL
Llama 3.1 Minitron 4B Width Base
Llama · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
MI
Midnight Miqu 70b v1.5
Midnight · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
OR
Orca 2 13B
Orca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing