GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QU
Quill v1 imatrix
Quill · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Llama 4 Scout 17B 16E Instruct
Llama · second-state
Params108B
Context10240K
Q4_K_M65.4 GB
Tool useVision
WI
WizardLM 13B Uncensored
Wizardlm · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LT
LTX 2.3 DISTILLED
Ltx · FenomAI
Params21B
Context—
Q4_K_M14.2 GB
GGUF
QW
Sakura Qwen3.8 Flash Next Compact Swift IQ3 XXS 352E CP2
Qwen · webmp3
Params139B
Context256K
Smallest2.6 GB
ReasoningTool use
TI
TIPO 200M
Tipo · KBlueLeaf
Params203M
Context2K
Smallest0.4 GB
Vision
HE
HelpingAI2.5 2B
Helpingai · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
GE
Gemma 2 2b It
Gemma · duyntnet
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
FL
FLUX.1 Fill dev
Flux · gaianet
Params84M
Context—
Smallest0.3 GB
GGUF
QW
Qwen2.5 VL 7B Meteorology
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
qwenimage21
Qwen · wwdsada
Params7.12B
Context—
Q4_K_M4.2 GB
GGUF
ME
Medgemma 1.5 4b It
Medgemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
QW
Qwen3.8 Flash Next ROCmFP4 STRIX LEAN
Qwen · kingjones777
Params177B
Context256K
Smallest105.8 GB
ReasoningTool use
MI
minicpm5 1B GLM 5.2 Agentic v3
MiniCPM · hudsongouge
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
GE
gemma-2b
Gemma · leliuga
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
NE
Nemotron 3.5 Embed 1B
Nemotron · maternion
Params1.14B
Context256K
Smallest0.9 GB
EmbeddingVision
OP
OpenCoder 8B Instruct
Opencoder · QuantFactory
Params7.77B
Context8K
Q4_K_M4.7 GB
Coding
MI
Llama 3.1 Nemotron 70B Instruct HF
Mistral · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M13.3 GB
Tool use
LL
Bio Medical Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.5 122B A10B REAP 20
Qwen · mradermacher
Params99B
Context256K
Q4_K_M60.2 GB
ReasoningTool use
CO
Cosmos Reason1 7B
Cosmos · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
QW
Qwen Image 2.1 Companions
Qwen · off-grid-ai
Params8.19B
Context256K
Q4_K_M5.0 GB
CodingTool useVision
LL
larryvrh_yi-34b-200k-llamafied
Llama · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
AN
Anima aesthetic v1.0
Anima · Abiray
Params2.09B
Context—
Q4_K_M1.4 GB
GGUF
OP
OpenOrca-Platypus2-13B
Openorca · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
RU
RusMind Malysh 4.7
Rusmind · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
LL
Meta Llama Guard 2 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OM
Omni Edu 4B
Omni · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
QW
TEMPURA Qwen2.5 VL 3B s2
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Tool useVision
KE
KernelLLM
Kernelllm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing