GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen 72B
Qwen · mradermacher
Params72.3B
Context32K
Q4_K_M45.1 GB
GGUF
LL
Meta-Llama-3-8B-Instruct
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LF
LFM3 Omni 2B
Lfm · prithivMLmods
Params1.73B
Context125K
Q4_K_M1.1 GB
CodingReasoningTool use
HA
Hathor_Stable-v0.2-L3-8B
Hathor · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
raspberry 3B
Qwen · QuantFactory
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
ME
meditron-7b
Meditron · duyntnet
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
QW
Qwen Image 2.1
Qwen · off-grid-ai
Params7.12B
Context—
Smallest4.1 GB
GGUF
NE
Nemotron 3.5 Lightning 30B A3B Cricket Reasoning
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
HI
higgs
Higgs · calcuis
Params5.77B
Context—
Q4_K_M4.5 GB
GGUF
AU
Autodev Coder
Autodev · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
HA
Hathor Fractionate L3 8B v.05
Hathor · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
TU
Tulu 2 Dpo 7b
Tulu · mradermacher
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
EX
EXAONE 3.0 7.8B Instruct
Exaone · ThomasBaruzier
Params7.82B
Context4K
Q4_K_M4.8 GB
GGUF
HA
Hathor Sofit L3 8B v1
Hathor · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Skywork Critic Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
AE
Aegis 14B
Aegis · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
GH
Ghost 8b Beta 1608
Ghost · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
QW
Qwen1.5 14B
Qwen · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
NE
NeuralLlama 3 8B Instruct abliterated
Neuralllama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · duyntnet
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
SP
spicyboros-7b-2.2
Spicyboros · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
HU
Huggy 2 1k Alpaca
Huggy · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LF
LFM2 1.2B Tool
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
QW
calme-2.1-qwen2.5-72b
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
NE
NVIDIA Nemotron Labs 3 Elastic 12B A2B
Nemotron · mradermacher
Params12.4B
Context1024K
Q4_K_M9.6 GB
ReasoningTool use
MA
Magnum v4 22b
Magnum · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
OM
d1-omni-600M
Omni · AtomicChat
Params381M
Context125K
Q4_K_M0.3 GB
Vision
QW
claude opus 9 undecillion v
Qwen · oroboros-labs
Params27.3B
Context256K
Smallest10.9 GB
ReasoningTool useVision
YO
Youtu LLM 2B
Youtu · AaryanK
Params1.96B
Context128K
Q4_K_M1.2 GB
CodingReasoningTool use
GE
gemma-2b-it
Gemma · second-state
Params2.51B
Context8K
Q4_K_M1.5 GB
GGUF

Keep browsing