GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen 72B
Qwen · mradermacher
Params72.3B
Context32K
Q4_K_M45.1 GB
LL
Meta-Llama-3-8B-Instruct
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LF
LFM3 Omni 2B
Lfm · prithivMLmods
Params1.73B
Context125K
Q4_K_M1.1 GB
HA
Hathor_Stable-v0.2-L3-8B
Hathor · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
raspberry 3B
Qwen · QuantFactory
Params3.09B
Context32K
Q4_K_M1.9 GB
ME
meditron-7b
Meditron · duyntnet
Params6.74B
Context2K
Q4_K_M4.1 GB
QW
Qwen Image 2.1
Qwen · off-grid-ai
Params7.12B
Context—
Smallest4.1 GB
NE
Nemotron 3.5 Lightning 30B A3B Cricket Reasoning
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
HI
higgs
Higgs · calcuis
Params5.77B
Context—
Q4_K_M4.5 GB
AU
Autodev Coder
Autodev · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
HA
Hathor Fractionate L3 8B v.05
Hathor · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
TU
Tulu 2 Dpo 7b
Tulu · mradermacher
Params6.74B
Context8K
Q4_K_M4.1 GB
EX
EXAONE 3.0 7.8B Instruct
Exaone · ThomasBaruzier
Params7.82B
Context4K
Q4_K_M4.8 GB
HA
Hathor Sofit L3 8B v1
Hathor · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Skywork Critic Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
AE
Aegis 14B
Aegis · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GH
Ghost 8b Beta 1608
Ghost · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen1.5 14B
Qwen · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
NE
NeuralLlama 3 8B Instruct abliterated
Neuralllama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mistral Nemo Instruct 2407
Mistral · duyntnet
Params12.2B
Context1000K
Q4_K_M7.5 GB
SP
spicyboros-7b-2.2
Spicyboros · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
HU
Huggy 2 1k Alpaca
Huggy · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
LF
LFM2 1.2B Tool
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
QW
calme-2.1-qwen2.5-72b
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
NE
NVIDIA Nemotron Labs 3 Elastic 12B A2B
Nemotron · mradermacher
Params12.4B
Context1024K
Q4_K_M9.6 GB
MA
Magnum v4 22b
Magnum · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
OM
d1-omni-600M
Omni · AtomicChat
Params381M
Context125K
Q4_K_M0.3 GB
QW
claude opus 9 undecillion v
Qwen · oroboros-labs
Params27.3B
Context256K
Smallest10.9 GB
YO
Youtu LLM 2B
Youtu · AaryanK
Params1.96B
Context128K
Q4_K_M1.2 GB
GE
gemma-2b-it
Gemma · second-state
Params2.51B
Context8K
Q4_K_M1.5 GB