GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LF
LFM2.5-Audio-1.5B
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
EX
EXAONE 4.0 1.2B
Exaone · bartowski
Params1.28B
Context64K
Q4_K_M0.8 GB
ReasoningTool use
LL
KawaiiMahou-llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CA
calme-3.1-instruct-78b
Calme · bartowski
Params78B
Context32K
Q4_K_M50.7 GB
GGUF
FA
Falcon H1 Tiny Multilingual 100M Instruct
Falcon · mradermacher
Params108M
Context256K
Q4_K_M0.1 GB
Tool use
LL
Llama 3 8B LexiFun Uncensored V1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
KA
Kanana 2 3b Instruct
Kanana · mradermacher
Params3.51B
Context32K
Q4_K_M2.2 GB
ReasoningTool use
IN
Internvl3-78B
Internvl · unsloth
Params72.7B
Context32K
Q4_K_M47.4 GB
CodingTool useVision
MO
Moonshine Base (Korean)
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
GGUF
MI
Mistral7B PairRM SPPO Iter3 imatrix
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · bullerwins
Params236B
Context160K
Smallest133.9 GB
Coding
ST
steptrail recorder models
Steptrail · meelu1
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
IN
InternLM2
InternLM · second-state
Params7.74B
Context32K
Q4_K_M4.7 GB
Coding
XW
Xwin-MLewd-13B-V0.2
Xwin · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WI
WizardLM-2-7B
Wizardlm · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3.8 Flash Next REAP 288 44GB 262k
Qwen · jdominick05
Params124B
Context256K
Smallest63.3 GB
ReasoningTool use
PF
pfnet nekomata 14b pfn qfin inst merge
Pfnet · mmnga
Params14.2B
Context8K
Q4_K_M9.4 GB
GGUF
DE
SAND MathScience DeepSeek Qwen32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
CO
ContextPilot 8B
Contextpilot · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
Qwen3.8 Flash Next Heretic
Qwen · groxaxo
Params170B
Context256K
Smallest56.1 GB
Vision
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
HA
Hathor L3 8B v.02 i1
Hathor · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PR
Fish Speech S2 Pro Dual AR
Pro · subspecs
Params4.95B
Context32K
Q4_K_M3.6 GB
GGUF
QW
Vivy R Robotics 3B
Qwen · vinguyen0891
Params3.4B
Context32K
Q4_K_M2.1 GB
Tool use
NE
openthai2.0 legal thaillm nemotron 3 nano 30b a3b
Nemotron · iapp
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
MI
Mistral NeMo Minitron 8B Instruct
Mistral · QuantFactory
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
MO
MotherEarth Proverbs 8B
Motherearth · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
TI
TimeLens 8B
Timelens · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
IN
InternLM2
InternLM · lmstudio-community
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
SM
SmolLM2 1.7B
SmolLM · duyntnet
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF

Keep browsing