GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
LF
LFM2.5-Audio-1.5B
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.7 GB
EX
EXAONE 4.0 1.2B
Exaone · bartowski
Params1.28B
Context64K
Q4_K_M0.8 GB
LL
KawaiiMahou-llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
CA
calme-3.1-instruct-78b
Calme · bartowski
Params78B
Context32K
Q4_K_M50.7 GB
FA
Falcon H1 Tiny Multilingual 100M Instruct
Falcon · mradermacher
Params108M
Context256K
Q4_K_M0.1 GB
LL
Llama 3 8B LexiFun Uncensored V1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
KA
Kanana 2 3b Instruct
Kanana · mradermacher
Params3.51B
Context32K
Q4_K_M2.2 GB
IN
Internvl3-78B
Internvl · unsloth
Params72.7B
Context32K
Q4_K_M47.4 GB
MO
Moonshine Base (Korean)
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
MI
Mistral7B PairRM SPPO Iter3 imatrix
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · bullerwins
Params236B
Context160K
Smallest133.9 GB
ST
steptrail recorder models
Steptrail · meelu1
Params4B
Context40K
Q4_K_M2.5 GB
IN
InternLM2
InternLM · second-state
Params7.74B
Context32K
Q4_K_M4.7 GB
XW
Xwin-MLewd-13B-V0.2
Xwin · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
WI
WizardLM-2-7B
Wizardlm · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3.8 Flash Next REAP 288 44GB 262k
Qwen · jdominick05
Params124B
Context256K
Smallest63.3 GB
PF
pfnet nekomata 14b pfn qfin inst merge
Pfnet · mmnga
Params14.2B
Context8K
Q4_K_M9.4 GB
DE
SAND MathScience DeepSeek Qwen32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
CO
ContextPilot 8B
Contextpilot · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3.8 Flash Next Heretic
Qwen · groxaxo
Params170B
Context256K
Smallest56.1 GB
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context32K
Q4_K_M4.7 GB
HA
Hathor L3 8B v.02 i1
Hathor · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
PR
Fish Speech S2 Pro Dual AR
Pro · subspecs
Params4.95B
Context32K
Q4_K_M3.6 GB
QW
Vivy R Robotics 3B
Qwen · vinguyen0891
Params3.4B
Context32K
Q4_K_M2.1 GB
NE
openthai2.0 legal thaillm nemotron 3 nano 30b a3b
Nemotron · iapp
Params31.6B
Context1024K
Q4_K_M24.5 GB
MI
Mistral NeMo Minitron 8B Instruct
Mistral · QuantFactory
Params8.41B
Context8K
Q4_K_M5.1 GB
MO
MotherEarth Proverbs 8B
Motherearth · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
TI
TimeLens 8B
Timelens · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
IN
InternLM2
InternLM · lmstudio-community
Params7.74B
Context8K
Q4_K_M4.7 GB
SM
SmolLM2 1.7B
SmolLM · duyntnet
Params1.71B
Context8K
Q4_K_M1.1 GB