GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
BA
BananaMind Title 1.0
Bananamind · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
NE
NVIDIA Nemotron Nano 9B v2 Japanese
Nemotron · mradermacher
Params8.89B
Context1024K
Q4_K_M6.5 GB
QW
Qwen2 Math 72B Instruct
Qwen · bartowski
Params72.7B
Context4K
Q4_K_M47.4 GB
GL
Glm 4 9b
GLM · mradermacher
Params9.4B
Context8K
Q4_K_M6.3 GB
QW
calme-2.2-qwen2-72b
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
AR
katanemo Arch Function Chat 7B
Arch · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.8-Flash-Next GSQ-RCO
Qwen · qmnvp
Params132B
Context256K
Smallest90.3 GB
OM
Omni Edu 4B
Omni · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
DE
deepseek math 7b rl
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
QW
Savant Qwen2.5 72B i1
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen1.5 7B
Qwen · mradermacher
Params7.72B
Context32K
Q4_K_M4.8 GB
FA
Models Tiiuae Falcon3 3B Base
Falcon · MaziyarPanahi
Params3.23B
Context32K
Smallest2.3 GB
LT
ltx2.3
Ltx · gguf-org
Params1.16B
Context—
Smallest0.7 GB
NO
Nous-Hermes-2-SOLAR-10.7B
Nous · duyntnet
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
Lightning 4step Qwen Image 2.1
Qwen · darioooooo0o
Params7.12B
Context—
Q4_K_M4.2 GB
SK
SkyReels V2 I2V 14B 540P
Skyreels · ThePun1sher
Params16.4B
Context—
Q4_K_M10.9 GB
IN
InternVL3 78B
Internvl · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
MO
Moonshine Tiny (Korean)
Moonshine · handy-computer
Params27M
Context—
Smallest0.0 GB
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · QuantFactory
Params9B
Context—
Q4_K_M5.5 GB
LT
ltxv0.9.5
Ltx · calcuis
Params1.92B
Context—
Q4_K_M1.1 GB
PR
Priya 3B
Priya · mradermacher
Params2.81B
Context128K
Q4_K_M1.8 GB
MI
cerebras/MiniMax-M2.5-REAP-172B-A10B
Minimax · mradermacher
Params173B
Context192K
Q4_K_M104.4 GB
UN
Universal Prompt Enhancer 0.8B
Universal · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
DU
DualMind TKD Agentic 1.7B
Dualmind · tinyopsec
Params1.72B
Context40K
Q4_K_M1.1 GB
AL
ALoDLM 8B imatrix
Alodlm · liodon-ai
Params8.19B
Context40K
Q4_K_M5.0 GB
KA
Kanana 1.5 15.7b A3B Instruct
Kanana · mradermacher
Params15.7B
Context32K
Q4_K_M10.4 GB
LF
LFM2.5 350M
Lfm · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
CO
Code 290k 6.7B Instruct
Code · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
HE
HelpingAI-9B
Helpingai · bartowski
Params8.83B
Context4K
Q4_K_M5.3 GB
ST
stable audio open small
Stable · thepatch
Params341M
Context—
Q4_K_M0.1 GB