GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
BA
BananaMind Title 1.0
Bananamind · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
Tool use
NE
NVIDIA Nemotron Nano 9B v2 Japanese
Nemotron · mradermacher
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
QW
Qwen2 Math 72B Instruct
Qwen · bartowski
Params72.7B
Context4K
Q4_K_M47.4 GB
GGUF
GL
Glm 4 9b
GLM · mradermacher
Params9.4B
Context8K
Q4_K_M6.3 GB
GGUF
QW
calme-2.2-qwen2-72b
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
AR
katanemo Arch Function Chat 7B
Arch · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
QW
Qwen3.8-Flash-Next GSQ-RCO
Qwen · qmnvp
Params132B
Context256K
Smallest90.3 GB
CodingReasoningTool use
OM
Omni Edu 4B
Omni · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
DE
deepseek math 7b rl
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
QW
Savant Qwen2.5 72B i1
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
QW
Qwen1.5 7B
Qwen · mradermacher
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
FA
Models Tiiuae Falcon3 3B Base
Falcon · MaziyarPanahi
Params3.23B
Context32K
Smallest2.3 GB
GGUF
LT
ltx2.3
Ltx · gguf-org
Params1.16B
Context—
Smallest0.7 GB
GGUF
NO
Nous-Hermes-2-SOLAR-10.7B
Nous · duyntnet
Params10.7B
Context4K
Q4_K_M6.5 GB
Tool use
QW
Lightning 4step Qwen Image 2.1
Qwen · darioooooo0o
Params7.12B
Context—
Q4_K_M4.2 GB
GGUF
SK
SkyReels V2 I2V 14B 540P
Skyreels · ThePun1sher
Params16.4B
Context—
Q4_K_M10.9 GB
GGUF
IN
InternVL3 78B
Internvl · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
CodingTool useVision
MO
Moonshine Tiny (Korean)
Moonshine · handy-computer
Params27M
Context—
Smallest0.0 GB
GGUF
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · QuantFactory
Params9B
Context—
Q4_K_M5.5 GB
GGUF
LT
ltxv0.9.5
Ltx · calcuis
Params1.92B
Context—
Q4_K_M1.1 GB
GGUF
PR
Priya 3B
Priya · mradermacher
Params2.81B
Context128K
Q4_K_M1.8 GB
GGUF
MI
cerebras/MiniMax-M2.5-REAP-172B-A10B
Minimax · mradermacher
Params173B
Context192K
Q4_K_M104.4 GB
ReasoningTool use
UN
Universal Prompt Enhancer 0.8B
Universal · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
DU
DualMind TKD Agentic 1.7B
Dualmind · tinyopsec
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
AL
ALoDLM 8B imatrix
Alodlm · liodon-ai
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
KA
Kanana 1.5 15.7b A3B Instruct
Kanana · mradermacher
Params15.7B
Context32K
Q4_K_M10.4 GB
Tool use
LF
LFM2.5 350M
Lfm · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
Tool use
CO
Code 290k 6.7B Instruct
Code · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
HE
HelpingAI-9B
Helpingai · bartowski
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
ST
stable audio open small
Stable · thepatch
Params341M
Context—
Q4_K_M0.1 GB
GGUF

Keep browsing