GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
LocateAnything-3B
Qwen · Mungert
Params3.4B
Context32K
Q4_K_M2.4 GB
Tool useVision
HE
HelpingAI-9B-200k
Helpingai · mradermacher
Params8.83B
Context195K
Q4_K_M5.3 GB
GGUF
EP
Epsilon Ocr D.Markdown Post3.0.M
Epsilon · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
GGUF
ST
Starling-LM-7B-beta
Starling · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
Llama-3-Aplite-Instruct-4x8B
Llama · mradermacher
Params24.9B
Context8K
Q4_K_M15.2 GB
Coding
QW
Qwen2.5 3B Instruct
Qwen · itlwas
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
QW
Qwen 7B Chat
Qwen · mradermacher
Params7.72B
Context32K
Q4_K_M4.9 GB
GGUF
QW
Qwen Image 2.1 Turbo
Qwen · m9ter1a
Params7.12B
Context—
Q4_K_M4.3 GB
GGUF
MI
minimax h3 turbo
Minimax · udero
Params20.1B
Context—
Q4_K_M11.4 GB
GGUF
QW
ThinCtx Qwen3.5 4B
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
LF
LFM2 350M Math
Lfm · bartowski
Params354M
Context125K
Q4_K_M0.2 GB
Tool use
ME
MergeMonster 13B 20231124
Mergemonster · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Codestral 22B v0.1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
NE
Nemotron 3.5 Lightning Omni 30B A3B
Nemotron · engram-ae
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool useVision
BA
baichuan2 7b chat
Baichuan · shaowenchen
Params7.51B
Context4K
Smallest3.3 GB
GGUF
LT
Stubelius Remix Ltx2.5
Ltx · Stuubs
Params21B
Context—
Smallest12.5 GB
GGUF
LF
LFM2.5 24B A2B Uncensored
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
ReasoningTool use
SC
scenema audio
Scenema · ChrisColeTech
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
QW
Qwen1.5-32B-Chat
Qwen · bartowski
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
QW
Qwen3.8 Flash Next MTP ROCmFP4 FAST
Qwen · agentionai
Params3.88B
Context256K
Smallest2.4 GB
ReasoningTool use
MI
Minitron 4B Base
Minitron · mradermacher
Params4.19B
Context4K
Q4_K_M2.7 GB
GGUF
QW
MathSmith HC Qwen3 32B ShortCoT
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
ReasoningTool use
QW
Qwen3.5 9B Heretic
Qwen · saidutta69
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
EX
EXAONE 3.5 7.8B Instruct
Exaone · mradermacher
Params7.82B
Context32K
Q4_K_M4.8 GB
GGUF
QW
CodeQwen1.5 7B
Qwen · mradermacher
Params7.25B
Context64K
Q4_K_M4.7 GB
GGUF
PA
Pallete 2.6B RP Reasoning 2609 V1A
Pallete · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
ReasoningRoleplay
LL
llm-compiler-13b-ftd
Llm · legraphista
Params13B
Context16K
Smallest2.9 GB
GGUF
BE
Behemoth X R1 123B
Behemoth · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
ReasoningRoleplay
SE
SeaLLMs v3 1.5B Chat
Seallms · RichardErkhov
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
NE
Nemotron Terminal 8B
Nemotron · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
CodingReasoningTool use

Keep browsing