GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
LocateAnything-3B
Qwen · Mungert
Params3.4B
Context32K
Q4_K_M2.4 GB
HE
HelpingAI-9B-200k
Helpingai · mradermacher
Params8.83B
Context195K
Q4_K_M5.3 GB
EP
Epsilon Ocr D.Markdown Post3.0.M
Epsilon · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
ST
Starling-LM-7B-beta
Starling · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
Llama-3-Aplite-Instruct-4x8B
Llama · mradermacher
Params24.9B
Context8K
Q4_K_M15.2 GB
QW
Qwen2.5 3B Instruct
Qwen · itlwas
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen 7B Chat
Qwen · mradermacher
Params7.72B
Context32K
Q4_K_M4.9 GB
QW
Qwen Image 2.1 Turbo
Qwen · m9ter1a
Params7.12B
Context—
Q4_K_M4.3 GB
MI
minimax h3 turbo
Minimax · udero
Params20.1B
Context—
Q4_K_M11.4 GB
QW
ThinCtx Qwen3.5 4B
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
LF
LFM2 350M Math
Lfm · bartowski
Params354M
Context125K
Q4_K_M0.2 GB
ME
MergeMonster 13B 20231124
Mergemonster · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
Codestral 22B v0.1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
NE
Nemotron 3.5 Lightning Omni 30B A3B
Nemotron · engram-ae
Params32.9B
Context1024K
Q4_K_M25.4 GB
BA
baichuan2 7b chat
Baichuan · shaowenchen
Params7.51B
Context4K
Smallest3.3 GB
LT
Stubelius Remix Ltx2.5
Ltx · Stuubs
Params21B
Context—
Smallest12.5 GB
LF
LFM2.5 24B A2B Uncensored
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
SC
scenema audio
Scenema · ChrisColeTech
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Qwen1.5-32B-Chat
Qwen · bartowski
Params32.5B
Context32K
Q4_K_M19.7 GB
QW
Qwen3.8 Flash Next MTP ROCmFP4 FAST
Qwen · agentionai
Params3.88B
Context256K
Smallest2.4 GB
MI
Minitron 4B Base
Minitron · mradermacher
Params4.19B
Context4K
Q4_K_M2.7 GB
QW
MathSmith HC Qwen3 32B ShortCoT
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen3.5 9B Heretic
Qwen · saidutta69
Params8.95B
Context256K
Q4_K_M5.6 GB
EX
EXAONE 3.5 7.8B Instruct
Exaone · mradermacher
Params7.82B
Context32K
Q4_K_M4.8 GB
QW
CodeQwen1.5 7B
Qwen · mradermacher
Params7.25B
Context64K
Q4_K_M4.7 GB
PA
Pallete 2.6B RP Reasoning 2609 V1A
Pallete · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
LL
llm-compiler-13b-ftd
Llm · legraphista
Params13B
Context16K
Smallest2.9 GB
BE
Behemoth X R1 123B
Behemoth · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
SE
SeaLLMs v3 1.5B Chat
Seallms · RichardErkhov
Params1.54B
Context128K
Q4_K_M1.0 GB
NE
Nemotron Terminal 8B
Nemotron · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB