GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DR
Drama 3 ConfigI
Drama · thetom-ai
Params34.7B
Context256K
Smallest24.3 GB
ReasoningTool use
DB
dbrx instruct iMat
Dbrx · dranger003
Params132B
Context32K
Smallest26.9 GB
GGUF
PO
Poppy_Porpoise-0.72-L3-8B
Poppy · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
EA
EAN 3B
Ean · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
Vision
LT
LTX 2.3
Ltx · wuhaixie
Params21B
Context—
Q4_K_M14.2 GB
GGUF
BE
Behemoth 123B v2.2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
LL
Huihui ai.Llama 3.1 Nemotron Nano 8B v1 Abliterated
Llama · DevQuasar-12
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen Image 2.1 Uncensored
Qwen · laazuri
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
AR
ArmenianGPT 1.0 3B
Armeniangpt · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningTool useVision
MI
Mistral Nemo Gutenberg Vitus 12B
Mistral · duyntnet
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
QW
Qwen1.5-7B-Chat
Qwen · bartowski
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
OR
Orca 2 13B
Orca · second-state
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LF
LFM2.5 VL 450M
Lfm · ZuzeTt
Params354M
Context125K
Q4_K_M0.2 GB
ReasoningTool useVision
LF
LFM2.5 2.6B Uncensored
Lfm · zaakirio
Params2.7B
Context125K
Q4_K_M1.7 GB
GGUF
QW
Qwen2.5 Coder 3B Instruct
Qwen · second-state
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
DE
deepseek math 7b instruct
DeepSeek · MaziyarPanahi
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
QW
VisReason Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningVision
OR
OrcaMaid 13b
Orcamaid · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3 4B MegaR3ASONER v1
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
CodingReasoningTool use
XO
XORTRON NXTXPRTXXL
Xortron · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
ReasoningTool useVision
DE
Deepseek Llm 7b Chat
DeepSeek · matrixportalx
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
BO
Borealis 27b
Borealis · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
QW
Qwen 7B
Qwen · mradermacher
Params7.72B
Context32K
Q4_K_M4.9 GB
GGUF
QW
VEPO ERM Qwen3 VL 4B
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool useVision
LF
Tanpo Marketing Merged Format v3
Lfm · d4rkninja
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
LF
lfm3 vld 2b
Lfm · webbrain-one
Params1.99B
Context125K
Q4_K_M1.2 GB
ReasoningTool useVision
HA
Hathor Respawn L3 8B v0.8
Hathor · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
NE
Elbaz NVIDIA Nemotron 3 Nano 30B A3B PRISM
Nemotron · Ex0bit
Params31.6B
Context1024K
Smallest18.2 GB
CodingReasoningTool use
CO
Cosmos Reason2 8B
Cosmos · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool use
MA
magnum 32b v2 i1
Magnum · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF

Keep browsing