GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
CH
ChaoticNeutrals Prima LelantaclesV5 7b
Chaoticneutrals · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IN
InternVL3 78B Pretrained
Internvl · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
CodingTool use
QW
Qwen3.8 Flash Next abliterated GSQ RCO Strata
Qwen · QWER123951
Params—
Context—
Smallest0.0 GB
GGUF
QW
Qwen2.5 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
LF
Lfm2.5 2.6b Fable5 Coding Agent Heretic
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
Tool use
IQ
IQuest Coder V1 40B Base Stage1
Iquest · mradermacher
Params39.8B
Context16K
Q4_K_M24.0 GB
CodingTool use
QW
Huihui Qwen3.8 Flash Next abliterated v2
Qwen · V1ta11y1
Params177B
Context256K
Smallest68.2 GB
ReasoningTool useVision
LF
lfm3 omni vl 2b 1rco 2mix
Lfm · efeisot
Params1.73B
Context125K
Smallest0.0 GB
GGUF
LF
LFM2.5 8B A1B
Lfm · RemySkye
Params8.47B
Context125K
Q4_K_M5.2 GB
ReasoningTool use
MO
Moonshine Base (Ukrainian)
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
GGUF
IQ
IQuest-Q1 Mixed Quant IQ2_XXS minimum with recursive MTP
Iquest · Baekpica
Params340B
Context512K
Smallest88.0 GB
GGUF
QW
Qwen3.8-Flash-Next-119B-A5B-Niwaki-v2.4-3bit
Qwen · neopolita
Params118B
Context256K
Smallest51.0 GB
ReasoningTool use
LF
LFM2.5 ColBERT 350M
Lfm · LiquidAI
Params353M
Context125K
Q4_K_M0.2 GB
EmbeddingTool use
MO
Moonshine Base (Japanese)
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
GGUF
QW
Qwen2.5 72B
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Roleplay
BH
BharatGPT 3B Indic
Bharatgpt · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
IN
Internlm2_5 1_8b Chat
InternLM · mradermacher
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
DA
Dark-Miqu-103B
Dark · backyardai
Params103B
Context32K
Q4_K_M61.9 GB
GGUF
QW
Qwen2.5-Omni-7B
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M4.8 GB
GGUF
ER
ERNIE Image Abliterated
Ernie · ponpoke
Params3.43B
Context256K
Q4_K_M2.1 GB
GGUF
FA
Virtuoso Lite 2
Falcon · arcee-ai
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
CU
CursorCore DS 6.7B i1
Cursorcore · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
QW
Qwen2.5 7B Instruct
Qwen · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
FA
Fara 7B Abliterated v2
Fara · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
LF
Lfm2-2.6B-Exp
Lfm · unsloth
Params2.57B
Context125K
Q4_K_M1.6 GB
Tool use
PH
Phi 3 medium 4k instruct imatrix
Phi · duyntnet
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
TR
Trinity Nano Base Pre Anneal
Trinity · mradermacher
Params6.12B
Context4K
Q4_K_M3.8 GB
GGUF
FL
FLUX.2 dev
Flux · orabazes
Params32.2B
Context—
Q4_K_M18.7 GB
GGUF
LL
Llama 3 11B Instruct v0.1
Llama · mradermacher
Params11.5B
Context8K
Q4_K_M7.0 GB
GGUF
NE
Nemotron Cascade 14B Thinking
Nemotron · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use

Keep browsing