GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
CH
ChaoticNeutrals Prima LelantaclesV5 7b
Chaoticneutrals · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
InternVL3 78B Pretrained
Internvl · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen3.8 Flash Next abliterated GSQ RCO Strata
Qwen · QWER123951
Params—
Context—
Smallest0.0 GB
QW
Qwen2.5 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
LF
Lfm2.5 2.6b Fable5 Coding Agent Heretic
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
IQ
IQuest Coder V1 40B Base Stage1
Iquest · mradermacher
Params39.8B
Context16K
Q4_K_M24.0 GB
QW
Huihui Qwen3.8 Flash Next abliterated v2
Qwen · V1ta11y1
Params177B
Context256K
Smallest68.2 GB
LF
lfm3 omni vl 2b 1rco 2mix
Lfm · efeisot
Params1.73B
Context125K
Smallest0.0 GB
LF
LFM2.5 8B A1B
Lfm · RemySkye
Params8.47B
Context125K
Q4_K_M5.2 GB
MO
Moonshine Base (Ukrainian)
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
IQ
IQuest-Q1 Mixed Quant IQ2_XXS minimum with recursive MTP
Iquest · Baekpica
Params340B
Context512K
Smallest88.0 GB
QW
Qwen3.8-Flash-Next-119B-A5B-Niwaki-v2.4-3bit
Qwen · neopolita
Params118B
Context256K
Smallest51.0 GB
LF
LFM2.5 ColBERT 350M
Lfm · LiquidAI
Params353M
Context125K
Q4_K_M0.2 GB
MO
Moonshine Base (Japanese)
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
QW
Qwen2.5 72B
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
BH
BharatGPT 3B Indic
Bharatgpt · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
IN
Internlm2_5 1_8b Chat
InternLM · mradermacher
Params1.89B
Context32K
Q4_K_M1.2 GB
DA
Dark-Miqu-103B
Dark · backyardai
Params103B
Context32K
Q4_K_M61.9 GB
QW
Qwen2.5-Omni-7B
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M4.8 GB
ER
ERNIE Image Abliterated
Ernie · ponpoke
Params3.43B
Context256K
Q4_K_M2.1 GB
FA
Virtuoso Lite 2
Falcon · arcee-ai
Params10.3B
Context32K
Q4_K_M6.3 GB
CU
CursorCore DS 6.7B i1
Cursorcore · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
QW
Qwen2.5 7B Instruct
Qwen · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
FA
Fara 7B Abliterated v2
Fara · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
LF
Lfm2-2.6B-Exp
Lfm · unsloth
Params2.57B
Context125K
Q4_K_M1.6 GB
PH
Phi 3 medium 4k instruct imatrix
Phi · duyntnet
Params14B
Context4K
Q4_K_M8.6 GB
TR
Trinity Nano Base Pre Anneal
Trinity · mradermacher
Params6.12B
Context4K
Q4_K_M3.8 GB
FL
FLUX.2 dev
Flux · orabazes
Params32.2B
Context—
Q4_K_M18.7 GB
LL
Llama 3 11B Instruct v0.1
Llama · mradermacher
Params11.5B
Context8K
Q4_K_M7.0 GB
NE
Nemotron Cascade 14B Thinking
Nemotron · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB