Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
KR
krea 2
Krea · gguf-org
Params12.8B
Context—
Smallest0.3 GB
GR
Granite 4.0 350M BE
Granite · taronaeo
Params352M
Context—
Q4_K_M0.2 GB
GR
Granite 4.0 H 350M BE
Granite · taronaeo
Params340M
Context—
Q4_K_M0.2 GB
QW
OrcaRouter Qwen3.8 Flash Next Uncensored NVFP4 GPTQ Strata
Qwen · Maximilian228
Params4.95B
Context—
Smallest1.3 GB
TE
Test Frankenstein
Test · ND911
Params11.9B
Context—
Smallest6.9 GB
MO
moshiko candle q8
Moshiko · kyutai
Params7.69B
Context—
Smallest8.2 GB
FA
face detect
Face · mudler
Params70M
Context—
Smallest0.0 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B Uncensored
Nemotron · AtomicChat
Params74B
Context256K
Q4_K_M51.7 GB
DE
DeepSeek V4.1 Flash
DeepSeek · smalinin
Params748B
Context—
Smallest0.8 GB
KI
Kimodo-SOMA-RP-v1.1
Kimodo · LocalAI-io
Params283M
Context—
Smallest1.1 GB
UN
Unlimited OCR
Unlimited · sahilchachra
Params2.93B
Context—
Q4_K_M2.0 GB
QW
Ternary Bonsai 2 27B MTP
Qwen · ProCreations
Params27.3B
Context256K
Smallest7.7 GB
NE
Nex N2.5 mini OrcaRouter Sangreal ICE
Nex · gbuzhf
Params34.7B
Context256K
Smallest11.9 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · lmstudio-community
Params284B
Context—
Smallest156.4 GB
QW
Qwen3.8 27B S mirai
Qwen · alesha-pro
Params27B
Context—
Smallest0.0 GB
CY
Cyber Tiel Coder 35B A3B APEX I MiniPlus V2.1
Cyber · IsValorum
Params34.7B
Context256K
Smallest1.5 GB
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · mrfakename
Params1M
Context—
Q4_K_M444.7 GB
DE
DeepSeek V4.1 Flash 1017 GSQ agentic strata
DeepSeek · kaushikvira
Params14.7B
Context—
Smallest5.7 GB
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · huihui-ai
Params1.68B
Context1024K
Smallest0.6 GB
MI
minmax
Minmax · Kutches
Params20.1B
Context—
Q4_K_M11.5 GB
QW
Signal 3.8 27B
Qwen · agentionai
Params27.3B
Context—
Q4_K_M17.0 GB
QW
Qwen3.8 4B Distill Heretic Abliterated
Qwen · yachen4ever
Params4.33B
Context256K
Q4_K_M2.8 GB
QW
Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · ScottzillaSystems
Params177B
Context—
Smallest0.9 GB
MU
Muse Spark Open 816B A42B
Muse · unsloth
Params816B
Context—
Smallest0.8 GB
ES
Esan testi
Esan · fiojanea
Params14.3B
Context—
Smallest15.4 GB
QW
Qwen3.8 Flash Next i1
Qwen · mradermacher
Params177B
Context—
Smallest0.6 GB
PP
pplx decider v1.1 27b
Pplx · Livesport
Params25.6B
Context—
Smallest0.0 GB
QW
Qwen3.8-27B GSQ-RCO
Qwen · cruizba
Params27.3B
Context256K
Smallest8.6 GB
MI
Sharp MiniCPM5 2B
MiniCPM · peculiar-ragdoll
Params2.52B
Context—
Smallest0.0 GB
QW
Qwen3.8 Flash Next S abliterated Strata
Qwen · alesha-pro
Params—
Context—
Smallest0.0 GB