Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
KR
krea 2
Krea · gguf-org
Params12.8B
Context—
Smallest0.3 GB
GGUF
GR
Granite 4.0 350M BE
Granite · taronaeo
Params352M
Context—
Q4_K_M0.2 GB
GGUF
GR
Granite 4.0 H 350M BE
Granite · taronaeo
Params340M
Context—
Q4_K_M0.2 GB
GGUF
QW
OrcaRouter Qwen3.8 Flash Next Uncensored NVFP4 GPTQ Strata
Qwen · Maximilian228
Params4.95B
Context—
Smallest1.3 GB
GGUF
TE
Test Frankenstein
Test · ND911
Params11.9B
Context—
Smallest6.9 GB
GGUF
MO
moshiko candle q8
Moshiko · kyutai
Params7.69B
Context—
Smallest8.2 GB
GGUF
FA
face detect
Face · mudler
Params70M
Context—
Smallest0.0 GB
GGUF
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B Uncensored
Nemotron · AtomicChat
Params74B
Context256K
Q4_K_M51.7 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · smalinin
Params748B
Context—
Smallest0.8 GB
GGUF
KI
Kimodo-SOMA-RP-v1.1
Kimodo · LocalAI-io
Params283M
Context—
Smallest1.1 GB
GGUF
UN
Unlimited OCR
Unlimited · sahilchachra
Params2.93B
Context—
Q4_K_M2.0 GB
GGUF
QW
Ternary Bonsai 2 27B MTP
Qwen · ProCreations
Params27.3B
Context256K
Smallest7.7 GB
GGUF
NE
Nex N2.5 mini OrcaRouter Sangreal ICE
Nex · gbuzhf
Params34.7B
Context256K
Smallest11.9 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · lmstudio-community
Params284B
Context—
Smallest156.4 GB
GGUF
QW
Qwen3.8 27B S mirai
Qwen · alesha-pro
Params27B
Context—
Smallest0.0 GB
GGUF
CY
Cyber Tiel Coder 35B A3B APEX I MiniPlus V2.1
Cyber · IsValorum
Params34.7B
Context256K
Smallest1.5 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · mrfakename
Params1M
Context—
Q4_K_M444.7 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 GSQ agentic strata
DeepSeek · kaushikvira
Params14.7B
Context—
Smallest5.7 GB
GGUF
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · huihui-ai
Params1.68B
Context1024K
Smallest0.6 GB
GGUF
MI
minmax
Minmax · Kutches
Params20.1B
Context—
Q4_K_M11.5 GB
GGUF
QW
Signal 3.8 27B
Qwen · agentionai
Params27.3B
Context—
Q4_K_M17.0 GB
GGUF
QW
Qwen3.8 4B Distill Heretic Abliterated
Qwen · yachen4ever
Params4.33B
Context256K
Q4_K_M2.8 GB
GGUF
QW
Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · ScottzillaSystems
Params177B
Context—
Smallest0.9 GB
GGUF
MU
Muse Spark Open 816B A42B
Muse · unsloth
Params816B
Context—
Smallest0.8 GB
GGUF
ES
Esan testi
Esan · fiojanea
Params14.3B
Context—
Smallest15.4 GB
GGUF
QW
Qwen3.8 Flash Next i1
Qwen · mradermacher
Params177B
Context—
Smallest0.6 GB
GGUF
PP
pplx decider v1.1 27b
Pplx · Livesport
Params25.6B
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.8-27B GSQ-RCO
Qwen · cruizba
Params27.3B
Context256K
Smallest8.6 GB
GGUF
MI
Sharp MiniCPM5 2B
MiniCPM · peculiar-ragdoll
Params2.52B
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.8 Flash Next S abliterated Strata
Qwen · alesha-pro
Params—
Context—
Smallest0.0 GB
GGUF

Other uses

Keep browsing