Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3 Coder 30B A3B Instruct SOTA
Qwen · CISCai
Params30.5B
Context—
Smallest0.1 GB
MA
madlad400 7b mt
Madlad · google
Params8.3B
Context—
Smallest4.7 GB
KI
Kimodo-G1-SEED-v1
Kimodo · LocalAI-io
Params284M
Context—
Smallest1.1 GB
DE
DeepSeek-V4-Flash-DSpark-Drafter
DeepSeek · alessandrobologna
Params19.8B
Context—
Smallest7.0 GB
SK
SkinTokens TokenRig
Skintokens · LocalAI-io
Params29M
Context—
Smallest0.1 GB
DI
dinov3-vitl16-pretrain-lvd1689m
Dinov · LocalAI-io
Params303M
Context—
Smallest0.6 GB
MU
multiagent orchestrator
Multiagent · erukude
Params45M
Context—
Smallest0.1 GB
DE
DeepSeek V4.1 Flash 1017 dsx ud
DeepSeek · lxe
Params—
Context—
Smallest303.6 GB
TR
TRELLIS image large
Trellis · LocalAI-io
Params74M
Context—
Smallest0.1 GB
LA
laya_english_unsloth_dynamic
Laya · mys
Params422M
Context—
Q4_K_M0.4 GB
HU
hy3d
Hunyuan · calcuis
Params1.11B
Context—
Q4_K_M0.6 GB
QW
Qwen3.8 27B
Qwen · akopytko
Params27.3B
Context—
Smallest0.0 GB
OM
omni json
Omni · erukude
Params45M
Context—
Smallest0.1 GB
SA
sarvam 105b GGUF IQ2 M IQ1 M
Sarvam · Aaravomega
Params106B
Context128K
Smallest0.3 GB
QW
Katy 27B
Qwen · sirfyyn
Params1.92B
Context256K
Smallest0.0 GB
MI
MiniMax-M3.1-Flash
Minimax · webmp3
Params426B
Context—
Smallest203.6 GB
JI
jina ocr v1
Jina · ahmadw
Params2.93B
Context—
Q4_K_M2.0 GB
DE
DeepSeek V4.1 Flash
DeepSeek · mxxm-t
Params748B
Context1024K
Smallest8.0 GB
ST
Step 5 Preview
Step · smalinin
Params601B
Context1024K
Smallest1.2 GB
GP
gpt 5.6 sol undecillion 6u5go5
Gpt · oroboros-labs
Params27.3B
Context256K
Smallest0.9 GB
DE
DeepSeek OCR
DeepSeek · sabafallah
Params2.93B
Context—
Q4_K_M2.0 GB
EM
Sakura EmbeddingGemma 2 HighQuality
Embeddinggemma · webmp3
Params271M
Context—
Smallest0.0 GB
GE
Huihui gemma 4 31B it abliterated v2
Gemma · groxaxo
Params30.7B
Context—
Smallest0.0 GB
UN
baidu.Unlimited OCR
Unlimited · DevQuasar
Params2.93B
Context—
Q4_K_M2.0 GB
SD
sdcpp gguf dtype typeconf poc
Sdcpp · ybgwon96
Params—
Context—
Smallest0.0 GB
BA
bagel
Bagel · calcuis
Params14.6B
Context—
Q4_K_M8.9 GB
GO
GonzaLomo Krea 2 v4.0 checkpoint
Gonzalomo · Quiho
Params12.8B
Context—
Smallest8.3 GB
QW
Qwen Flash abliterated Strata
Qwen · Hanselor
Params—
Context—
Smallest0.0 GB
MI
MinimaxH3 base
Minimaxh · EllaPriest45
Params25.8B
Context—
Q4_K_M13.8 GB
TE
TeleOCR
Teleocr · rleo
Params—
Context—
Smallest1.5 GB