Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 Coder 30B A3B Instruct SOTA
Qwen · CISCai
Params30.5B
Context—
Smallest0.1 GB
GGUF
MA
madlad400 7b mt
Madlad · google
Params8.3B
Context—
Smallest4.7 GB
GGUF
KI
Kimodo-G1-SEED-v1
Kimodo · LocalAI-io
Params284M
Context—
Smallest1.1 GB
GGUF
DE
DeepSeek-V4-Flash-DSpark-Drafter
DeepSeek · alessandrobologna
Params19.8B
Context—
Smallest7.0 GB
GGUF
SK
SkinTokens TokenRig
Skintokens · LocalAI-io
Params29M
Context—
Smallest0.1 GB
GGUF
DI
dinov3-vitl16-pretrain-lvd1689m
Dinov · LocalAI-io
Params303M
Context—
Smallest0.6 GB
GGUF
MU
multiagent orchestrator
Multiagent · erukude
Params45M
Context—
Smallest0.1 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 dsx ud
DeepSeek · lxe
Params—
Context—
Smallest303.6 GB
GGUF
TR
TRELLIS image large
Trellis · LocalAI-io
Params74M
Context—
Smallest0.1 GB
GGUF
LA
laya_english_unsloth_dynamic
Laya · mys
Params422M
Context—
Q4_K_M0.4 GB
GGUF
HU
hy3d
Hunyuan · calcuis
Params1.11B
Context—
Q4_K_M0.6 GB
GGUF
QW
Qwen3.8 27B
Qwen · akopytko
Params27.3B
Context—
Smallest0.0 GB
GGUF
OM
omni json
Omni · erukude
Params45M
Context—
Smallest0.1 GB
GGUF
SA
sarvam 105b GGUF IQ2 M IQ1 M
Sarvam · Aaravomega
Params106B
Context128K
Smallest0.3 GB
GGUF
QW
Katy 27B
Qwen · sirfyyn
Params1.92B
Context256K
Smallest0.0 GB
GGUF
MI
MiniMax-M3.1-Flash
Minimax · webmp3
Params426B
Context—
Smallest203.6 GB
GGUF
JI
jina ocr v1
Jina · ahmadw
Params2.93B
Context—
Q4_K_M2.0 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · mxxm-t
Params748B
Context1024K
Smallest8.0 GB
GGUF
ST
Step 5 Preview
Step · smalinin
Params601B
Context1024K
Smallest1.2 GB
GGUF
GP
gpt 5.6 sol undecillion 6u5go5
Gpt · oroboros-labs
Params27.3B
Context256K
Smallest0.9 GB
GGUF
DE
DeepSeek OCR
DeepSeek · sabafallah
Params2.93B
Context—
Q4_K_M2.0 GB
GGUF
EM
Sakura EmbeddingGemma 2 HighQuality
Embeddinggemma · webmp3
Params271M
Context—
Smallest0.0 GB
GGUF
GE
Huihui gemma 4 31B it abliterated v2
Gemma · groxaxo
Params30.7B
Context—
Smallest0.0 GB
GGUF
UN
baidu.Unlimited OCR
Unlimited · DevQuasar
Params2.93B
Context—
Q4_K_M2.0 GB
GGUF
SD
sdcpp gguf dtype typeconf poc
Sdcpp · ybgwon96
Params—
Context—
Smallest0.0 GB
GGUF
BA
bagel
Bagel · calcuis
Params14.6B
Context—
Q4_K_M8.9 GB
GGUF
GO
GonzaLomo Krea 2 v4.0 checkpoint
Gonzalomo · Quiho
Params12.8B
Context—
Smallest8.3 GB
GGUF
QW
Qwen Flash abliterated Strata
Qwen · Hanselor
Params—
Context—
Smallest0.0 GB
GGUF
MI
MinimaxH3 base
Minimaxh · EllaPriest45
Params25.8B
Context—
Q4_K_M13.8 GB
GGUF
TE
TeleOCR
Teleocr · rleo
Params—
Context—
Smallest1.5 GB
GGUF

Other uses

Keep browsing