Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
GE
gemma 4 E2B it
Gemma · eaddario
Params4.65B
Context128K
Smallest0.0 GB
RF
rfdetr cpp small
Rfdetr · mudler
Params31M
Context—
Smallest0.0 GB
QW
Qwen3.8 Flash Next tqLLM
Qwen · YTan2000
Params—
Context—
Smallest0.0 GB
QW
Qwen3.8 27B Defiance Uncensored MTP
Qwen · BIGJUTT
Params27.3B
Context256K
Smallest0.9 GB
GO
got ocr2 crispembed
Got · cstr
Params561M
Context—
Smallest0.2 GB
QC
QCOPM-40B-A5B
Qcopm · thehekimoghlu
Params34.7B
Context—
Q4_K_M21.2 GB
DE
DeepSeek V4.1 Flash 1017
DeepSeek · AshwinX
Params748B
Context1024K
Smallest8.0 GB
QW
Qwen3 8B Houdini VEX v10
Qwen · anshulVashist
Params8.19B
Context40K
Smallest0.7 GB
GL
Minicpm 5 2B GLM 5.3 Step 5 Distillied I Q
GLM · LiviiYS
Params2.52B
Context128K
Smallest0.0 GB
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · 10exdev
Params748B
Context1024K
Smallest1.6 GB
NS
nsfw models
Nsfw · DasCaptain
Params14.3B
Context—
Smallest15.4 GB
QW
mtp qwen 3.8 flash IQ2
Qwen · juan1995-dev
Params2.61B
Context—
Smallest0.9 GB
DE
DeepSeek OCR 2
DeepSeek · JamePeng2023
Params2.93B
Context8K
Smallest3.1 GB
MI
MiniMax M2 THRIFT 55 i1
Minimax · mradermacher
Params106B
Context192K
Smallest0.2 GB
QW
Qwen3.5 0.8B knapquant
Qwen · MissingPackage
Params752M
Context—
Smallest0.0 GB
LI
ActQuant Pi05 LIBERO 4bpw
Libero · NU-World-Model-Embodied-AI
Params3.39B
Context—
Smallest2.6 GB
MA
madlad400 7b mt bt
Madlad · google
Params8.3B
Context—
Smallest4.7 GB
QW
Qwen2.5 3B Instruct BE
Qwen · taronaeo
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen3.8 Flash Next GGUF HALO
Qwen · Beinsezii
Params180B
Context256K
Smallest0.6 GB
DE
DeepSeek V4 Flash 0731 Abliterated DS4 Quality128
DeepSeek · apetersson
Params284B
Context1024K
Smallest7.3 GB
GE
Gemma4 26B A4B Instruct QAT
Gemma · Atomic-Germ
Params25.2B
Context256K
Smallest0.1 GB
LF
LFM2.5 8B A1B
Lfm · Mungert
Params8.47B
Context125K
Smallest0.0 GB
GR
Granite 3.0 1B A400M Instruct BE
Granite · taronaeo
Params1.33B
Context4K
Q4_K_M0.8 GB
OC
PP-OCRv6_medium_det
Ocrv · cstr
Params22M
Context—
Smallest0.0 GB
QW
Qwen3 4B Runner ToolUse Q4 K M
Qwen · Joakimpalm-Zen
Params17M
Context—
Q4_K_M0.1 GB
QW
Qwen3.8 27B PL
Qwen · grpdxr
Params200M
Context—
Smallest0.4 GB
CL
clip-vit-large-patch14/
Clip · mys
Params428M
Context—
Smallest0.1 GB
QW
Qwen Image Edit 2511 diffuser
Qwen · smthem
Params20.4B
Context—
Smallest11.5 GB
GR
Granite 4.1 3B BE
Granite · taronaeo
Params3.4B
Context128K
Q4_K_M2.1 GB
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · therickcain
Params1.68B
Context1024K
Smallest0.6 GB