Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
gemma 4 E2B it
Gemma · eaddario
Params4.65B
Context128K
Smallest0.0 GB
GGUF
RF
rfdetr cpp small
Rfdetr · mudler
Params31M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.8 Flash Next tqLLM
Qwen · YTan2000
Params—
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.8 27B Defiance Uncensored MTP
Qwen · BIGJUTT
Params27.3B
Context256K
Smallest0.9 GB
GGUF
GO
got ocr2 crispembed
Got · cstr
Params561M
Context—
Smallest0.2 GB
GGUF
QC
QCOPM-40B-A5B
Qcopm · thehekimoghlu
Params34.7B
Context—
Q4_K_M21.2 GB
GGUF
DE
DeepSeek V4.1 Flash 1017
DeepSeek · AshwinX
Params748B
Context1024K
Smallest8.0 GB
GGUF
QW
Qwen3 8B Houdini VEX v10
Qwen · anshulVashist
Params8.19B
Context40K
Smallest0.7 GB
GGUF
GL
Minicpm 5 2B GLM 5.3 Step 5 Distillied I Q
GLM · LiviiYS
Params2.52B
Context128K
Smallest0.0 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · 10exdev
Params748B
Context1024K
Smallest1.6 GB
GGUF
NS
nsfw models
Nsfw · DasCaptain
Params14.3B
Context—
Smallest15.4 GB
GGUF
QW
mtp qwen 3.8 flash IQ2
Qwen · juan1995-dev
Params2.61B
Context—
Smallest0.9 GB
GGUF
DE
DeepSeek OCR 2
DeepSeek · JamePeng2023
Params2.93B
Context8K
Smallest3.1 GB
GGUF
MI
MiniMax M2 THRIFT 55 i1
Minimax · mradermacher
Params106B
Context192K
Smallest0.2 GB
GGUF
QW
Qwen3.5 0.8B knapquant
Qwen · MissingPackage
Params752M
Context—
Smallest0.0 GB
GGUF
LI
ActQuant Pi05 LIBERO 4bpw
Libero · NU-World-Model-Embodied-AI
Params3.39B
Context—
Smallest2.6 GB
GGUF
MA
madlad400 7b mt bt
Madlad · google
Params8.3B
Context—
Smallest4.7 GB
GGUF
QW
Qwen2.5 3B Instruct BE
Qwen · taronaeo
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
Qwen3.8 Flash Next GGUF HALO
Qwen · Beinsezii
Params180B
Context256K
Smallest0.6 GB
GGUF
DE
DeepSeek V4 Flash 0731 Abliterated DS4 Quality128
DeepSeek · apetersson
Params284B
Context1024K
Smallest7.3 GB
GGUF
GE
Gemma4 26B A4B Instruct QAT
Gemma · Atomic-Germ
Params25.2B
Context256K
Smallest0.1 GB
GGUF
LF
LFM2.5 8B A1B
Lfm · Mungert
Params8.47B
Context125K
Smallest0.0 GB
GGUF
GR
Granite 3.0 1B A400M Instruct BE
Granite · taronaeo
Params1.33B
Context4K
Q4_K_M0.8 GB
GGUF
OC
PP-OCRv6_medium_det
Ocrv · cstr
Params22M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3 4B Runner ToolUse Q4 K M
Qwen · Joakimpalm-Zen
Params17M
Context—
Q4_K_M0.1 GB
GGUF
QW
Qwen3.8 27B PL
Qwen · grpdxr
Params200M
Context—
Smallest0.4 GB
GGUF
CL
clip-vit-large-patch14/
Clip · mys
Params428M
Context—
Smallest0.1 GB
GGUF
QW
Qwen Image Edit 2511 diffuser
Qwen · smthem
Params20.4B
Context—
Smallest11.5 GB
GGUF
GR
Granite 4.1 3B BE
Granite · taronaeo
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · therickcain
Params1.68B
Context1024K
Smallest0.6 GB
GGUF

Other uses

Keep browsing