Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
NI
NitroFusion
Nitrofusion · mrfatso
Params3.47B
Context—
Smallest2.0 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · TacoTakumi
Params284B
Context1024K
Smallest0.5 GB
RF
rfdetr cpp seg small
Rfdetr · adithya-balaji
Params34M
Context—
Smallest0.0 GB
DE
DeepSeek-V4.1-Flash-1017 dsx T16 uncensored overlay
DeepSeek · lxe
Params1.45B
Context—
Smallest1.5 GB
TE
Ternary Bonsai 2 27B PTQ1 0 and own42 LoRA
Ternary · groxaxo
Params2M
Context—
Smallest0.0 GB
OR
Ornith 1.5 35B A3B ADQ4 Shisa12K MTP
Ornith · BillFan666
Params35.5B
Context256K
Smallest20.6 GB
NE
NVIDIA Nemotron 3 Ultra 550B A55B BF16
Nemotron · AesSedai
Params549B
Context1024K
Smallest0.7 GB
BE
Behemoth ReduX 123B v1.1 i1
Behemoth · mradermacher
Params123B
Context128K
Smallest0.0 GB
DE
DeepSeek V4 Flash 0731 DS4 Quality128
DeepSeek · apetersson
Params284B
Context1024K
Smallest7.3 GB
VA
VAGOsolutions/SauerkrautLM-Multi-ColBERT-15m
Vagosolutions · johannhartmann
Params15M
Context—
Smallest0.0 GB
DE
DeepSeek V4.1 Flash
DeepSeek · flaviodelgrosso
Params755B
Context—
Smallest365.7 GB
SA
SauerkrautLM MoEdernColBERT 115M CrispEmbed
Sauerkrautlm · cstr
Params115M
Context—
Smallest0.1 GB
BO
Bonsai 1.7B requantized
Bonsai · lilyanatia
Params1.72B
Context32K
Smallest0.0 GB
QW
Qwen3.6-35B-A3B
Qwen · Black-Engineer
Params35.5B
Context256K
Smallest15.2 GB
IN
InternVL2_5-2B
Internvl · cstr
Params2.21B
Context—
Smallest1.5 GB
RO
roberta-base-go_emotions
Roberta · masahiroid
Params125M
Context—
Smallest0.5 GB
TI
tiny aya global strategy agent
Tiny · HatemSaadallah
Params30M
Context—
Smallest0.1 GB
GG
gguf memory amplification poc
Gguf · reservoir-cmyk
Params2M
Context—
Smallest0.0 GB
IN
indic ocr int8 onnx
Indic · adidsh
Params33M
Context—
Smallest0.1 GB
QW
Qwen Image Edit 2511
Qwen · h31337
Params20.4B
Context—
Smallest11.5 GB
KA
Kandinsky 5.0 T2V Lite distilled16steps 5s Diffusers
Kandinsky · JoPmt
Params2.01B
Context—
Smallest0.7 GB
GE
gemma 4 31B it GGUF 5.05BPW
Gemma · Beinsezii
Params30.7B
Context256K
Smallest0.0 GB
NL
nllb-200-distilled-600M
Nllb · keisuke-miyako
Params1.4B
Context—
Q4_K_M0.8 GB
MI
MiniCPM5 2B pjev LoRA
MiniCPM · adriandj3
Params100M
Context—
Smallest0.2 GB
GL
GLM 5.3 Flash EXTENSOR
GLM · amd
Params313B
Context1024K
Smallest173.5 GB
BO
Bonsai 8B unpacked i1
Bonsai · mradermacher
Params8.19B
Context64K
Smallest0.0 GB
QW
Qwen3.5 122B A10B trohrbaugh Heretic MTP
Qwen · random257
Params125B
Context256K
Smallest88.5 GB
QW
jarvis qwen38 27b gguf
Qwen · MelissaJ
Params467M
Context—
Smallest0.9 GB
AR
AresMath1.0-IT
Aresmath · MoreThought
Params—
Context—
Smallest0.0 GB
QW
Qwen3.5 35B A3B patent Q8 0
Qwen · chai1208
Params34.7B
Context256K
Smallest19.5 GB