Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
NI
NitroFusion
Nitrofusion · mrfatso
Params3.47B
Context—
Smallest2.0 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · TacoTakumi
Params284B
Context1024K
Smallest0.5 GB
GGUF
RF
rfdetr cpp seg small
Rfdetr · adithya-balaji
Params34M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek-V4.1-Flash-1017 dsx T16 uncensored overlay
DeepSeek · lxe
Params1.45B
Context—
Smallest1.5 GB
GGUF
TE
Ternary Bonsai 2 27B PTQ1 0 and own42 LoRA
Ternary · groxaxo
Params2M
Context—
Smallest0.0 GB
GGUF
OR
Ornith 1.5 35B A3B ADQ4 Shisa12K MTP
Ornith · BillFan666
Params35.5B
Context256K
Smallest20.6 GB
GGUF
NE
NVIDIA Nemotron 3 Ultra 550B A55B BF16
Nemotron · AesSedai
Params549B
Context1024K
Smallest0.7 GB
GGUF
BE
Behemoth ReduX 123B v1.1 i1
Behemoth · mradermacher
Params123B
Context128K
Smallest0.0 GB
GGUF
DE
DeepSeek V4 Flash 0731 DS4 Quality128
DeepSeek · apetersson
Params284B
Context1024K
Smallest7.3 GB
GGUF
VA
VAGOsolutions/SauerkrautLM-Multi-ColBERT-15m
Vagosolutions · johannhartmann
Params15M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · flaviodelgrosso
Params755B
Context—
Smallest365.7 GB
GGUF
SA
SauerkrautLM MoEdernColBERT 115M CrispEmbed
Sauerkrautlm · cstr
Params115M
Context—
Smallest0.1 GB
GGUF
BO
Bonsai 1.7B requantized
Bonsai · lilyanatia
Params1.72B
Context32K
Smallest0.0 GB
GGUF
QW
Qwen3.6-35B-A3B
Qwen · Black-Engineer
Params35.5B
Context256K
Smallest15.2 GB
GGUF
IN
InternVL2_5-2B
Internvl · cstr
Params2.21B
Context—
Smallest1.5 GB
GGUF
RO
roberta-base-go_emotions
Roberta · masahiroid
Params125M
Context—
Smallest0.5 GB
GGUF
TI
tiny aya global strategy agent
Tiny · HatemSaadallah
Params30M
Context—
Smallest0.1 GB
GGUF
GG
gguf memory amplification poc
Gguf · reservoir-cmyk
Params2M
Context—
Smallest0.0 GB
GGUF
IN
indic ocr int8 onnx
Indic · adidsh
Params33M
Context—
Smallest0.1 GB
GGUF
QW
Qwen Image Edit 2511
Qwen · h31337
Params20.4B
Context—
Smallest11.5 GB
GGUF
KA
Kandinsky 5.0 T2V Lite distilled16steps 5s Diffusers
Kandinsky · JoPmt
Params2.01B
Context—
Smallest0.7 GB
GGUF
GE
gemma 4 31B it GGUF 5.05BPW
Gemma · Beinsezii
Params30.7B
Context256K
Smallest0.0 GB
GGUF
NL
nllb-200-distilled-600M
Nllb · keisuke-miyako
Params1.4B
Context—
Q4_K_M0.8 GB
GGUF
MI
MiniCPM5 2B pjev LoRA
MiniCPM · adriandj3
Params100M
Context—
Smallest0.2 GB
GGUF
GL
GLM 5.3 Flash EXTENSOR
GLM · amd
Params313B
Context1024K
Smallest173.5 GB
GGUF
BO
Bonsai 8B unpacked i1
Bonsai · mradermacher
Params8.19B
Context64K
Smallest0.0 GB
GGUF
QW
Qwen3.5 122B A10B trohrbaugh Heretic MTP
Qwen · random257
Params125B
Context256K
Smallest88.5 GB
GGUF
QW
jarvis qwen38 27b gguf
Qwen · MelissaJ
Params467M
Context—
Smallest0.9 GB
GGUF
AR
AresMath1.0-IT
Aresmath · MoreThought
Params—
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.5 35B A3B patent Q8 0
Qwen · chai1208
Params34.7B
Context256K
Smallest19.5 GB
GGUF

Other uses

Keep browsing