Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8-Flash-Next DS4 Q4 ple
Qwen · ivanfioravanti
Params51.2B
Context—
Smallest32.0 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · ggml-org
Params284B
Context—
Smallest10.8 GB
GP
kldzj gpt oss 120b heretic v2
gpt-oss · bartowski
Params117B
Context—
Smallest0.2 GB
SD
sdmodels
Sdmodels · MWSAH
Params11.9B
Context—
Smallest6.9 GB
QW
Qwen3.8 27B
Qwen · batiai
Params27B
Context256K
Q4_K_M16.5 GB
DE
DeepSeek V4.1 Flash 1017 heretic
DeepSeek · pqhaz
Params748B
Context1024K
Smallest457.0 GB
BE
Beam 1.0 501B A23B
Beam · unsloth
Params501B
Context—
Smallest0.6 GB
GR
Granite 4.0 H 1B BE
Granite · taronaeo
Params1.46B
Context—
Q4_K_M0.9 GB
DE
DeepSeek V4 Flash Vision Exp Uncensored
DeepSeek · ddh0
Params284B
Context—
Smallest140.7 GB
AN
Anima
Anima · Bedovyy
Params2.09B
Context—
Q4_K_M1.4 GB
MI
Ministral 3 8B Nymphaea RP
Mistral · 0xA50C1A1
Params8.49B
Context—
Smallest0.0 GB
UN
unlimited ocr
Unlimited · vimalnakrani
Params2.93B
Context—
Q4_K_M2.0 GB
MA
madlad400 3b mt
Madlad · jbochi
Params2.94B
Context—
Smallest1.0 GB
QW
Qwen3.8 27B Velocity
Qwen · joycx
Params27.3B
Context—
Smallest0.0 GB
GL
GLM 5.3 Flash Uncensored Mixed Quant
GLM · Baekpica
Params564M
Context—
Smallest1.1 GB
MA
madlad400 10b mt
Madlad · google
Params10.7B
Context—
Smallest6.0 GB
QW
Qwen3.8-27B GSQ-RCO
Qwen · Farggin
Params27.3B
Context256K
Smallest12.0 GB
WA
WanT2IHighRealism2.2
Want · Kolso14
Params14.3B
Context—
Smallest15.4 GB
DE
DeepSeek V4.1 Flash ik llama
DeepSeek · pokey2025
Params14.2B
Context—
Smallest7.9 GB
UN
Unlimited OCR 2
Unlimited · RX5950XT
Params2.94B
Context128K
Q4_K_M2.2 GB
QW
ATX Swift 1.5 Qwen3.8 27B Uncensored IQ4 XS M
Qwen · jakeatx
Params27.3B
Context256K
Smallest0.0 GB
MI
MiMo V2.6 Pro MOPD
Mimo · AesSedai
Params1020B
Context—
Smallest3.1 GB
MO
nightmare moss image
Moss · AbrahamPJ
Params5.08B
Context—
Smallest3.2 GB
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · grainrigi
Params177B
Context256K
Smallest0.9 GB
MI
Mistral Small 4 119B 2603 GGUF HALO
Mistral · Beinsezii
Params119B
Context—
Smallest0.1 GB
DE
DeepSeek V4.1 Flash 1017 dsx mxfp4
DeepSeek · lxe
Params—
Context—
Smallest270.5 GB
LL
Llama 2 7b chat hf function calling v2
Llama · Trelis
Params7B
Context—
Smallest0.0 GB
CO
Cosmos Predict2 14B Text2Image
Cosmos · city96
Params14.3B
Context—
Q4_K_M9.5 GB
HI
HiDream O1 Image Dev
Hidream · smthem
Params8.8B
Context—
Smallest9.9 GB
TI
tinyllama split test
Tinyllama · ngxson
Params24M
Context—
Smallest0.0 GB