Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
TE
Ternary Bonsai 2 27B Steered
Ternary · Secondchancee
Params27B
Context—
Smallest0.0 GB
DE
DeepSeek V4 Flash 0731 REAP
DeepSeek · heath0xFF
Params180B
Context1024K
Q4_K_M109.0 GB
DE
Huihui DeepSeek V4 Flash Vision Exp abliterated
DeepSeek · taurusduan
Params284B
Context—
Smallest135.3 GB
AN
anima aesthetic v1.1
Anima · E-stick
Params2.09B
Context—
Smallest2.2 GB
QW
Swift Qwen3.8 27B RCO
Qwen · ticeclock
Params27.3B
Context—
Smallest0.0 GB
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · cc1244578151
Params177B
Context256K
Smallest0.9 GB
MI
MiniCPM5 1B
MiniCPM · eaddario
Params1.08B
Context128K
Smallest0.0 GB
QW
Qwen3.6 35B A3B SILVER APEX
Qwen · White-Wolf13
Params34.7B
Context256K
Smallest12.1 GB
MO
MoCha
Mocha · vantagewithai
Params14.3B
Context—
Q4_K_M9.7 GB
MI
Candle Mistral 7B Instruct v0.1
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
SY
Synthia 70B
Synthia · TheBloke
Params69B
Context—
Q4_K_M41.4 GB
MI
Candle llava v1.6 mistral 7b
Mistral · DanielClough
Params7.57B
Context—
Smallest2.5 GB
GE
gemma 4 31B it qat heretic japanese imatrix
Gemma · OS-Software
Params30.7B
Context—
Smallest0.0 GB
DE
DeepSeek-OCR
DeepSeek · NexaAI
Params2.93B
Context—
Smallest1.7 GB
QW
Qwen3.8 Flash Next abliterated GSQ RCO Strata
Qwen · QWER123951
Params—
Context—
Smallest0.0 GB
MI
MiMo V2.6 Flash MOPD MXFP4
Mimo · kernelpool
Params310B
Context1024K
Smallest0.8 GB
LF
lfm3 omni vl 2b 1rco 2mix
Lfm · efeisot
Params1.73B
Context125K
Smallest0.0 GB
IM
Z Image Turbo Finetune GGUFs
Image · prolma
Params6.15B
Context—
Q4_K_M5.0 GB
SO
SongGeneration v2 large
Songgeneration · smthem
Params5.12B
Context—
Smallest6.9 GB
QW
Qwen3.8 27B Parasyte
Qwen · Plaguekind
Params27.3B
Context256K
Smallest23.0 GB
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params102B
Context1024K
Smallest99.1 GB
QW
Qwen Image 2.1 Uncensored
Qwen · Sica-Quants-1
Params7.12B
Context—
Q4_K_M4.6 GB
MI
Mistral Large 4 1T A52B Uncensored
Mistral · AtomicChat
Params114M
Context—
Smallest0.5 GB
QW
Qwopus3.5 9B Coder MTP
Qwopus · noctrex
Params1M
Context—
Smallest0.0 GB
QW
Huihui Qwen3.8 Flash Next abliterated v2
Qwen · loscrossos
Params177B
Context256K
Smallest1.2 GB
DE
DeepSeek V4.1 Flash DS4 IQ2
DeepSeek · ivanfioravanti
Params755B
Context—
Smallest1.0 GB
FL
FLX BACKUP
Flx · wrongtarget
Params11.9B
Context—
Q4_K_M6.9 GB
QW
Heretic Qwen3 VL 235B A22B Instruct i1
Qwen · mradermacher
Params235B
Context—
Smallest0.5 GB
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · CoreWolf
Params284B
Context1024K
Smallest10.9 GB
QW
Lattice 7 Hermes CDM Poincare Instruct
Qwen · DuoNeural
Params437M
Context512
Smallest0.4 GB