Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
RF
rfdetr cpp seg 2xlarge
Rfdetr · mudler
Params38M
Context—
Smallest0.0 GB
QW
Qwen3 Coder Next code
Qwen · Voidstackloop
Params79.7B
Context256K
Smallest0.9 GB
GE
Gemma 3 12b It
Gemma · eaddario
Params11.8B
Context128K
Q4_K_M6.2 GB
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · Ashwinxs
Params1.68B
Context1024K
Smallest0.6 GB
RF
rfdetr cpp seg large
Rfdetr · mudler
Params35M
Context—
Smallest0.0 GB
DE
DeepSeek V4 Flash
DeepSeek · vultr
Params284B
Context1024K
Smallest5.7 GB
QW
Qwen3.8 27B GGUF 4.2BPW 16GB
Qwen · hitsfmdj
Params27.3B
Context256K
Smallest0.0 GB
OP
open cabrita3b
Open · lucianosb
Params3.55B
Context—
Smallest2.1 GB
FE
Fenrir X 26B A4B UD Q4 K XL
Fenrir · KaviarLabs
Params25.2B
Context256K
Smallest0.1 GB
QW
TwinFlow Qwen Image v1.0 diffusers
Qwen · smthem
Params20.4B
Context—
Smallest9.0 GB
LF
LFM2.5 24B A2B Heretic GSQ RCO
Lfm · lavendercomputing
Params24B
Context128K
Smallest0.1 GB
QW
Qwen3.8 27B chinese taste lora
Qwen · Moeblack
Params638M
Context—
Smallest0.7 GB
QW
qwen3 vl 2b crispembed
Qwen · cstr
Params10M
Context—
Smallest0.0 GB
GE
BgGPT Gemma 2 9B IT v1.0
Gemma · INSAIT-Institute
Params9.24B
Context8K
Q4_K_M0.0 GB
TE
TestKrea
Testkrea · LoneWolfVPS
Params12.8B
Context—
Smallest8.3 GB
NA
Nanbeige4.3 33B
Nanbeige · DogukanUrker
Params33.1B
Context512K
Smallest0.0 GB
OR
Ornith 1.5 35B A3B REAP50
Ornith · Atomic-Germ
Params18.5B
Context256K
Smallest0.2 GB
SR
SRPO
Srpo · befox
Params11.9B
Context—
Smallest4.0 GB
OR
Ornith 1.5 397B GGUF imatrix
Ornith · cdanis
Params403B
Context256K
Smallest1.1 GB
GP
gpt oss 160b kiwi i1
gpt-oss · mradermacher
Params160B
Context128K
Smallest0.2 GB
CM
CMFUI
Cmfui · jmew1989
Params14.3B
Context—
Smallest15.4 GB
QW
Qwen3.5 2B BE
Qwen · taronaeo
Params1.94B
Context256K
Q4_K_M1.3 GB
QW
Qwen3.5 9B BE
Qwen · taronaeo
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP GGUF 6 bit
Qwen · LunarMoonar
Params1.86B
Context256K
Smallest0.9 GB
QW
nerkyor Qwen3.8 27B EfficientThink KQVQ4 IQ3Floor 10G MTP Fast
Qwen · zhangrover
Params461M
Context256K
Smallest10.9 GB
QW
Huihui v2 Qwen3.8 Flash Next GSQ RCO Strata abliterated direction
Qwen · Pragmatism0220
Params—
Context—
Smallest0.0 GB
RF
rfdetr cpp seg small
Rfdetr · mudler
Params34M
Context—
Smallest0.0 GB
HY
Hy3 NVFP4
Avifenesh
Params—
Context—
Smallest0.0 GB
QW
nerkyor Qwen3.8 27B EfficientThink SimPO KQVQ4 IQ3Floor 10G MTP
Qwen · zhangrover
Params461M
Context256K
Smallest10.9 GB
MI
Candle Mistral 7B OpenOrca
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB