Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
DE
DeepSeek V4 Flash 0731 heretic abliterated v2 GGUF lora
DeepSeek · MorinoNushi
Params—
Context—
Smallest0.0 GB
MI
Dolphin Mistral 24B Venice Edition
Mistral · eaddario
Params23.6B
Context32K
Q4_K_M12.4 GB
GL
GLM 5.3 Flash Abliterated LoRA
GLM · GCSA-AiLab
Params144M
Context—
Smallest0.3 GB
OM
Sakura d1 omni 600M HighQuality
Omni · webmp3
Params381M
Context125K
Smallest0.0 GB
JU
juggernaut xl v9 q4k
Juggernaut · MomoSoft
Params3.47B
Context—
Smallest3.0 GB
QW
Qwen3.8 27B NVFP4 prefiller
Qwen · ISTA-DASLab
Params24.4B
Context—
Smallest13.7 GB
RF
rfdetr cpp seg xlarge
Rfdetr · mudler
Params37M
Context—
Smallest0.0 GB
QW
Qwen3.8 Flash Next PLE tables
Qwen · mduca771
Params51.2B
Context—
Smallest28.8 GB
QW
QJev3.5 0.8B
Qwen · ZY-Lee4
Params752M
Context256K
Smallest0.0 GB
CO
command a 03 2025 writer v1 i1
Command · mradermacher
Params111B
Context128K
Smallest0.0 GB
TI
stories converted
Tinyllamas · shibatch
Params24M
Context128
Smallest0.0 GB
IN
Inkling
Inkling · AtomicChat
Params947B
Context1024K
Smallest1.0 GB
SA
SAM3DBody cpp onnx models
Sam · AmmarkoV
Params7M
Context—
Smallest0.0 GB
OC
PP OCRv6 medium rec
Ocrv · cstr
Params19M
Context—
Smallest0.0 GB
DE
DeepSeek V4 Flash
DeepSeek · bullerwins
Params284B
Context1024K
Smallest88.0 GB
GE
axom x1 ultra
Gemma · AxomLabs
Params12M
Context—
Smallest0.0 GB
CA
candle quantized t5
Candle · lmz
Params248M
Context—
Smallest0.1 GB
QW
Qwen3.5 4B BE
Qwen · taronaeo
Params4.33B
Context256K
Q4_K_M2.8 GB
MI
Candle Mistral Trismegistus 7B
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
CO
cow encoder
Cow · calcuis
Params2.62B
Context—
Smallest0.4 GB
QW
Qwen3.8 Flash Next refusal projection
Qwen · Cudecnik
Params—
Context—
Smallest0.0 GB
QW
ATX Swift Qwen3.8 27B Uncensored IQ4 XS M
Qwen · jakeatx
Params27.3B
Context—
Smallest0.0 GB
LL
Llama 3.2 3B Instruct BE
Llama · taronaeo
Params3.21B
Context128K
Q4_K_M2.0 GB
LF
lfm3 1.7b posttrained 1rco 2mix
Lfm · efeisot
Params1.73B
Context256K
Smallest0.0 GB
GR
Granite 4.0 H Micro BE
Granite · taronaeo
Params3.19B
Context1024K
Q4_K_M1.9 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · IMUGLYHUH
Params1.86B
Context256K
Smallest0.9 GB
GL
GLM 4.6 Derestricted
GLM · ReadyArt
Params357B
Context198K
Smallest0.7 GB
DE
DeepSeek V4 Pro 0813
DeepSeek · 6block
Params1570B
Context1024K
Smallest1.7 GB
DE
DeepSeek V4 Flash Vision Uncensored 3.87bpw Q3 K
DeepSeek · MetaphoricalCode
Params284B
Context1024K
Smallest137.6 GB
BG
bge reranker v2 m3
BGE · cstr
Params568M
Context—
Smallest0.5 GB