Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4 Flash 0731 heretic abliterated v2 GGUF lora
DeepSeek · MorinoNushi
Params—
Context—
Smallest0.0 GB
GGUF
MI
Dolphin Mistral 24B Venice Edition
Mistral · eaddario
Params23.6B
Context32K
Q4_K_M12.4 GB
GGUF
GL
GLM 5.3 Flash Abliterated LoRA
GLM · GCSA-AiLab
Params144M
Context—
Smallest0.3 GB
GGUF
OM
Sakura d1 omni 600M HighQuality
Omni · webmp3
Params381M
Context125K
Smallest0.0 GB
GGUF
JU
juggernaut xl v9 q4k
Juggernaut · MomoSoft
Params3.47B
Context—
Smallest3.0 GB
GGUF
QW
Qwen3.8 27B NVFP4 prefiller
Qwen · ISTA-DASLab
Params24.4B
Context—
Smallest13.7 GB
GGUF
RF
rfdetr cpp seg xlarge
Rfdetr · mudler
Params37M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.8 Flash Next PLE tables
Qwen · mduca771
Params51.2B
Context—
Smallest28.8 GB
GGUF
QW
QJev3.5 0.8B
Qwen · ZY-Lee4
Params752M
Context256K
Smallest0.0 GB
GGUF
CO
command a 03 2025 writer v1 i1
Command · mradermacher
Params111B
Context128K
Smallest0.0 GB
GGUF
TI
stories converted
Tinyllamas · shibatch
Params24M
Context128
Smallest0.0 GB
GGUF
IN
Inkling
Inkling · AtomicChat
Params947B
Context1024K
Smallest1.0 GB
GGUF
SA
SAM3DBody cpp onnx models
Sam · AmmarkoV
Params7M
Context—
Smallest0.0 GB
GGUF
OC
PP OCRv6 medium rec
Ocrv · cstr
Params19M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · bullerwins
Params284B
Context1024K
Smallest88.0 GB
GGUF
GE
axom x1 ultra
Gemma · AxomLabs
Params12M
Context—
Smallest0.0 GB
GGUF
CA
candle quantized t5
Candle · lmz
Params248M
Context—
Smallest0.1 GB
GGUF
QW
Qwen3.5 4B BE
Qwen · taronaeo
Params4.33B
Context256K
Q4_K_M2.8 GB
GGUF
MI
Candle Mistral Trismegistus 7B
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
CO
cow encoder
Cow · calcuis
Params2.62B
Context—
Smallest0.4 GB
GGUF
QW
Qwen3.8 Flash Next refusal projection
Qwen · Cudecnik
Params—
Context—
Smallest0.0 GB
GGUF
QW
ATX Swift Qwen3.8 27B Uncensored IQ4 XS M
Qwen · jakeatx
Params27.3B
Context—
Smallest0.0 GB
GGUF
LL
Llama 3.2 3B Instruct BE
Llama · taronaeo
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LF
lfm3 1.7b posttrained 1rco 2mix
Lfm · efeisot
Params1.73B
Context256K
Smallest0.0 GB
GGUF
GR
Granite 4.0 H Micro BE
Granite · taronaeo
Params3.19B
Context1024K
Q4_K_M1.9 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · IMUGLYHUH
Params1.86B
Context256K
Smallest0.9 GB
GGUF
GL
GLM 4.6 Derestricted
GLM · ReadyArt
Params357B
Context198K
Smallest0.7 GB
GGUF
DE
DeepSeek V4 Pro 0813
DeepSeek · 6block
Params1570B
Context1024K
Smallest1.7 GB
GGUF
DE
DeepSeek V4 Flash Vision Uncensored 3.87bpw Q3 K
DeepSeek · MetaphoricalCode
Params284B
Context1024K
Smallest137.6 GB
GGUF
BG
bge reranker v2 m3
BGE · cstr
Params568M
Context—
Smallest0.5 GB
GGUF

Other uses

Keep browsing