Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
AL
alist guardian decision adapter
Alist · NateRunsA-LIST
Params22M
Context—
Smallest0.0 GB
GGUF
DE
keys DeepSeekV4 Flash GA 0731 Dspark Abliterated 32 32
DeepSeek · bullerwins
Params19.8B
Context1024K
Smallest10.9 GB
GGUF
PU
public storage
Public · dayuadg
Params8.19B
Context256K
Smallest0.2 GB
GGUF
AN
Analyst
Analyst · webAI-Official
Params65M
Context—
Smallest0.1 GB
GGUF
GL
GLM 4.7 i1
GLM · mradermacher
Params358B
Context198K
Smallest0.7 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · prometheusAIR
Params284B
Context1024K
Smallest6.9 GB
GGUF
UN
unlimited ocr crispembed
Unlimited · cstr
Params3.34B
Context—
Smallest0.2 GB
GGUF
MI
buzzwords style loras
MiniCPM · BastienHot
Params22M
Context—
Smallest0.1 GB
GGUF
AP
Apex 35B V1.0
Apex · na0x2c6
Params35.5B
Context256K
Smallest0.4 GB
GGUF
LL
Llama 3.2 90B Vision Instruct
Llama · Thaurock
Params926M
Context—
Smallest2.0 GB
GGUF
IN
indigoFurryMixXL noobaiEPS6
Indigofurrymixxl · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
QW
Qwen3.8 27b Fable5 Distill Abliterated
Qwen · Verkiki
Params461M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.5 122B A10B IQ3 XXS 16G64G
Qwen · zephel01
Params122B
Context256K
Smallest0.4 GB
GGUF
WA
WAN 2.2 SmoothMix FP16
Wan · BigDannyPt
Params14.3B
Context—
Smallest10.8 GB
GGUF
BO
Bonsai 8B requantized
Bonsai · lilyanatia
Params8.19B
Context64K
Smallest0.0 GB
GGUF
HY
Hy3 NVFP4
tiyuvta
Params—
Context—
Smallest0.0 GB
GGUF
SM
SmolLM2 135M Instruct BehaviorTree LoRA
SmolLM · unileon-robotics
Params2M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4.1 Flash DS4 Q4
DeepSeek · ivanfioravanti
Params485M
Context—
Smallest1.0 GB
GGUF
AN
AnyCalib
Anycalib · Asher-1
Params321M
Context—
Smallest0.4 GB
GGUF
WM
wmt21 dense 24 wide x en
Wmt · cstr
Params4.7B
Context—
Smallest2.7 GB
GGUF
QW
Qwen3.8 27B RVN vision MTP
Qwen · cfigueiroa
Params461M
Context256K
Q4_K_M16.8 GB
GGUF
LF
lfm2 embed
Lfm · cstr
Params354M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 heretic HXQ3K lite
DeepSeek · NektoDron
Params552B
Context—
Smallest198.0 GB
GGUF
CO
c4ai command r v01 jacobian lens
Command R · gghfez
Params2.62B
Context—
Smallest5.2 GB
GGUF
DM
dms krea2 turbo q4 k m
Dms · DanielMarius
Params12.9B
Context—
Q4_K_M7.5 GB
GGUF
QW
Qwen3.8 Perian
Qwen · jakeatx
Params77.5B
Context256K
Smallest47.5 GB
GGUF
KR
Krea2 checkpoints
Krea · yuji2026
Params12.8B
Context—
Smallest14.6 GB
GGUF
LF
lfm3 1.7b 1rco 2mix
Lfm · efeisot
Params1.73B
Context256K
Smallest0.0 GB
GGUF
QW
Qwen3 Coder REAP 25B A3B MXFP4 MOE
Qwen · noctrex
Params24.9B
Context256K
Smallest0.1 GB
GGUF
PO
pony v6xl q4k
Pony · MomoSoft
Params3.47B
Context—
Smallest2.8 GB
GGUF

Other uses

Keep browsing