GGUF models by gguf-org

43 GGUF models quantized by gguf-org on Hugging Face. Sizes run from 2M to 27.9B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
DI
diffusion
Diffusion · gguf-org
Params695M
Context—
Smallest0.2 GB
GGUF
LL
llada image
Llada · gguf-org
Params6.54B
Context—
Smallest0.2 GB
GGUF
TR
trainer
Trainer · gguf-org
Params596M
Context—
Smallest1.2 GB
GGUF
PI
pixart
Pixart · gguf-org
Params84M
Context—
Smallest0.2 GB
GGUF
ME
Medgemma-1.5-4b-It
Medgemma · gguf-org
Params3.88B
Context128K
Smallest2.4 GB
Vision
GG
ggk
Ggk · gguf-org
Params1.07B
Context—
Smallest1.6 GB
GGUF
MI
minimax h3
Minimax · gguf-org
Params151M
Context—
Smallest0.3 GB
GGUF
PI
pixel
Pixel · gguf-org
Params2M
Context—
Smallest0.0 GB
GGUF
GE
gemma 4 12b it
Gemma · gguf-org
Params11.9B
Context256K
Smallest5.1 GB
ReasoningTool useVision
IM
x image
Image · gguf-org
Params84M
Context—
Smallest0.2 GB
GGUF
YU
yue2 3b
Yue · gguf-org
Params3.77B
Context—
Smallest2.3 GB
GGUF
ED
editor
Editor · gguf-org
Params—
Context—
Smallest0.0 GB
GGUF
FI
fibo2
Fibo · gguf-org
Params8.23B
Context—
Smallest4.6 GB
GGUF
QW
cantonese tts
Qwen · gguf-org
Params1.92B
Context—
Smallest0.3 GB
GGUF

Keep browsing