General GGUF models
134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.
NE
NVIDIA-Nemotron-3.5-Lightning-30B-A3B
Nemotron · ggml-org
Params31.6B
Context1024K
Smallest1.2 GB
PR
Hy4 preview
Preview · AngelSlim
Params770B
Context1024K
Q4_K_M467.3 GB
HY
Hy3
AngelSlim
Params295B
Context256K
Q4_K_M182.3 GB
LA
Laguna XS 2.1
Laguna · poolside
Params33.4B
Context256K
Q4_K_M20.3 GB
QW
Qwen3.8 27B Uncensored
Qwen · azukivc
Params27.3B
Context256K
Q4_K_M16.5 GB
LL
Llama 3.2 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwen3 1.7B Instruct
Qwen · Qwen
Params1.72B
Context40K
Smallest1.8 GB
LF
LFM2.5-24B-A2B-Preview
Lfm · unsloth
Params24B
Context128K
Smallest7.5 GB
LL
Llama-3.2-3B-Instruct
Llama · unsloth
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwen2.5 14B Instruct
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
Llama 3.2 1B Instruct
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
Qwen3-0.6B
Qwen · unsloth
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen3 4B
Qwen · bartowski
Params4B
Context32K
Q4_K_M2.5 GB
ME
Mellum2 12B A2.5B Instruct
Mellum · JetBrains
Params12.1B
Context128K
Smallest12.9 GB
GL
GLM 5.2
GLM · unsloth
Params754B
Context1024K
Q4_K_M465.8 GB
QW
Qwen3-8B
Qwen · unsloth
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3 1.7B
Qwen · ggml-org
Params2.03B
Context40K
Q4_K_M1.3 GB
VI
VieNeu TTS 0.3B q4
Vieneu · pnnbao-ump
Params294M
Context4K
Smallest0.2 GB
GR
grug 27b mtp
Grug · ProCreations
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Huihui Qwen3.8 Flash Next abliterated i1
Qwen · mradermacher
Params177B
Context—
Smallest0.6 GB
QW
Qwen Image 2.1
Qwen · leejet
Params7.12B
Context—
Smallest2.6 GB
IM
Z Image Turbo
Image · leejet
Params6.15B
Context—
Smallest2.6 GB
TE
test model router download
Test · ggml-org
Params1M
Context2K
Smallest0.0 GB
LT
LTX 2.3 uncensored v1.4 FP8
Ltx · ChrisColeTech
Params21B
Context128K
Q4_K_M7.3 GB
BO
Bonsai-8B
Bonsai · prism-ml
Params8.2B
Context64K
Smallest1.2 GB
QW
Qwen3 32B Awq Compatible Instruct
Qwen · Qwen
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen2.5 0.5B Instruct
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
GE
gemma 7b
Gemma · google
Params8.54B
Context—
Smallest34.2 GB
QW
Qwen3.8 Flash Next REAP 288 Bf16
Qwen · sh0wie
Params124B
Context256K
Q4_K_M83.8 GB
QW
Qwen3 0.6B
Qwen · bartowski
Params752M
Context32K
Q4_K_M0.5 GB