General GGUF models

134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
OR
Ornith 1.0 9B
Ornith · ornith-ai
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
MI
MiniMax H3
Minimax · unsloth
Params20B
Context—
Q4_K_M18.2 GB
GGUF
QW
Qwen Image 2.1
Qwen · unsloth
Params7.12B
Context—
Q4_K_M4.2 GB
GGUF
OR
Ornith 1.0 35B
Ornith · ornith-ai
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
WA
Wan2.1
Wan · DeepBeepMeep
Params9.2B
Context256K
Q4_K_M0.3 GB
GGUF
HY
HyperCLOVAX SEED Text Instruct 1.5B
Hyperclovax · rippertnt
Params1.81B
Context128K
Q4_K_M1.1 GB
GGUF
HY
Hy MT2 7B
tencent
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
QW
Qwen2.5 32B Instruct
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Qwen3 8B Awq Compatible Instruct
Qwen · Qwen
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
qwen2.5-7b-instruct
Qwen · Qwen
Params7.6B
Context128K
Q4_K_M4.7 GB
GGUF
QW
Qwen3 4B Instruct Awq
Qwen · Qwen
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
GP
Gpt-Oss-20B
gpt-oss · unsloth
Params20.9B
Context128K
Q4_K_M11.6 GB
GGUF
JI
jinen-v1-small-hf
Jinen · togatogah
Params110M
Context1K
Smallest0.1 GB
GGUF
YU
YuE2 LM
Yue · scragnog
Params3.8B
Context24K
Q4_K_M2.4 GB
GGUF
LF
LFM2.5 2.6B
Lfm · LiquidAI
Params2.7B
Context128K
Q4_K_M1.7 GB
GGUF
QW
Qwen3-4B
Qwen · unsloth
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
DA
POCKET 35B
Darwin · FINAL-Bench
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Qwen3-4B-Instruct-2507
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
MO
models moved
Models · ggml-org
Params34M
Context—
Smallest0.0 GB
GGUF
LA
Laguna S 2.1
Laguna · poolside
Params118B
Context1024K
Q4_K_M96.0 GB
GGUF
QW
RVN Qwen3.8 Flash Next Abliterated Uncensored IQ3 S Strata
Qwen · jimmy31chen
Params177B
Context256K
Smallest88.9 GB
GGUF
QW
qwen2.5-1.5b-instruct
Qwen · Qwen
Params1.78B
Context32K
Q4_K_M1.1 GB
GGUF
QW
Qwen3.8-27B-DFlash2
Qwen · z-lab
Params1.92B
Context256K
Q4_K_M1.1 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen3-30B-A3B-Instruct-2507
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
Qwen Image 2.1 Turbo
Qwen · DogukanUrker
Params7.1B
Context—
Smallest2.4 GB
GGUF
GL
GLM 5.3
GLM · unsloth
Params754B
Context1024K
Smallest216.7 GB
GGUF
QW
qwen2.5-0.5b-instruct
Qwen · Qwen
Params630M
Context32K
Q4_K_M0.5 GB
GGUF
SP
Spark X2.5 4B
Spark · XHToken
Params4.1B
Context1024K
Q4_K_M2.6 GB
GGUF
QW
Qwen3 14B Awq Compatible Instruct
Qwen · Qwen
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF

About General GGUF models

134,659 GGUF models are filed under General: general chat and instruction-following models. The most downloaded are Ornith 1.0 9B, MiniMax H3 and Qwen Image 2.1. Parameter counts run from 0M to 20260731B, and the longest trained context window is 4194304K tokens.

General models are the broadest choice for chat and instruction following. Start with the size that fits your GPU, then pick a quant. The families you will see most are Llama (26695), Qwen (12868) and Gemma (7914).

Frequently asked questions

What are General GGUF models?

General chat and instruction-following models. There are 134,659 of them on this site.

Which General GGUF model should I start with?

The most downloaded is Ornith 1.0 9B. Choose the size that fits your GPU, then a Q4_K_M quant unless you have memory to spare.

Other uses

Keep browsing