General GGUF models

134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
SP
Spark X2.5 4B
Spark · abenzerps
Params4.1B
Context1024K
Q4_K_M2.6 GB
GGUF
TE
Ternary Bonsai 8B
Ternary · prism-ml
Params8.19B
Context64K
Smallest2.2 GB
GGUF
JA
Jan-v3.5-4B
Jan · janhq
Params4.4B
Context256K
Q4_K_M2.7 GB
GGUF
HY
Hy MT2 1.8B
tencent
Params1.79B
Context256K
Q4_K_M1.1 GB
GGUF
LF
LFM2.5 1.2B Instruct
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
SP
Spark X2.5 4B Heretic jp
Spark · soyaakinohara
Params4.1B
Context1024K
Q4_K_M2.6 GB
Tool use
DA
POCKET-Darwin-180B
Darwin · FINAL-Bench
Params177B
Context256K
Smallest111.3 GB
GGUF
LF
LFM2.5 230M
Lfm · LiquidAI
Params230M
Context125K
Q4_K_M0.2 GB
GGUF
GR
Granite 4.2 3b
Granite · ibm-granite
Params3.66B
Context128K
Q4_K_M2.2 GB
GGUF
GR
Granite 4.2 8b
Granite · ibm-granite
Params8.79B
Context128K
Q4_K_M5.3 GB
GGUF
QW
Qwen-Agentworld-35B-A3B
Qwen · unsloth
Params34.7B
Context256K
Q4_K_M22.1 GB
GGUF
GP
gpt-oss-20b
gpt-oss · ggml-org
Params870M
Context128K
Smallest0.9 GB
GGUF
GE
Gemma 3 1b It
Gemma · ggml-org
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
MI
MiniMax H3
Minimax · leejet
Params20.1B
Context—
Q4_K_M11.4 GB
GGUF
GP
gpt-oss-120b
gpt-oss · ggml-org
Params800M
Context128K
Smallest0.8 GB
GGUF
GL
Glm-4.7-Flash
GLM · unsloth
Params30B
Context198K
Q4_K_M18.3 GB
GGUF
GE
POCKET 26B
Gemma · FINAL-Bench
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
GR
Granite 4.2 30b
Granite · ibm-granite
Params29.3B
Context128K
Q4_K_M17.7 GB
GGUF
QW
qwen2.5-3b-instruct
Qwen · Qwen
Params3.4B
Context32K
Q4_K_M2.1 GB
GGUF
SP
spark s1 4b v6
Spark · abhishek085
Params4.21B
Context256K
Smallest3.5 GB
GGUF
QW
Qwen2.5 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MI
s1 mini
Mini · superwhisper
Params752M
Context40K
Q4_K_M0.5 GB
GGUF
SP
Spark X2.5 1.7B
Spark · XHToken
Params1.71B
Context1024K
Q4_K_M1.1 GB
GGUF
QW
Qwen3-1.7B
Qwen · unsloth
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
QW
Qwen3 0.6B Instruct
Qwen · Qwen
Params596M
Context40K
Smallest0.6 GB
GGUF
CA
Carbon 8B
Carbon · HuggingFaceBio
Params8.26B
Context32K
Q4_K_M5.5 GB
GGUF
CA
Carbon 3B
Carbon · HuggingFaceBio
Params3.45B
Context32K
Q4_K_M2.3 GB
GGUF
LF
LFM2.5-24B-A2B
Lfm · LiquidAI
Params24B
Context128K
Q4_K_M14.5 GB
GGUF
FL
Flint Preview
Flint · unsloth
Params39.8B
Context256K
Smallest11.4 GB
GGUF
EX
Experiment26 7B passthrough 10slice
Experiment · babybirdprd
Params7B
Context—
Q4_K_M0.0 GB
GGUF

Other uses

Keep browsing