General GGUF models
134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.
AP
APUS Reflex 9B
Apus · apus-ailab
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
mistralai_mistral-7b-v0.1
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
Sommerfugl 31b v2
Sommerfugl · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen1.5-0.5B-Chat-AWQ-fp16
Qwen · Qwen
Params620M
Context32K
Q4_K_M0.4 GB
QW
Qwen3 4B
Qwen · lmstudio-community
Params4B
Context32K
Q4_K_M2.5 GB
HO
K2 Horizon MoVA 36B A4B Uncensored
Horizon · mradermacher
Params37.4B
Context512K
Q4_K_M22.4 GB
JE
Jebadiah 9b v2
Jebadiah · frontier-infra
Params9.2B
Context256K
Q4_K_M5.8 GB
EU
L3.3 70B Euryale v2.3
Euryale · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
OP
openchat-3.6-8b-20240522
Openchat · legraphista
Params8B
Context8K
Smallest2.0 GB
QW
Qwen3-235B-A22B
Qwen · unsloth
Params235B
Context40K
Q4_K_M142.2 GB
QW
Qwen3 Sex
Qwen · ystemsrx
Params4B
Context256K
Smallest4.3 GB
HU
Hunyuan-MT-7B
Hunyuan · Mungert
Params7.5B
Context256K
Q4_K_M4.7 GB
QW
Jev Style Qwen3.5 2B Decision
Qwen · chaoliangUNSW
Params1.94B
Context256K
Q4_K_M1.3 GB
GE
Ablation 188 Gemma3.Webnovels.Test.Gemma 3 12b
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
SM
SmolLM2 135M Instruct
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
ME
G4 MeroMero v2 31B
Meromero · zerofata
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen2.5-14B-Instruct-1M
Qwen · Mungert
Params14.8B
Context986K
Q4_K_M9.2 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · lmstudio-community
Params7.25B
Context32K
Q4_K_M4.4 GB
QW
Sakura 1.5B Qwen2.5 v1.0 GGUF IMX
Qwen · shing3232
Params1.78B
Context128K
Smallest1.3 GB
GL
GLM-5.3-Flash
GLM · neuralll
Params313B
Context1024K
Smallest113.6 GB
LA
m51Lab MiniMax M2.7 REAP 139B A10B
Lab · mradermacher
Params139B
Context192K
Q4_K_M84.2 GB
GE
avemio digital gemma 2b Sft pretrain 6000 steps merge
Gemma · RichardErkhov
Params2.5B
Context8K
Q4_K_M1.6 GB
QW
Qwen2.5 7B Instruct
Qwen · paultimothymooney
Params7.62B
Context32K
Q4_K_M4.7 GB
HU
Humanizer
Humanizer · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
NE
DictaLM 3.0 Nemotron 12B Instruct
Nemotron · dicta-il
Params12.3B
Context1024K
Q4_K_M7.5 GB
GE
Gemma 2 9b It
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen3 14B
Qwen · ggml-org
Params14.8B
Context40K
Q4_K_M9.0 GB
SM
SmolLM2 135M
SmolLM · QuantFactory
Params135M
Context8K
Q4_K_M0.1 GB
GP
Gpt Oss 20b
gpt-oss · bartowski
Params20.9B
Context128K
Q4_K_M11.7 GB
GR
Granite 4.1 3b
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB