General GGUF models
134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.
MP
Mpt 7b Chat
Mpt · mradermacher
Params6.65B
Context2K
Q4_K_M4.3 GB
QW
Qwen3 4B
Qwen · NobodyWho
Params4B
Context32K
Q4_K_M2.5 GB
WI
Winterreise-m7
Winterreise · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
models--automerger--Inex12Multiverseex26-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
FA
Falcon
Falcon · mradermacher
Params41.8B
Context2K
Q4_K_M26.0 GB
GE
gemma-4-31B-it-uncensored-biproj
Gemma · ressl
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
MN 12B Celeste V1.9
Qwen · adrose98
Params12.2B
Context1000K
Q4_K_M7.5 GB
EH
ehartford_wizardlm-33b-v1.0-uncensored
Ehartford · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
MI
Ministral 3b instruct
Mistral · mradermacher
Params3.32B
Context128K
Q4_K_M2.0 GB
QW
Swift 1.5 Qwen3.8 27B Uncensored MTP
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
PR
T pro it 2.1
Pro · t-tech
Params32.8B
Context40K
Q4_K_M19.8 GB
MI
MistralMakise Merged 13B
Mistral · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
PY
Pythia 1.4b
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
QW
Qwen3 14B Base
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
AU
Augmental 13B v1.50 A
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen2.5 32B Instruct Abliterated
Qwen · RichardErkhov
Params32.8B
Context32K
Q4_K_M19.9 GB
PH
Athene Phi 3.5 mini instruct orpo
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
TI
TinyLlama 1.1B Chat v1.0 imatrix
Tinyllama · duyntnet
Params1.1B
Context2K
Q4_K_M0.7 GB
AT
Athena v2
Athena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
ST
stabilityai japanese stablelm base gamma 7b
Stabilityai · RichardErkhov
Params7.24B
Context4K
Q4_K_M4.4 GB
GE
Gemma 3 1b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params1B
Context32K
Smallest0.7 GB
LU
dreamgen lucid v1 nemo
Lucid · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
LL
Llama 2 7b Chat Hf Gpt 4 80k Base_Lora
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
YI
Nous Hermes 2 Yi 34B i1
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB
GU
Guanaco 7B Uncensored
Guanaco · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Fathom-Search-4B
Qwen · Mungert
Params4B
Context40K
Q4_K_M2.6 GB
HU
Huihui3.5 67B A3B Abliterated
Huihui · mradermacher
Params67B
Context256K
Q4_K_M40.8 GB
HO
Sakura K2 Horizon 3.7B
Horizon · webmp3
Params5.06B
Context512K
Smallest2.2 GB
MI
Nous Hermes 2 Mistral 7B DPO
Mistral · NousResearch
Params7.24B
Context32K
Q4_K_M4.4 GB
SE
Sensualize Solar 10.7B
Sensualize · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB