General GGUF models

134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.2 3B Instruct Abliterated
Llama · RichardErkhov
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
WI
WizardLM 2 7B GGUF smashed
Wizardlm · PrunaAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LF
Lfm2-1.2B
Lfm · unsloth
Params1.17B
Context32K
Q4_K_M0.7 GB
GGUF
MI
MiniChat 1.5 3B Sorah
Minichat · mradermacher
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
LL
Open Insurance LLM Llama3 8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama Krikri 8b Instruct
Llama · ilsp
Params8.2B
Context128K
Q4_K_M5.0 GB
GGUF
MI
Mistral 7b Sandbagging Cb New
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TW
tweety 7b tatar v24a
Tweety · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
ultratensor models
DeepSeek · NagusameCS
Params73.8B
Context1024K
Smallest17.1 GB
GGUF
IC
darkps ice AI
Ice · bartowski
Params8.2B
Context40K
Q4_K_M5.2 GB
GGUF
LL
nvidia Llama 3 3 Nemotron Super 49B v1 5
Llama · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
QW
Qwen1.5 MoE A2.7B Chat
Qwen · duyntnet
Params14.3B
Context32K
Q4_K_M9.5 GB
GGUF
HE
Hebrew_Nemo
Hebrew · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
ID
ideogram 4
Ideogram · molbal
Params9.28B
Context—
Smallest5.6 GB
GGUF
XI
Xing4.0 29B A4B CRACK
Xing · dealignai
Params31.2B
Context256K
Q4_K_M19.0 GB
GGUF
CG
cgato TheSpice 7b FT ExperimentalOrca
Cgato · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mr Grammatology clinical problems Mistral 7B 0.5
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MU
music generation model
Music · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
UN
UNAversal 8x7B v1beta i1
Unaversal · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
BE
BeeLLM 30P
Beellm · schizophyllume
Params12M
Context4K
Smallest0.0 GB
GGUF
MI
Air Striker Mixtral 8x7B ZLoss
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
LL
Meta Llama 3.1 Chat Uncensored i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
ED
Eduardo 27b
Eduardo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
SY
migtissera_synthia-7b-v2.0
Synthia · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3.5 9B Heretic v2
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
MI
openbuddy_openbuddy-mistral-7b-v13.1
Mistral · TheBloke
Params7.28B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Young Children Storyteller Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KA
KangalKhan RawRuby 7B i1
Kangalkhan · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IN
Inkbot 13B 8k 0.2
Inkbot · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MO
MonarchPipe 7B slerp
Monarchpipe · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF

Other uses

Keep browsing