General GGUF models
134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.
MI
Midnight Miqu 103B v1.0 i1
Midnight · mradermacher
Params103B
Context32K
Smallest22.0 GB
IN
models--automerger--NeuralsynthesisInex12-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
gemma3
Gemma · libretranslate
Params11.8B
Context32K
Smallest1.0 GB
VI
Vicuna 7b v1.3
Vicuna · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
MI
mistral 7b grok
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
EX
Experimentmultiverse 7B slerp
Experimentmultiverse · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
AI
airoboros l2 13B 3.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
Configurable-Mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GR
Ibm Granite_Granite 4.1 8b
Granite · lmstudio-community
Params8.79B
Context128K
Q4_K_M5.3 GB
PY
PygWin 4x7B
Pygwin · mradermacher
Params19.7B
Context4K
Q4_K_M12.1 GB
MI
Kant-Test-0.1-Mistral-7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
PY
pythia 160m
Pythia · QuantFactory
Params162M
Context2K
Q4_K_M0.1 GB
OR
Orca2myth7.2
Orca · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
BE
BeagleNuBuRPInfinWestLakev2 IreneRP Neural 7B slerp
Beaglenuburpinfinwestlakev · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
BA
BanglaLLama-3-8b-BnWiki-Base
Banglallama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
AI
airoboros l2 c70b 3.1.2
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
XL
xLAM 7b R
Xlam · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiroThinker 1.7
Mirothinker · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
LL
Trendyol Cybersecurity LLM v2 70B Q4 K M
Llama · Trendyol
Params70.6B
Context128K
Q4_K_M42.5 GB
NI
Ninja v1 NSFW 128k
Ninja · mmnga
Params7.24B
Context128K
Q4_K_M4.4 GB
BI
Bigstral 12b 32k
Bigstral · mradermacher
Params12.5B
Context32K
Q4_K_M7.5 GB
QW
Qwen2.5 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GR
Granite 4.0 Micro
Granite · bartowski
Params3.4B
Context128K
Q4_K_M2.1 GB
GE
Gemma 4 12b Heretic Styletune Head
Gemma · mradermacher
Params12.9B
Context128K
Q4_K_M7.9 GB
IR
iris 7b
Iris · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
SW
Swallow 7B Instruct
Swallow · TheBloke
Params6.83B
Context4K
Q4_K_M4.1 GB
VE
VertaLily 1.2 1B
Vertalily · VLTX
Params1.17B
Context125K
Q4_K_M0.7 GB
MI
microsoft_WizardLM-2-7B
Microsoft · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
aixsatoshi Honyaku 13b
Aixsatoshi · mmnga
Params13.1B
Context4K
Q4_K_M7.9 GB
PL
lilloukas_platypus-30b
Platypus · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB