General GGUF models

134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Raw Uncensored Qwen3 14b Heretic Recovered
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
MA
magnum v4 12b
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Llama 3.2 1B Instruct Uncensored
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
HY
Hy MT2 7B
mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
QW
Qwen3 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.8 GB
GGUF
MY
Mythical Destroyer L2 13B
Mythical · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SM
SmolLM2 135M
SmolLM · prithivMLmods
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · lmstudio-community
Params3.84B
Context128K
Q4_K_M2.5 GB
GGUF
TE
Ternary Bonsai 4B
Ternary · prism-ml
Params4B
Context32K
Smallest1.1 GB
GGUF
HE
0 hero Matter 0.2 7B
Hero · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
llama3.1 airoboros3.2 QDT 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 30B A3B
Qwen · 6block
Params30.5B
Context40K
Q4_K_M18.6 GB
GGUF
GL
GLM-4.7-Flash-Uncensored-HauhauCS-Aggressive
GLM · HauhauCS
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
LL
LIama 3.2 test
Llama · bhanuripranathi
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
MA
magnum v4 12b
Magnum · anthracite-org
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
BO
Borealis Open 27b
Borealis · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GL
GLM 4 32B 0414
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
GGUF
MI
MegaBeam Mistral 7B 512k
Mistral · bartowski
Params7.24B
Context512K
Q4_K_M4.4 GB
GGUF
HY
Hy MT2 1.8B 1.25Bit
tencent
Params1.79B
Context256K
Smallest0.5 GB
GGUF
MI
ehartford_dolphin-2.1-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BA
Bathory X 26B A4B 0.1
Bathory · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
GGUF
QW
Huihui Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
GGUF
GE
Gemma 3 270m Qat Q4_0 Unquantized
Gemma · ggml-org
Params268M
Context32K
Smallest0.2 GB
GGUF
LL
Llm Jp 4 8b Instruct
Llm · mmnga-o
Params8.59B
Context64K
Q4_K_M5.3 GB
GGUF
IN
InternLM2
InternLM · legraphista
Params7.74B
Context8K
Smallest1.9 GB
GGUF
MI
Mistral Small Instruct 2409
Mistral · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · lmstudio-community
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
Huihui Qwen3 4B Abliterated v2
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
SP
Spectre 37B v1a GGUF Dirty
Spectre · BeaverAI
Params36.6B
Context256K
Q4_K_M22.2 GB
GGUF
AI
Airoboros L2 7B 2.2
Airoboros · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Other uses

Keep browsing