General GGUF models
134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.
GE
Gemma 3 1b It Abliterated
Gemma · bartowski
Params1B
Context32K
Q4_K_M0.8 GB
GE
Baihua Gemma4 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
QW
Qwen3.8-Flash-Next GSQ-RCO
Qwen · rSalone
Params177B
Context256K
Smallest83.8 GB
D1
d1 3B
NANI-Nithin
Params2.7B
Context32K
Q4_K_M1.7 GB
QW
Qwen2.5 14B Instruct 1M
Qwen · bartowski
Params14.8B
Context986K
Q4_K_M9.0 GB
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B Uncensored Heretic MTP UD
Qwen · codavidgarcia
Params27.3B
Context256K
Smallest10.9 GB
GR
Granite 4.0 1b
Granite · ibm-granite
Params1.63B
Context128K
Q4_K_M1.0 GB
QU
QuartetAnemoi 70B t0.0001
Quartetanemoi · backyardai
Params69B
Context32K
Q4_K_M41.4 GB
LL
Llama xLAM 2 8b Fc R
Llama · Salesforce
Params8B
Context128K
Q4_K_M4.9 GB
HO
K2 Horizon 7B Uno Uncensored
Horizon · geantendormi
Params9B
Context512K
Smallest5.1 GB
GE
Gemma 3 270m It
Gemma · ggml-org
Params268M
Context32K
Smallest0.3 GB
WH
whisper tiny
Whisper · oxide-lab
Params38M
Context—
Smallest0.0 GB
NE
nexus medical
Nexus · King3Djbl
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen Qwen1.5 MoE A2.7B Chat
Qwen · tensorblock
Params14.3B
Context32K
Smallest5.9 GB
UN
UnslopNemo 12B v3
Unslopnemo · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen3 8b Abliterated
Qwen · richardyoung
Params8.19B
Context40K
Q4_K_M5.0 GB
MI
MiniCPM5 1B
MiniCPM · NANI-Nithin
Params1.08B
Context128K
Q4_K_M0.7 GB
GE
Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
LO
LoKuS 13B
Lokus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen_Qwen3 0.6B
Qwen · lmstudio-community
Params752M
Context40K
Q4_K_M0.5 GB
DE
DeepScaleR 1.5B Preview
Deepscaler · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
LL
Llama3-Chinese-8B-Instruct
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
MA
Magidonia 24B v4.3 Heretic v1.2
Magidonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.5 27B Uncensored Heretic v1
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen2.5 0.5B Instruct
Qwen · ThomasBaruzier
Params494M
Context32K
Q4_K_M0.4 GB
LF
LFM2 8B A1B
Lfm · LiquidAI
Params8.34B
Context125K
Q4_K_M5.0 GB
XL
xLAM 8x7b R
Xlam · legraphista
Params46.7B
Context32K
Smallest9.8 GB
LL
Llama 3.3 70B Instruct Abliterated v2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GR
Granite 3.1 8b Instruct
Granite · bartowski
Params8.17B
Context128K
Q4_K_M4.9 GB