General GGUF models
134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.
QW
Qwen2.5 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
LA
poolside_Laguna S 2.1
Laguna · lmstudio-community
Params118B
Context256K
Q4_K_M71.2 GB
FL
Flint
Flint · ggml-org
Params39.8B
Context256K
Q4_K_M23.4 GB
QW
Qwen3.8 27B Uncensored Heretic Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
OR
Huihui Ornith 1.0 9B abliterated MTP
Ornith · huihui-ai
Params2.28B
Context256K
Q4_K_M6.9 GB
LF
LFM2 700M
Lfm · LiquidAI
Params742M
Context125K
Q4_K_M0.5 GB
LL
Meta llama_Meta Llama 3 70B Instruct
Llama · ThomasBaruzier
Params70.6B
Context8K
Q4_K_M42.5 GB
LY
Lythri 4B A2B
Lythri · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
GL
Huihui GLM 4.7 Flash Abliterated
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
QW
Flashnext Abliterated
Qwen · windowsxp811203
Params177B
Context256K
Q4_K_M119.2 GB
GR
Granite 4.1 8b
Granite · ibm-granite
Params8.79B
Context128K
Q4_K_M5.3 GB
QW
qwen2-0_5b-instruct
Qwen · Qwen
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen3.6 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
AR
Artemis 31B v1.2 Abliterix v2
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
MI
Mistral 7B Instruct v0.2 llamafile
Mistral · mozilla-ai
Params7.24B
Context32K
Smallest14.5 GB
GE
gemma 4 12B it uncensored
Gemma · TrevorJS
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen2.5 0.5B Instruct
Qwen · lmstudio-community
Params494M
Context32K
Q4_K_M0.4 GB
KI
Kimi-K2.5
Kimi · unsloth
Params1030B
Context256K
Q4_K_M621.2 GB
DE
Deepseek-V3.1
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
QW
Qwen3.5 4B NSFW ARA Heretic Literotica i1
Qwen · Sinbad-The-Sailor
Params4.2B
Context256K
Q4_K_M2.7 GB
OR
Ornith
Ornith · pfeifferj
Params34.7B
Context256K
Smallest13.0 GB
QW
Qwen3.8 Flash Next Uncensored ik llama
Qwen · ji-farthing
Params177B
Context—
Smallest2.2 GB
MI
MiMo-V2.6-Flash-RL
Mimo · YanissAmz
Params310B
Context1024K
Smallest107.8 GB
GA
GalTransl v4 4B 2601
Galtransl · SakuraLLM
Params4B
Context32K
Smallest2.8 GB
AR
Artemis 31B v1.2
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
MU
Murasaki 4B v0.3
Murasaki · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
QW
sakura-14b-qwen3-v1.5
Qwen · SakuraLLM
Params14.8B
Context32K
Smallest8.2 GB
LY
Lythri 7B A4B
Lythri · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
SA
Sakura GalTransl 14B v3.8
Sakura · SakuraLLM
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen2.5 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB