General GGUF models
134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.
QW
Qwen3.8 27B Uncensored
Qwen · MiawTeam
Params27.3B
Context256K
Q4_K_M16.5 GB
PH
phonon 40m en
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
GE
Writer
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Sugoi 32B Ultra
Qwen · sugoitoolkit
Params32.8B
Context32K
Q4_K_M19.9 GB
RO
RoLlama2-7b-Base
Rollama · legraphista
Params6.74B
Context4K
Smallest1.5 GB
LF
LFM2.5 2.6B Heretic Abliterated
Lfm · Abiray
Params2.7B
Context125K
Q4_K_M1.7 GB
BA
Bathory X 26B A4B 0.2
Bathory · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
NE
nexus finance
Nexus · King3Djbl
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
FILM6912 Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8B
Context—
Q4_K_M0.0 GB
GR
Granite 3.3 8b Instruct
Granite · ibm-granite
Params8.17B
Context128K
Q4_K_M4.9 GB
MI
Mistral Small 24B Instruct 2501
Mistral · unsloth
Params23.6B
Context32K
Q4_K_M14.3 GB
LL
Speechless Llama2 Hermes Orca Platypus WizardLM 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama Artemis
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
GE
gemma 4 31B it uncensored
Gemma · TrevorJS
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen2.5 7B Instruct Abliterated v2
Qwen · lumen-models
Params7.62B
Context32K
Q4_K_M4.7 GB
NE
Nvidia-Nemotron-3-Ultra-550B-A55B
Nemotron · unsloth
Params550B
Context1024K
Q4_K_M359.2 GB
QW
Qwen3 4B Instruct 2507 Polaris Alpha Distill Heretic Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
RW
Rwkv 6 World 7b
Rwkv · latestissue
Params7.64B
Context1024K
Smallest3.0 GB
KE
Kev 9B
Kev · ggml-org
Params9B
Context256K
Q4_K_M6.4 GB
HO
K2-Horizon-32B
Horizon · bartowski
Params34.8B
Context512K
Q4_K_M22.0 GB
QW
Qwen3.5 27B Ultra Uncensored Heretic v2
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
DR
Drex v1.5
Drex · nace-ai
Params9B
Context256K
Smallest9.5 GB
LL
tap-m_luna-ai-llama2-uncensored
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GR
Granite-4.0-H-Tiny
Granite · unsloth
Params6.94B
Context1024K
Q4_K_M4.3 GB
QW
Qwen2.5 14B Instruct 1M
Qwen · lmstudio-community
Params14.8B
Context986K
Q4_K_M9.0 GB
RO
RoLlama2-7b-Instruct
Rollama · legraphista
Params6.74B
Context4K
Smallest1.5 GB
QW
Swift 1.5 Qwen3.8 Flash Next REAP Pruned
Qwen · 90-008
Params109B
Context256K
Smallest55.3 GB
PH
phonon 40m es
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
PH
phonon 40m multilingual
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
HU
Ornith 1.5 35B A3B Abliterated CyberTiel Calibrated MTPv2 ICE
Huihui · gbuzhf
Params35.5B
Context256K
Smallest18.8 GB