All GGUF models
206,171 models with specs, quants and memory estimates.
GE
Gemma 3n E2B It
Gemma · bartowski
Params4.46B
Context32K
Q4_K_M2.8 GB
LL
calme 2.2 llama3 70b
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Huihui Qwen3.8 Flash Next abliterated MTP
Qwen · htdohk
Params177B
Context256K
Q4_K_M1.9 GB
ME
G4 MeroMero 31B Uncensored Heretic
Meromero · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3.8 27B Uncensored noMTP Q4 K M OpenCode
Qwen · oceanonline
Params27B
Context256K
Q4_K_M16.5 GB
MI
Minimax-M2.5
Minimax · unsloth
Params230B
Context192K
Q4_K_M138.3 GB
SU
Sulphur 2 Prompt Enhancer Uncensored
Sulphur · PeppX
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwopus3.5 9B v3
Qwen · Jackrong
Params8.95B
Context256K
Q4_K_M5.6 GB
SH
Shadow-Siren-14B-v2-Pruned
Shadow · mradermacher
Params13.8B
Context256K
Q4_K_M9.2 GB
AI
jondurbin_airoboros-c34b-3.1.2
Airoboros · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
QW
Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
IN
InternVL3_5 38B
Internvl · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
PH
Phi 3 Medium 4k Instruct
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
IN
InternVL3_5 38B
Internvl · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen2.5 32B
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
LF
LFM2.5 1.2B JP 202606
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · nyan-ame
Params7.6B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.8-27B
Qwen · LxBarn
Params27.3B
Context256K
Q4_K_M16.6 GB
DE
Deepseeker Kunou Qwen2.5 14b i1
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
LF
LFM2.5 24B A2B Uncensored
Lfm · pottokao
Params24B
Context128K
Q4_K_M14.5 GB
GE
Genz 70b
Genz · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwopus3.5 27B v3 Abliterated
Qwopus · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ZW
ZwZ2 4B
Zwz · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · bocalan
Params3.09B
Context32K
Q4_K_M1.9 GB
LL
Hermes 3 Llama 3.1 8B Lorablated
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
MI
Pixtral
Mistral · ggml-org
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
MI
kolibri-vikhr-mistral-0427
Mistral · Vikhrmodels
Params7.6B
Context32K
Q4_K_M4.6 GB
MI
Mistral Small 4 119B 2603 Heretic
Mistral · Rioky
Params119B
Context1024K
Q4_K_M72.2 GB
OR
ddh0_orcamaidxl-17b-32k
Orcamaidxl · TheBloke
Params17.5B
Context32K
Q4_K_M10.5 GB