All GGUF models
206,171 models with specs, quants and memory estimates.
QW
Qwen3.8 27B abliterated MTP
Qwen · hotdogs
Params27B
Context256K
Q4_K_M16.8 GB
GL
GLM 5.3 Flash Uncensored
GLM · BoldingBuilds
Params321B
Context1024K
Smallest76.8 GB
QW
Qwen2.5 VL 3B Instruct
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
XX
encoder
Xxl · chatpig
Params219M
Context512
Q4_K_M2.9 GB
ME
G4 MeroMero 26B A4B It Uncensored Heretic
Meromero · llmfan46
Params25.2B
Context256K
Q4_K_M17.3 GB
OR
Ornith 1.5 9b Mtp
Ornith · protoLabsAI
Params456M
Context256K
Q4_K_M5.8 GB
LY
Lythri 4B A2B
Lythri · bartowski
Params4.63B
Context128K
Q4_K_M3.2 GB
GL
GLM 5
GLM · unsloth
Params754B
Context198K
Q4_K_M455.9 GB
MI
Huihui Mistral Small 3.2 24B Instruct 2506 Abliterated
Mistral · maerong3
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.5 35B A3B APEX
Qwen · mudler
Params34.7B
Context256K
Smallest13.3 GB
NE
NeoHorse-1-4B
Neohorse · TokenRhythm
Params4.21B
Context256K
Q4_K_M2.7 GB
DE
WhiteRabbitNeo WhiteRabbitNeo V3 7B
Deephat · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
WI
ehartford_wizard-vicuna-13b-uncensored
Wizard · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
LF
LiquidAI_LFM2.5 1.2B Instruct
Lfm · lmstudio-community
Params1.17B
Context125K
Q4_K_M0.7 GB
GE
Gemma 4 12B HybridAgent
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen3 32B Uncensored
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen3 VL 8B Heretic Stable
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
LL
Llama 3.2 8X4B MOE V2 Dark Champion Instruct uncensored abliterated 21B
Llama · DavidAU
Params20.9B
Context128K
Q4_K_M12.9 GB
GL
Glm-4-9B-0414
GLM · unsloth
Params9.4B
Context32K
Q4_K_M6.2 GB
GR
Granite 20b Code Instruct
Granite · bartowski
Params20B
Context8K
Q4_K_M12.8 GB
HO
Holo4 35B A3B
Holo · Hcompany
Params34.7B
Context256K
Q4_K_M21.3 GB
GE
Fallen Gemma3 27B v1
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
FO
Foundation Sec 8B Reasoning
Foundation · fdtn-ai
Params8B
Context128K
Q4_K_M4.9 GB
SA
Sabi Noema
Sabi · owao
Params27B
Context256K
Q4_K_M16.5 GB
DE
DeepSeek-V4.1-Flash-mixed-q2
DeepSeek · apetersson
Params552B
Context1024K
Smallest168.9 GB
QW
qwen2.5-32b-instruct
Qwen · Qwen
Params32.8B
Context128K
Q4_K_M19.9 GB
RE
Blackfrost-AI/RED-SNOW-5.3-FLASH-BF16
Red · freakyskittle
Params321B
Context1024K
Q4_K_M181.5 GB
HO
K2-Horizon-MoVA-36B-A4B
Horizon · mradermacher
Params37.4B
Context512K
Q4_K_M22.4 GB
QW
Qwen3 8B Heretic
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes Final NVFP4
Qwen · jan1k
Params34.7B
Context256K
Smallest21.1 GB