All GGUF models
206,171 models with specs, quants and memory estimates.
QW
Qwen Image 2.1 Uncensored
Qwen · 0xSojalSec
Params7.12B
Context—
Q4_K_M4.6 GB
QW
Qwen3.8 27B Heretic JP Roleplay NSFW DanbooruTags
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
MI
mistralai_Devstral Small 2 24B Instruct 2512
Mistral · lmstudio-community
Params23.6B
Context384K
Q4_K_M14.3 GB
MI
Models Mrfakename Mistral Small 3.1 24b Instruct 2503 Hf
Mistral · MaziyarPanahi
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
Qwen3 TTS 12Hz 1.7B Base
Qwen · ggml-org
Params1.73B
Context32K
Q4_K_M1.0 GB
LL
Hermes 3 Llama 3.1 8B
Llama · NousResearch
Params8B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
YI
models--01-ai--Yi-1.5-6B-Chat
Yi · MaziyarPanahi
Params6.06B
Context4K
Q4_K_M3.7 GB
GE
Models Google Gemma 3 12b It
Gemma · MaziyarPanahi
Params11.8B
Context128K
Q4_K_M7.3 GB
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-64k
Llama · MaziyarPanahi
Params8B
Context63K
Q4_K_M4.9 GB
MI
Models Mistralai Mistral Nemo Instruct 2407
Mistral · MaziyarPanahi
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Models Meta Llama Llama 3.3 70B Instruct
Llama · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · thesven
Params7B
Context32K
Q4_K_M4.4 GB
MI
models--mistralai--mathstral-7B-v0.1
Mistral · MaziyarPanahi
Params7.25B
Context32K
Q4_K_M4.4 GB
TP
tpn004 cand v3f aim
Tpn · tatjr13
Params23.6B
Context128K
Smallest14.7 GB
TP
tpn004 cand v4f l1im
Tpn · tatjr13
Params23.6B
Context128K
Smallest18.3 GB
MI
Rocinante X 12B v1
Mistral · TheDrummer
Params12.2B
Context128K
Q4_K_M7.5 GB
TP
tpn004 cand v3f l1im
Tpn · tatjr13
Params23.6B
Context128K
Smallest18.3 GB
QW
Qwen3.8 27B TWIN TURBO Fable Cold Fusion 709 ULTRA HERETIC Uncensored NM DAU NEO MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M18.0 GB
QW
Qwen3 VL 32B Instruct ultra uncensored heretic H3
Qwen · nif0
Params25.2B
Context256K
Q4_K_M14.9 GB
LL
Llama 3.2 1B Instruct
Llama · hugging-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Models Meta Llama Meta Llama 3.1 70B Instruct
Llama · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M42.5 GB
TP
tpn004 cand v4f aim
Tpn · tatjr13
Params23.6B
Context128K
Smallest14.7 GB
TP
tpn004 cand v1f aim
Tpn · tatjr13
Params23.6B
Context128K
Smallest14.7 GB
GL
GLM 5.3 Flash GGUF DGX Spark
GLM · autotrust
Params279B
Context1024K
Smallest84.9 GB
QW
Qwen Image 2.1 PE T2I Heretic
Qwen · pottokao
Params8.95B
Context256K
Q4_K_M5.9 GB
LL
Llama-4-Scout-17B-16E-Instruct
Llama · unsloth
Params108B
Context10240K
Q4_K_M65.4 GB
OP
Tinyopenjev For Testing
Openjev · ggml-org
Params33M
Context256K
Smallest0.0 GB
MI
MiniMax H3 encoder
Minimax · joeygambino
Params32.8B
Context256K
Q4_K_M19.8 GB
QW
Qwen3.5 35B A3B
Qwen · bartowski
Params35.5B
Context256K
Q4_K_M22.3 GB