All GGUF models

206,171 models with specs, quants and memory estimates.

LL
tap-m_luna-ai-llama2-uncensored
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
GR
Granite-4.0-H-Tiny
Granite · unsloth
Params6.94B
Context1024K
Q4_K_M4.3 GB
GGUF
QW
Qwen3 VL 8B Instruct Uncensored V2
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
Qwen2.5 14B Instruct 1M
Qwen · lmstudio-community
Params14.8B
Context986K
Q4_K_M9.0 GB
GGUF
MI
dolphin 2.8 mistral 7b v02
Mistral · lmstudio-community
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
PY
Pyrut 8B Instruct Uncensored i1
Pyrex · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
RO
RoLlama2-7b-Instruct
Rollama · legraphista
Params6.74B
Context4K
Smallest1.5 GB
GGUF
AP
Apex 35B V1.0
Apex · bartowski
Params35.5B
Context256K
Q4_K_M22.8 GB
ReasoningTool useVision
SW
Swish 31B Final
Swish · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
QW
Swift 1.5 Qwen3.8 Flash Next REAP Pruned
Qwen · 90-008
Params109B
Context256K
Smallest55.3 GB
GGUF
QW
Qwen3.8 Flash Next Heretic2 IQ4XS NGQ4
Qwen · cygnal
Params177B
Context256K
Smallest98.4 GB
Vision
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
Coding
GE
Gemma 4 31B Monadize v0.1
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
PH
phonon 40m es
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
GGUF
GE
gemma 3 4b it qat q4 0
Gemma · google
Params3.88B
Context—
Smallest3.2 GB
Vision
IN
Ingot VI 27B Q2
Ingot · dendriteholdings
Params26.9B
Context256K
Smallest7.2 GB
ReasoningTool use
LL
codellama_codellama-34b-python-hf
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
PH
phonon 40m multilingual
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
GGUF
GE
Gemma 4 26B A4B It Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Coding
HU
Ornith 1.5 35B A3B Abliterated CyberTiel Calibrated MTPv2 ICE
Huihui · gbuzhf
Params35.5B
Context256K
Smallest18.8 GB
GGUF
GE
Gemma 4 E4B Abliterated Uncensored
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
Roleplay
QW
Raw Uncensored Qwen3 14b Heretic Recovered
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
MA
magnum v4 12b
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GL
GLM 5.3 Flash Uncensored
GLM · axi0mX
Params321B
Context1024K
Smallest93.3 GB
Vision
LL
Llama 3.2 1B Instruct Uncensored
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
HY
Hy MT2 7B
mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored GGUF UltraOptimised DSpark MTP
Qwen · Solstice-AI
Params26.9B
Context256K
Q4_K_M1.1 GB
ReasoningVision
QW
Qwen3 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.8 GB
GGUF
MY
Mythical Destroyer L2 13B
Mythical · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3VL 8B Uncensored HauhauCS Balanced
Qwen · HauhauCS
Params8.2B
Context256K
Q4_K_M5.0 GB
Vision

Jump to a hub