General GGUF models

134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MA
Magnum v4 72b
Magnum · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
ST
Step 3.5 Flash
Step · ggml-org
Params197B
Context256K
Smallest118.7 GB
GGUF
QW
Qwen3-235B-A22B-Instruct-2507
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
GGUF
LY
Lythri 4B A2B
Lythri · bartowski
Params4.63B
Context128K
Q4_K_M3.2 GB
GGUF
GL
GLM 5
GLM · unsloth
Params754B
Context198K
Q4_K_M455.9 GB
GGUF
WI
ehartford_wizard-vicuna-13b-uncensored
Wizard · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LF
LiquidAI_LFM2.5 1.2B Instruct
Lfm · lmstudio-community
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
QW
Qwen3 32B Uncensored
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
GL
Glm-4-9B-0414
GLM · unsloth
Params9.4B
Context32K
Q4_K_M6.2 GB
GGUF
GE
Fallen Gemma3 27B v1
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
DE
DeepSeek-V4.1-Flash-mixed-q2
DeepSeek · apetersson
Params552B
Context1024K
Smallest168.9 GB
GGUF
QW
qwen2.5-32b-instruct
Qwen · Qwen
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
HO
K2-Horizon-MoVA-36B-A4B
Horizon · mradermacher
Params37.4B
Context512K
Q4_K_M22.4 GB
GGUF
QW
Qwen3 8B Heretic
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
NE
NVIDIA Nemotron 3.5 Bolt E4B Uncensored
Nemotron · AtomicChat
Params7.5B
Context64K
Q4_K_M5.1 GB
GGUF
ST
StartLux Decision v1 27B Q4 K M
Startlux · startlux-models
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3.8-27B
Qwen · julianmb
Params27.3B
Context256K
Smallest9.2 GB
GGUF
TE
Ternary Bonsai 2 27B Abliterated PQ2 0 MTP
Ternary · BoldingBuilds
Params27B
Context256K
Smallest7.2 GB
GGUF
GE
Gemma 2 27b It
Gemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
GGUF
QW
Qwen3.8 27B Uncensored IQ4 XS MTP 16GB VRAM
Qwen · Bucoid
Params27.3B
Context256K
Smallest13.9 GB
GGUF
DA
DanTagGen beta
Dantaggen · KBlueLeaf
Params393M
Context512
Smallest0.3 GB
GGUF
NE
Nvidia-Nemotron-3-Super-120B-A12B
Nemotron · unsloth
Params121B
Context1024K
Q4_K_M82.5 GB
GGUF
QW
Qwen2.5 14B_Uncencored
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
GL
Glm-4-32B-0414
GLM · unsloth
Params32.6B
Context32K
Q4_K_M19.7 GB
GGUF
QW
Qwen3.8 9B Heretic Uncensored
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
GR
Granite 4.0 H Tiny
Granite · ibm-granite
Params6.94B
Context1024K
Q4_K_M4.2 GB
GGUF
BI
Bielik-11B-v3.0-Instruct
Bielik · speakleash
Params11.2B
Context32K
Q4_K_M6.7 GB
GGUF
GE
Gemma 4 31B Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
LL
WizardLM 1.0 Uncensored Llama2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OR
Orpheus-3B-0.1-Ft
Orpheus · unsloth
Params3.3B
Context128K
Q4_K_M2.1 GB
GGUF

Other uses

Keep browsing