Q4_K_M GGUF models

4-bit k-quant, medium. The common default: a good balance of size and quality. 148631 models have a Q4_K_M file. Sizes run from 1M to 2450B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
FL
PornMaster Klein 9b
Flux · rectangleworm
Params8.19B
Context256K
Q4_K_M5.0 GB
GGUF
SP
Raptor 0.6 4B
Spark · OsaurusAI
Params4.1B
Context1024K
Q4_K_M2.6 GB
ReasoningTool use
LE
lemer
Lemer · lthn
Params4.65B
Context128K
Q4_K_M3.4 GB
Vision
ME
MedGo i1
Medgo · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
FL
FLUX.1 Kontext dev
Flux · bullerwins
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
ST
StandardOne 8B
Standardone · StandardThinking
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningVision
LL
Llama Joycaption Beta One Hf Llava
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Vision
LT
LTX 2.5 uncensored v1.1 FP8
Ltx · frtertaer
Params21B
Context—
Q4_K_M7.5 GB
GGUF
GI
GigaAM v3 CTC
Gigaam · handy-computer
Params221M
Context—
Q4_K_M0.2 GB
GGUF
QW
Qwen3.6-35B-A3B
Qwen · TokenTinkerer
Params34.7B
Context256K
Q4_K_M0.6 GB
ReasoningTool use
SP
Spectre 37B v1a
Spectre · BeaverAI
Params36.6B
Context256K
Q4_K_M22.2 GB
GGUF
LL
openassistant_codellama-13b-oasst-sft-v10
Llama · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
Coding
QW
Dolphin3.0 Qwen2.5 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
KI
Kitchoon V2 26B A4B
Kitchoon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
QW
Qwen2.5 32B AGI
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
MA
MS3.2 24B Magnum Diamond
Magnum · Doctor-Shotgun
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
LL
Llama 3 8B Lexi Uncensored
Llama · Orenguteng
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
imajev 9b
Qwen · mindchain
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Qwen3 4B
Qwen · ggml-org
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
QW
Huihui Qwen3.5 2B Abliterated
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
MI
Mistral Small 4 119B 2603 Heretic
Mistral · Rioky
Params119B
Context1024K
Q4_K_M72.2 GB
Vision
LF
LFM2 1.2B
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
HO
K2-Horizon-MoVA-36B-A4B
Horizon · bartowski
Params37.4B
Context512K
Q4_K_M22.7 GB
GGUF
QW
Qwen3 VL 4B Instruct
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
Vision
QW
Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
GGUF
GE
gemma-4-E4B-it
Gemma · TheStageAI
Params7.46B
Context128K
Q4_K_M4.3 GB
GGUF
QW
Qwen3.8 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3 4B Abliterated
Qwen · bartowski
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
SK
Skyfall 31B v4.2
Skyfall · bartowski
Params31.4B
Context128K
Q4_K_M19.3 GB
GGUF
AN
Anima Turbo V1.1
Anima · vanes430
Params2.09B
Context—
Q4_K_M1.4 GB
GGUF

Other quants

Keep browsing