Q3_K_L GGUF models

3-bit k-quant, large. A little better than Q3_K_M at a slightly larger size. 101200 models have a Q3_K_L file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
PI
maywell_pivot-sus-rp
Pivot · TheBloke
Params34.4B
Context8K
Q4_K_M20.7 GB
Roleplay
QW
Qwen2.5 1.5B Instruct
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
ZI
idea-ccnl_ziya-coding-34b-v1.0
Ziya · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
DI
DialFactSum ACU 8B
Dialfactsum · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
WI
Wizard Vicuna 30B Uncensored
Wizard · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
QW
Qwen2 Audio 7B
Qwen · NexaAI
Params7.75B
Context8K
Q4_K_M4.8 GB
GGUF
KA
Kadoe 4B
Kadoe · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
MI
UCLA AGI Mistral7B PairRM SPPO Iter3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
bhenrym14_airoboros-l2-13b-2.1-yarn-64k
Airoboros · TheBloke
Params13B
Context64K
Q4_K_M7.9 GB
GGUF
MP
Mpt 7b Chat
Mpt · mradermacher
Params6.65B
Context2K
Q4_K_M4.3 GB
GGUF
WI
Winterreise-m7
Winterreise · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IN
models--automerger--Inex12Multiverseex26-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FA
Falcon
Falcon · mradermacher
Params41.8B
Context2K
Q4_K_M26.0 GB
GGUF
OC
Occamy 1.0
Occamy · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Tool useVision
EH
ehartford_wizardlm-33b-v1.0-uncensored
Ehartford · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
GL
Poe 8B GLM5 Opus4.6 Sonnet4.5 Kimi Grok Gemini 3 Pro Preview HERETIC
GLM · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
LL
Llama 3.2 3B MoE 4Expert
Llama · mradermacher
Params9.55B
Context128K
Q4_K_M5.9 GB
Coding
MI
Ministral 3b instruct
Mistral · mradermacher
Params3.32B
Context128K
Q4_K_M2.0 GB
GGUF
QW
Swift 1.5 Qwen3.8 27B Uncensored MTP
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
CH
Chronos 70B v2
Chronos · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Roleplay
MI
MistralMakise Merged 13B
Mistral · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PY
Pythia 1.4b
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
SP
SpatialAxiom 9B
Spatialaxiom · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
DE
DeepSeek R1 Distill Qwen 1.5B Heretic
DeepSeek · saidutta69
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
QW
Qwen3 14B Base
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
AU
Augmental 13B v1.50 A
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NA
NaruMOE-3x7B-v2
Narumoe · mradermacher
Params18.5B
Context32K
Q4_K_M11.2 GB
Roleplay
DE
deepseek coder 1.3B kexer
DeepSeek · QuantFactory
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
CO
beowolx_codeninja-1.0-openchat-7b
Codeninja · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
QW
Qwen2.5 32B Instruct Abliterated
Qwen · RichardErkhov
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF

Other quants

Keep browsing