Q3_K_L GGUF models
3-bit k-quant, large. A little better than Q3_K_M at a slightly larger size. 101200 models have a Q3_K_L file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
PH
Phi 3 Mini 128k Instruct
Phi · second-state
Params3.82B
Context128K
Q4_K_M2.4 GB
QW
Qwen2.5 7B Instruct
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
Chinese Mixtral 8x7B
Mistral · RichardErkhov
Params46.9B
Context32K
Q4_K_M28.6 GB
GE
Gemma 3 1b It Qat
Gemma · bartowski
Params1B
Context32K
Q4_K_M0.8 GB
CA
cat-v1.0-13b
Cat · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
MI
Devstral Small 2507 Vision
Mistral · EnlistedGhost
Params23.6B
Context128K
Q4_K_M14.5 GB
LM
LMCocktail 10.7B v1
Lmcocktail · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
CL
Claire 7B 0.1
Claire · TheBloke
Params7.22B
Context2K
Q4_K_M5.0 GB
MI
Hermes-2-Pro-Mistral-7B-infinity
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
VI
Vigogne 2 13B Instruct
Vigogne · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
JA
Javi0.3 2B
Javi · mradermacher
Params1.94B
Context256K
Q4_K_M1.3 GB
LL
gpt 4o distil Llama 3.3 70B Instruct PaperWitch heresy i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MY
MythoMix L2 13B
Mythomix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
OpenHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
OpenChat 3.5 7B InternLM v2.0
InternLM · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
QW
FlashModel Qwen 3.6 35B A3B Maxed
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
GL
Glistening Gem 31B v2.1
Glistening · kin2341
Params30.7B
Context256K
Q4_K_M19.6 GB
XO
XORTRON AgentRICO
Xortron · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
MI
Mistral Syndicate 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
L3.3 Nevoria R1 70b
Nevoria · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
Nehuronion Dvt 9b
Nehuronion · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
models--Groq--Llama-3-Groq-8B-Tool-Use
Llama · MaziyarPanahi
Params8B
Context8K
Q4_K_M4.9 GB
OR
Ornith 1.5 122B
Ornith · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
GR
Granite 3b Code Instruct 128k
Granite · RichardErkhov
Params3.48B
Context125K
Q4_K_M2.1 GB
QW
Qwen3.6 35B A3B Uncensored Genesis Final Safetensors
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
RE
Redmond Puffin 13B
Redmond · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LE
leolm_leo-hessianai-13b-chat-bilingual
Leo · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
DE
deepseek r1
DeepSeek · cortexso
Params70.6B
Context128K
Q4_K_M1.1 GB
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB