Q3_K GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 15171 models have a Q3_K file. Sizes run from 1M to 5632B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
MLP KTLim llama 3 Korean Bllossom 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
swap uniba LLaMAntino 2 chat 13b hf ITA
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
meta llama CodeLlama 7b Python hf
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
FA
Falcon H1 Tiny R 0.6B
Falcon · tiiuae
Params622M
Context256K
Q4_K_M0.4 GB
Tool use
KR
krishnachaitanya5555 fitness chatbot model
Krishnachaitanya · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
LL
chinese llama 2 1.3b
Llama · hfl
Params1.26B
Context4K
Smallest0.6 GB
GGUF
GE
Gemma4-26B-A4B-Uncensored-HauhauCS-Balanced
Gemma · Unrestricted
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
SM
SmolLlama-1.5B-Sorted
Smolllama · RichardErkhov
Params1.5B
Context2K
Q4_K_M0.9 GB
GGUF
QW
Qwen3 TTS 12Hz 0.6B Base
Qwen · FILM6912
Params2B
Context—
Smallest1.3 GB
GGUF
GE
Gemma4-26B-A4B-Uncensored-HauhauCS-Balanced
Gemma · DonaldHump
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
CH
chinese alpaca 2 13b 16k
Chinese · hfl
Params13.3B
Context16K
Smallest5.0 GB
GGUF
DE
deepseek coder 7b instruct
DeepSeek · jtrancas
Params6.74B
Context16K
Smallest2.8 GB
Coding
TI
TIPO 500M
Tipo · RichardErkhov
Params508M
Context2K
Q4_K_M0.3 GB
GGUF
MI
nbeerbower Stella mistral nemo 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GE
gemma-2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
IN
AlchemistCoder L 7B
InternLM · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
ST
SD3.5 Large Turbo GGUF mixed sdcpp
Stable · stduhpf
Params8.23B
Context—
Smallest4.7 GB
GGUF
LL
Llama 3 SynE
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
nbeerbower mistral nemo wissenschaft 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
SR
SRPO
Srpo · befox
Params11.9B
Context—
Smallest4.0 GB
GGUF
MI
Ae Calem Mistral 7b v0.1
Mistral · RichardErkhov
Params7.29B
Context32K
Q4_K_M4.4 GB
GGUF
GA
garage bAInd Stable Platypus2 13B
Garage · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Vezora Mistral 22B v0.2
Mistral · RichardErkhov
Params22.2B
Context64K
Q4_K_M13.3 GB
GGUF
GE
Gemma 2b Aps It
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
zelk12 recoilme gemma 2 Ataraxy 9B v0.1 t0.25
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
NE
nenad1002 quantum research bot v1.0
Nenad · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LO
LongAlpaca 70B
Longalpaca · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
HE
0 hero Matter 0.1 Slim 7B A
Hero · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OL
Olmo 3 7B Think
OLMo · eaddario
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
GI
giux78 zefiro 7b beta ITA v0.1
Giux · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Other quants

Keep browsing