Q3_K GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 15171 models have a Q3_K file. Sizes run from 1M to 5632B parameters. The longest trained context is 102400K tokens.
LL
Llama3 8B Aifeifei 1.1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
IN
interview eval zephyr 7b math case 8
Interview · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
KR
kromcomp L3 Ceto Epith StableRP v0.1 8B
Kromcomp · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
v000000 Qwen2.5 14B Gutenberg Instruct Slerpeno
Qwen · RichardErkhov
Params14.8B
Context32K
Q4_K_M9.0 GB
SE
sethuiyer Dr.Samantha 8B
Sethuiyer · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Gemma 2b It
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
QW
claude opus 35B Uncensored Aggressive
Qwen · lazekkkk
Params34.7B
Context256K
Q4_K_M21.2 GB
ML
mlfoundations dev OH DCFT V3 wo collective cognition
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 Coder 1.5B Instruct MLX
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
CP
cpm ai Ocelot Ko self instruction 10.8B v1.0
Cpm · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
LL
ryzen88 Llama 3 70b Arimas story RP V2.1
Llama · RichardErkhov
Params70.6B
Context32K
Q4_K_M42.5 GB
OL
akrishnan TOFU olmo 7b ft full 10epochs lr2e 06 seed42 run1
OLMo · RichardErkhov
Params6.89B
Context4K
Q4_K_M4.2 GB
PY
Pythia 410m
Pythia · RichardErkhov
Params405M
Context2K
Q4_K_M0.3 GB
IN
InstructLM-1.3B
Instructlm · RichardErkhov
Params1.35B
Context2K
Q4_K_M0.8 GB
TE
TeeZee DarkForest 20B v1.1
Teezee · RichardErkhov
Params20B
Context4K
Q4_K_M0.7 GB
DE
Deepseek Coder 1.3b Instruct
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
QW
Phi 3.5 Mini Instruct
Qwen · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
ML
mlfoundations dev oh v1.3 unnatural instructions x.125
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
Mohan 08 gpt 2 guanaco finetuned
Mohan · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
LL
codellama CodeLlama 7b Instruct hf
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
MI
wanadzhar913 malaysian mistral llmasajudge v3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Base SFT KTO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
KSU HW SEC Deepseek SFT RL Text only
DeepSeek · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
MO
Monarch 7B
Monarch · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Meta-Llama-3-8B-Instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 Coder 1.5B
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.05
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
KI
Kiwi_Solar_Merge_Slerp_Test_V1
Kiwi · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
ReAligned Qwen3.5 27B
Qwen · Lazarus-Ai
Params26.9B
Context256K
Smallest10.1 GB
LL
nota ai st llama 1 5.5b taylor
Llama · RichardErkhov
Params5.52B
Context2K
Q4_K_M3.3 GB