Q3_K GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 15171 models have a Q3_K file. Sizes run from 1M to 5632B parameters. The longest trained context is 102400K tokens.
HE
0 hero Matter 0.2 7B
Hero · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
InternLM2
InternLM · legraphista
Params7.74B
Context8K
Smallest1.9 GB
YI
Yi 1.5 34B Chat
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
LL
4 alokk llama 3 8b English to Hinglish
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
IN
InternLM2
InternLM · legraphista
Params19.9B
Context8K
Smallest4.5 GB
LL
Ostrich 70B
Llama · some1nostr
Params70.6B
Context8K
Smallest34.3 GB
CO
CohereForAI aya 23 35B
Cohereforai · RichardErkhov
Params35B
Context—
Q4_K_M0.0 GB
MI
llava 1.6 mistral 7b
Mistral · cjpais
Params7.24B
Context32K
Q4_K_M4.4 GB
RW
rwkv 6 world 3b
Rwkv · latestissue
Params3.1B
Context1024K
Smallest1.2 GB
QW
Qwen3.8-27B
Qwen · k1lliiviie
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Qwen3.8-27B
Qwen · NilVoid
Params27.3B
Context256K
Q4_K_M16.6 GB
FA
Falcon H1R 7B
Falcon · tiiuae
Params7.59B
Context256K
Q4_K_M4.6 GB
QW
Qwen3.8-27B
Qwen · ahmed-amedo
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Qwen3.8-27B
Qwen · aiartorious
Params27.3B
Context256K
Q4_K_M16.6 GB
MI
Codestral 22B v0.1 IMat
Mistral · legraphista
Params22.2B
Context32K
Smallest4.8 GB
DE
DeepSeek V2.5
DeepSeek · legraphista
Params236B
Context160K
Smallest47.4 GB
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · CCSSNE
Params34.7B
Context256K
Q4_K_M21.2 GB
YI
01 ai Yi 34B
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
QW
Qwen3.8-27B
Qwen · haybar4k
Params27.3B
Context256K
Q4_K_M16.6 GB
FA
90m Instruct
Falcon · tiiuae
Params91M
Context256K
Q4_K_M0.1 GB
QW
Qwen3.8-27B
Qwen · Weirdo333
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Qwen3.8-27B
Qwen · Aleks199999
Params27.3B
Context256K
Q4_K_M16.6 GB
WH
whisper tiny
Whisper · oxide-lab
Params38M
Context—
Smallest0.0 GB
QW
Qwen3.8-27B
Qwen · kcarly
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Qwen3.8-27B
Qwen · Fhjdjdbxhshsh
Params27.3B
Context256K
Q4_K_M16.6 GB
LL
Llama3-Chinese-8B-Instruct
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
XL
xLAM 8x7b R
Xlam · legraphista
Params46.7B
Context32K
Smallest9.8 GB
LL
Hermes-2-Theta-Llama-3-8B
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
QW
Qwen3.8-27B
Qwen · igroc656
Params27.3B
Context256K
Q4_K_M16.6 GB
DA
datagemma rig 27b it IMat
Datagemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB