GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
GR
Groot 19B A3B 261023
Groot · bartowski
Params19B
Context256K
Q4_K_M12.5 GB
PH
Phi 3 Medium 128k Instruct
Phi · bartowski
Params14B
Context128K
Q4_K_M8.6 GB
TI
Tini Cybersec 8B A1B
Tini · bartowski
Params8.47B
Context125K
Q4_K_M5.2 GB
HO
K2-Horizon-7B
Horizon · bartowski
Params9B
Context512K
Q4_K_M5.8 GB
QW
Qwen2.5 Coder 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
KO
Kolibri 1
Kolibri · bartowski
Params78.1B
Context256K
Q4_K_M49.8 GB
GE
gemma-1.1-7b-it
Gemma · bartowski
Params8.54B
Context8K
Q4_K_M5.3 GB
GL
Glistening Gem 31B v2.1
Glistening · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
GL
Glm 4 9b Chat
GLM · bartowski
Params9.4B
Context128K
Q4_K_M6.3 GB
QW
Qwen2.5 7B Instruct 1M
Qwen · bartowski
Params7.62B
Context986K
Q4_K_M4.7 GB
CE
MN 12B Celeste V1.9
Celeste · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
CY
Cydonia 24B v4.2.0
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral Small 24B Instruct 2501
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
DA
Darwin 36B Opus
Darwin · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
NE
Nemotron 3 Nano 30B A3B
Nemotron · bartowski
Params31.6B
Context1024K
Q4_K_M24.7 GB
AY
Aya Expanse 8b
Aya · bartowski
Params8B
Context8K
Q4_K_M5.1 GB
OL
Olmo 3.1 32B Instruct
OLMo · bartowski
Params32.2B
Context64K
Q4_K_M19.5 GB
GE
Gemma 4 MoonGem 31B
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
LL
dolphin 2.9.4 llama3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
RW
Rwkv 6 World 7b
Rwkv · bartowski
Params7.64B
Context1024K
Q4_K_M4.8 GB
YI
Yi-1.5-6B-Chat
Yi · bartowski
Params6.06B
Context4K
Q4_K_M3.7 GB
G9
G9v3 3B
bartowski
Params3B
Context128K
Q4_K_M1.9 GB
GR
Granite 3.1 1b A400M Instruct
Granite · bartowski
Params1.33B
Context128K
Q4_K_M0.8 GB
YI
Yi-1.5-9B-Chat
Yi · bartowski
Params8.83B
Context4K
Q4_K_M5.3 GB
GL
GLM Z1 32B 0414
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
HA
L3.1 70B Hanami X1
Hanami · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GL
Glm 4 9b Chat
GLM · bartowski
Params9.4B
Context128K
Q4_K_M6.3 GB
TO
Tongyi DeepResearch 30B A3B
Tongyi · bartowski
Params30.5B
Context128K
Q4_K_M18.6 GB
GE
Gemma 3 1b It Abliterated
Gemma · bartowski
Params1B
Context32K
Q4_K_M0.8 GB
QW
Qwen2.5 14B Instruct 1M
Qwen · bartowski
Params14.8B
Context986K
Q4_K_M9.0 GB