GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
DA
h2o-danube3-4b-chat
Danube · bartowski
Params3.96B
Context8K
Q4_K_M2.4 GB
SI
simplescaling s1 32B
bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
DA
Dans DangerousWinds V1.0.0 7b
Dans · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 VL 4B Thinking
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
NE
AceReason Nemotron 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
BL
G2 9B Blackout R1
Blackout · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Einstein-v7-Qwen2-7B
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
XL
xLAM 8x22b R
Xlam · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
LL
Llama 3.1 8B Open SFT
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GI
Gilgamesh 72B
Gilgamesh · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
MI
Miscii 14b 1225
Miscii · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
SA
Salience 27B R6
Salience · bartowski
Params27.3B
Context1024K
Q4_K_M17.4 GB
QW
QwQ LCoT 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
DE
DeepSeek V3.1 Terminus
DeepSeek · bartowski
Params671B
Context160K
Q4_K_M409.2 GB
LL
lolzinventor Meta Llama 3.1 8B SurviveV3
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
EL
Eleusis 12B
Eleusis · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
NE
OpenReasoning Nemotron 1.5B
Nemotron · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
QW
Replete Coder Qwen2 1.5b
Qwen · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
CE
Celestial Harmony 14b v1.0 Experimental 1016
Celestial · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
RE
ozone ai Reverb 7b
Reverb · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
KA
KAT Dev
Kat · bartowski
Params32.8B
Context128K
Q4_K_M19.8 GB
SY
Synthia S1 27b
Synthia · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
LL
LLaMA2 13B Tiefighter
Llama · bartowski
Params13B
Context4K
Q4_K_M7.9 GB
DH
Dhanishtha 2.0 Preview 0825
Dhanishtha · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
TE
Tessa T1 7B
Tessa · bartowski
Params7.62B
Context117K
Q4_K_M4.7 GB
LL
Llama 3.2 1B Instruct
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
ST
Steelskull L3.3 Mokume Gane R1 70b
Steelskull · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
FU
functionary small v3.1
Functionary · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
VE
Q2.5 Veltha 14B 0.5
Veltha · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB