GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
DA
Dans PersonalityEngine V1.3.0 24b
Dans · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
DA
PocketDoc Dans PersonalityEngine V1.2.0 24b
Dans · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
DE
DeepScaleR 1.5B Preview
Deepscaler · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
Qwen2.5 Coder 7B
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
QwQ 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
KR
Kronumos Kairos v2
Kronumos · bartowski
Params7.6B
Context32K
Q4_K_M4.8 GB
MA
L3.3 70B Magnum v4 SE
Magnum · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GR
Granite 3.1 8b Instruct
Granite · bartowski
Params8.17B
Context128K
Q4_K_M4.9 GB
HE
Hermes 4 70B
Hermes · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen2.5 VL 72B Instruct
Qwen · bartowski
Params72.7B
Context125K
Q4_K_M47.4 GB
LL
Llama 3.3 8B Instruct
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
TE
Tev1 4B Experimental
Tev · bartowski
Params4.33B
Context256K
Q4_K_M2.8 GB
QW
Qwen2.5 Coder 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
LI
Ling Flash 2.0
Ling · bartowski
Params103B
Context32K
Q4_K_M62.6 GB
HU
Hunyuan 7B Instruct
Hunyuan · bartowski
Params7.5B
Context256K
Q4_K_M4.6 GB
GE
Gemma 3n E4B It
Gemma · bartowski
Params6.9B
Context32K
Q4_K_M4.2 GB
GR
Granite 4.2 8b
Granite · bartowski
Params8.79B
Context128K
Q4_K_M5.5 GB
EU
L3.1 70B Euryale v2.2
Euryale · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
IN
InternVL3_5 14B
Internvl · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
GE
Gemma 3 4b It Qat
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
OC
Occamy 1.0
Occamy · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
SM
SmolLM 1.7B
SmolLM · bartowski
Params1.71B
Context2K
Q4_K_M1.1 GB
CO
Yi Coder 9B Chat
Coder · bartowski
Params8.83B
Context128K
Q4_K_M5.3 GB
HU
HuatuoGPT O1 7B
Huatuogpt · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
IN
InternVL3_5 30B A3B
Internvl · bartowski
Params30.5B
Context40K
Q4_K_M18.6 GB
MI
Mistral Large Instruct 2411
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
OL
Olmo 3.1 32B Think
OLMo · bartowski
Params32.2B
Context64K
Q4_K_M19.5 GB
PA
MS3.2 PaintedFantasy Visage v2 33B
Paintedfantasy · bartowski
Params33.6B
Context128K
Q4_K_M20.4 GB
GL
GLM Z1 9B 0414
GLM · bartowski
Params9.4B
Context32K
Q4_K_M6.2 GB
LI
Ling 3.0 Flash Fin
Ling · bartowski
Params127B
Context256K
Q4_K_M77.8 GB