GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DA
Dans PersonalityEngine V1.3.0 24b
Dans · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingRoleplay
DA
PocketDoc Dans PersonalityEngine V1.2.0 24b
Dans · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingRoleplay
DE
DeepScaleR 1.5B Preview
Deepscaler · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF
QW
Qwen2.5 Coder 7B
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
QW
QwQ 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
KR
Kronumos Kairos v2
Kronumos · bartowski
Params7.6B
Context32K
Q4_K_M4.8 GB
Coding
MA
L3.3 70B Magnum v4 SE
Magnum · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
GR
Granite 3.1 8b Instruct
Granite · bartowski
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
HE
Hermes 4 70B
Hermes · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
QW
Qwen2.5 VL 72B Instruct
Qwen · bartowski
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
LL
Llama 3.3 8B Instruct
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
TE
Tev1 4B Experimental
Tev · bartowski
Params4.33B
Context256K
Q4_K_M2.8 GB
Vision
QW
Qwen2.5 Coder 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
LI
Ling Flash 2.0
Ling · bartowski
Params103B
Context32K
Q4_K_M62.6 GB
GGUF
HU
Hunyuan 7B Instruct
Hunyuan · bartowski
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
GE
Gemma 3n E4B It
Gemma · bartowski
Params6.9B
Context32K
Q4_K_M4.2 GB
GGUF
GR
Granite 4.2 8b
Granite · bartowski
Params8.79B
Context128K
Q4_K_M5.5 GB
ReasoningTool use
EU
L3.1 70B Euryale v2.2
Euryale · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
IN
InternVL3_5 14B
Internvl · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
Vision
GE
Gemma 3 4b It Qat
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
OC
Occamy 1.0
Occamy · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
Tool useVision
SM
SmolLM 1.7B
SmolLM · bartowski
Params1.71B
Context2K
Q4_K_M1.1 GB
Tool use
CO
Yi Coder 9B Chat
Coder · bartowski
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
HU
HuatuoGPT O1 7B
Huatuogpt · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Reasoning
IN
InternVL3_5 30B A3B
Internvl · bartowski
Params30.5B
Context40K
Q4_K_M18.6 GB
Vision
MI
Mistral Large Instruct 2411
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
OL
Olmo 3.1 32B Think
OLMo · bartowski
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
PA
MS3.2 PaintedFantasy Visage v2 33B
Paintedfantasy · bartowski
Params33.6B
Context128K
Q4_K_M20.4 GB
GGUF
GL
GLM Z1 9B 0414
GLM · bartowski
Params9.4B
Context32K
Q4_K_M6.2 GB
GGUF
LI
Ling 3.0 Flash Fin
Ling · bartowski
Params127B
Context256K
Q4_K_M77.8 GB
Tool use

Keep browsing