GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DA
h2o-danube3-4b-chat
Danube · bartowski
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
SI
simplescaling s1 32B
bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
DA
Dans DangerousWinds V1.0.0 7b
Dans · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 VL 4B Thinking
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
ReasoningVision
NE
AceReason Nemotron 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
BL
G2 9B Blackout R1
Blackout · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
Reasoning
QW
Einstein-v7-Qwen2-7B
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
XL
xLAM 8x22b R
Xlam · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
Tool use
LL
Llama 3.1 8B Open SFT
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GI
Gilgamesh 72B
Gilgamesh · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
MI
Miscii 14b 1225
Miscii · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
SA
Salience 27B R6
Salience · bartowski
Params27.3B
Context1024K
Q4_K_M17.4 GB
CodingReasoningTool use
QW
QwQ LCoT 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek V3.1 Terminus
DeepSeek · bartowski
Params671B
Context160K
Q4_K_M409.2 GB
ReasoningTool use
LL
lolzinventor Meta Llama 3.1 8B SurviveV3
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
EL
Eleusis 12B
Eleusis · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
NE
OpenReasoning Nemotron 1.5B
Nemotron · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning
QW
Replete Coder Qwen2 1.5b
Qwen · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingTool use
CE
Celestial Harmony 14b v1.0 Experimental 1016
Celestial · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
RE
ozone ai Reverb 7b
Reverb · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
KA
KAT Dev
Kat · bartowski
Params32.8B
Context128K
Q4_K_M19.8 GB
GGUF
SY
Synthia S1 27b
Synthia · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Vision
LL
LLaMA2 13B Tiefighter
Llama · bartowski
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DH
Dhanishtha 2.0 Preview 0825
Dhanishtha · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
TE
Tessa T1 7B
Tessa · bartowski
Params7.62B
Context117K
Q4_K_M4.7 GB
Tool use
LL
Llama 3.2 1B Instruct
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
CodingTool use
ST
Steelskull L3.3 Mokume Gane R1 70b
Steelskull · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
FU
functionary small v3.1
Functionary · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Roleplay
VE
Q2.5 Veltha 14B 0.5
Veltha · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF

Keep browsing