GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
LL
Llama Deepsync 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwen2.5 72B 0.6x Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
DE
MathCoder2 DeepSeekMath 7B
DeepSeek · bartowski
Params6.91B
Context4K
Q4_K_M4.2 GB
MI
allura org Mistral Small 24b Sertraline 0304
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
LL
Llama Sentient 3.2 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
IN
JanusCoder 14B
InternLM · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
KE
KernelLLM
Kernelllm · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
NE
TQ2.5 14B Neon v1
Neon · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
BE
Beck 8B
Beck · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
GR
Granite 3.0 2b Instruct
Granite · bartowski
Params2.63B
Context4K
Q4_K_M1.6 GB
MA
magnum v3 34b
Magnum · bartowski
Params34.4B
Context32K
Q4_K_M20.7 GB
QW
Dumpling Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
HO
Homunculus
Homunculus · bartowski
Params12.5B
Context128K
Q4_K_M7.6 GB
GE
Gemmasutra Pro 27B V1F
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
PR
Precog 24B v1
Precog · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
SM
SmallThinker 3B Preview
Smallthinker · bartowski
Params3.4B
Context32K
Q4_K_M2.1 GB
UN
UNA-ThePitbull-21.4B-v2
Una · bartowski
Params21.4B
Context32K
Q4_K_M12.9 GB
GL
GLM 4.7 Flash Heretic
GLM · bartowski
Params29.9B
Context198K
Q4_K_M18.5 GB
NE
OpenReasoning Nemotron 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GR
Granite Vision 3.2 2b
Granite · bartowski
Params2.53B
Context16K
Q4_K_M1.5 GB
LI
ozone ai 0x lite
Lite · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GE
Gemma 3 R1 12B v1
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
PR
Nohobby L3.3 Prikol 70B v0.5
Prikol · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
QwQ 32B ArliAI RpR v4
Qwen · bartowski
Params32.8B
Context40K
Q4_K_M19.9 GB
PE
Pernicious_Prophecy_70B
Pernicious · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
TX
Txgemma 9b Chat
Txgemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
DE
FuseO1 DeepSeekR1 Qwen2.5 Instruct 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
ML
MLExpert
Mlexpert · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
LL
FineMath Llama 3B
Llama · bartowski
Params3.21B
Context4K
Q4_K_M2.0 GB
ZE
zed industries zeta
Zeta · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB