GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama Deepsync 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
Coding
QW
Qwen2.5 72B 0.6x Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
DE
MathCoder2 DeepSeekMath 7B
DeepSeek · bartowski
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
MI
allura org Mistral Small 24b Sertraline 0304
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingReasoning
LL
Llama Sentient 3.2 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
IN
JanusCoder 14B
InternLM · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
KE
KernelLLM
Kernelllm · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
NE
TQ2.5 14B Neon v1
Neon · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
BE
Beck 8B
Beck · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
GR
Granite 3.0 2b Instruct
Granite · bartowski
Params2.63B
Context4K
Q4_K_M1.6 GB
GGUF
MA
magnum v3 34b
Magnum · bartowski
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
QW
Dumpling Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
HO
Homunculus
Homunculus · bartowski
Params12.5B
Context128K
Q4_K_M7.6 GB
GGUF
GE
Gemmasutra Pro 27B V1F
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
PR
Precog 24B v1
Precog · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
SM
SmallThinker 3B Preview
Smallthinker · bartowski
Params3.4B
Context32K
Q4_K_M2.1 GB
Reasoning
UN
UNA-ThePitbull-21.4B-v2
Una · bartowski
Params21.4B
Context32K
Q4_K_M12.9 GB
CodingTool use
GL
GLM 4.7 Flash Heretic
GLM · bartowski
Params29.9B
Context198K
Q4_K_M18.5 GB
GGUF
NE
OpenReasoning Nemotron 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
GR
Granite Vision 3.2 2b
Granite · bartowski
Params2.53B
Context16K
Q4_K_M1.5 GB
Vision
LI
ozone ai 0x lite
Lite · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
GE
Gemma 3 R1 12B v1
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
Reasoning
PR
Nohobby L3.3 Prikol 70B v0.5
Prikol · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
QwQ 32B ArliAI RpR v4
Qwen · bartowski
Params32.8B
Context40K
Q4_K_M19.9 GB
Reasoning
PE
Pernicious_Prophecy_70B
Pernicious · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
TX
Txgemma 9b Chat
Txgemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
DE
FuseO1 DeepSeekR1 Qwen2.5 Instruct 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
ML
MLExpert
Mlexpert · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
CodingReasoningTool use
LL
FineMath Llama 3B
Llama · bartowski
Params3.21B
Context4K
Q4_K_M2.0 GB
GGUF
ZE
zed industries zeta
Zeta · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF

Keep browsing