GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
CY
TheDrummer Cydonia 24B v2.1
Cydonia · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
GE
Gemma 3 R1 27B v1
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Reasoning
NE
nvidia OpenCodeReasoning Nemotron 32B IOI
Nemotron · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingReasoning
QW
Qwen3 Coder 480B A35B Instruct
Qwen · bartowski
Params480B
Context256K
Q4_K_M290.8 GB
Coding
PO
Polaris 7B Preview
Polaris · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
GE
Gemma 2 27b It
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
LI
Ling Lite 0415
Ling · bartowski
Params16.8B
Context32K
Q4_K_M11.2 GB
GGUF
HE
Hearthfire 24B
Hearthfire · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
LL
Tarek07 Legion V2.1 LLaMa 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
KA
KAT Dev 72B Exp
Kat · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
GL
GLM 4.6 Derestricted
GLM · bartowski
Params357B
Context198K
Q4_K_M217.7 GB
GGUF
QW
Qwen2.5 7b Coder_Codeio_Pp
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Coding
LL
Llama 3.3 8B Instruct 128K_Abliterated
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GR
Granite 3.2 2b Instruct
Granite · bartowski
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
ST
starcoder2-15b-instruct-v0.1
StarCoder · bartowski
Params16B
Context16K
Q4_K_M9.9 GB
Coding
PA
Pantheon Rp Pure 1.6.2 22b Small
Pantheon · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
Roleplay
TE
Tessa T1 32B
Tessa · bartowski
Params32.8B
Context117K
Q4_K_M19.9 GB
GGUF
FA
Falcon3 1B Instruct Abliterated
Falcon · bartowski
Params1.67B
Context8K
Q4_K_M1.1 GB
GGUF
OL
Olmo 3 32B Think
OLMo · bartowski
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
NI
NightyGurps 14b v1.1
Nightygurps · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
GL
Remnant Glm4 32b
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
Roleplay
IS
Ising Calibration 1.5 31B
Ising · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
GE
Dolphin 2.9.4 Gemma2 2b
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
AU
Austral 70B Winton
Austral · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
PR
Prismatic 12b
Prismatic · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
EX
EXAONE Deep 2.4B
Exaone · bartowski
Params2.41B
Context32K
Q4_K_M1.5 GB
GGUF
KO
Koto Small 7B IT
Koto · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
RI
Rio 3.5 Open 397B
Rio · bartowski
Params403B
Context256K
Q4_K_M245.0 GB
Vision
PA
MS3.2 PaintedFantasy v2 24B
Paintedfantasy · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
SK
Skywork OR1 32B
Skywork · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF

Keep browsing