GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
CY
TheDrummer Cydonia 24B v2.1
Cydonia · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GE
Gemma 3 R1 27B v1
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
NE
nvidia OpenCodeReasoning Nemotron 32B IOI
Nemotron · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen3 Coder 480B A35B Instruct
Qwen · bartowski
Params480B
Context256K
Q4_K_M290.8 GB
PO
Polaris 7B Preview
Polaris · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GE
Gemma 2 27b It
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
LI
Ling Lite 0415
Ling · bartowski
Params16.8B
Context32K
Q4_K_M11.2 GB
HE
Hearthfire 24B
Hearthfire · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
Tarek07 Legion V2.1 LLaMa 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
KA
KAT Dev 72B Exp
Kat · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
GL
GLM 4.6 Derestricted
GLM · bartowski
Params357B
Context198K
Q4_K_M217.7 GB
QW
Qwen2.5 7b Coder_Codeio_Pp
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Llama 3.3 8B Instruct 128K_Abliterated
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GR
Granite 3.2 2b Instruct
Granite · bartowski
Params2.53B
Context128K
Q4_K_M1.5 GB
ST
starcoder2-15b-instruct-v0.1
StarCoder · bartowski
Params16B
Context16K
Q4_K_M9.9 GB
PA
Pantheon Rp Pure 1.6.2 22b Small
Pantheon · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
TE
Tessa T1 32B
Tessa · bartowski
Params32.8B
Context117K
Q4_K_M19.9 GB
FA
Falcon3 1B Instruct Abliterated
Falcon · bartowski
Params1.67B
Context8K
Q4_K_M1.1 GB
OL
Olmo 3 32B Think
OLMo · bartowski
Params32.2B
Context64K
Q4_K_M19.5 GB
NI
NightyGurps 14b v1.1
Nightygurps · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GL
Remnant Glm4 32b
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
IS
Ising Calibration 1.5 31B
Ising · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
GE
Dolphin 2.9.4 Gemma2 2b
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
AU
Austral 70B Winton
Austral · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
PR
Prismatic 12b
Prismatic · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
EX
EXAONE Deep 2.4B
Exaone · bartowski
Params2.41B
Context32K
Q4_K_M1.5 GB
KO
Koto Small 7B IT
Koto · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
RI
Rio 3.5 Open 397B
Rio · bartowski
Params403B
Context256K
Q4_K_M245.0 GB
PA
MS3.2 PaintedFantasy v2 24B
Paintedfantasy · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
SK
Skywork OR1 32B
Skywork · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB