GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
ST
StrawberryLemonade L3 70B v1.0
Strawberrylemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
e n v y Legion V2.1 LLaMa 70B Elarablated v0.8 hf
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.5 27B RpRMax v1
Qwen · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
IN
Internlm2_5 20b Chat
InternLM · bartowski
Params19.9B
Context32K
Q4_K_M12.0 GB
MI
Mizan v3 3B
Mizan · bartowski
Params2.9B
Context256K
Q4_K_M2.0 GB
DA
datagemma rig 27b it
Datagemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
QW
Qwen3 72B Embiggened
Qwen · bartowski
Params72.7B
Context40K
Q4_K_M47.4 GB
EU
Eurus 2 7B PRIME
Eurus · bartowski
Params7.62B
Context4K
Q4_K_M4.7 GB
LL
MathCoder2 CodeLlama 7B
Llama · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
TR
Trinity Mini
Trinity · bartowski
Params26B
Context128K
Q4_K_M15.9 GB
GL
zai org GLM 4.5
GLM · bartowski
Params358B
Context128K
Q4_K_M218.5 GB
MI
Magistral Small 2507
Mistral · bartowski
Params23.6B
Context40K
Q4_K_M14.3 GB
LL
Llama 3.1 Tulu 3 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GE
Amoral Gemma3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
OP
Openhands Lm 32b v0.1
Openhands · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
LL
CodeLlama 13B MORepair
Llama · bartowski
Params13B
Context16K
Q4_K_M7.9 GB
GL
zai org GLM 5.1
GLM · bartowski
Params754B
Context198K
Q4_K_M459.7 GB
HU
Hunyuan 4B Instruct
Hunyuan · bartowski
Params4.22B
Context256K
Q4_K_M2.6 GB
QW
calme-2.2-qwen2-72b
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
DH
Dhanishtha 2.0 Preview
Dhanishtha · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
SK
Skywork Skywork R1V3 38B
Skywork · bartowski
Params32.8B
Context32K
Q4_K_M19.8 GB
SA
Salience 1.5 Flash
Salience · bartowski
Params30.5B
Context256K
Q4_K_M18.7 GB
QW
Qwen3 VL 30B A3B Thinking
Qwen · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
AT
Athena Codegemma 2 9b
Athena · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GL
cerebras/GLM-4.5-Air-REAP-82B-A12B
GLM · bartowski
Params85B
Context128K
Q4_K_M56.6 GB
CY
Cyberdonia 24B v8
Cyberdonia · bartowski
Params23.6B
Context128K
Q4_K_M14.6 GB
GR
GRM 3.2 Cliff
Grm · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
QW
Replete LLM V2.5 Qwen 3b
Qwen · bartowski
Params3.4B
Context32K
Q4_K_M2.1 GB
QW
Qwen3 Nemotron 32B RLBFF
Qwen · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
RE
Reka Flash 3
Reka · bartowski
Params21B
Context32K
Q4_K_M13.6 GB