GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
QW
Qwen2.5 7B
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
DW
Dwight 4b
Dwight · bartowski
Params4B
Context256K
Q4_K_M2.6 GB
CR
Crimson_Dawn v0.2 Base
Crimson · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
SK
Sky T1 32B Flash
Sky · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
DI
DiscoveryRSI 27B
Discoveryrsi · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
LL
Llama 3.1 Minitron 4B Width Base
Llama · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
AP
Apertus 8B Instruct 2509
Apertus · bartowski
Params8.05B
Context64K
Q4_K_M5.1 GB
LI
Ling 3.1 Flash 1019
Ling · bartowski
Params572B
Context256K
Q4_K_M358.0 GB
AP
Apriel 1.6 15b Thinker
Apriel · bartowski
Params14.4B
Context256K
Q4_K_M8.8 GB
AP
Apodex 1.1 Mini
Apodex · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
GE
Gemma 4 E4B Luchador
Gemma · bartowski
Params7.5B
Context128K
Q4_K_M5.4 GB
MI
Mistral Small 3.1 DRAFT 0.5B
Mistral · bartowski
Params593M
Context32K
Q4_K_M0.5 GB
MI
Ministral 3 14B Reasoning 2512
Mistral · bartowski
Params13.5B
Context256K
Q4_K_M8.2 GB
PY
Pythia 6.9B Instruct v1 Merged
Pythia · bartowski
Params6.86B
Context2K
Q4_K_M4.7 GB
DE
DeepCoder 1.5B Preview
Deepcoder · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
MI
Mistral Small 24B Base 2501
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
DE
DeepSWE Preview
Deepswe · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
MI
Mistral NeMo Minitron 8B Instruct
Mistral · bartowski
Params8.41B
Context8K
Q4_K_M5.1 GB
NE
Apriel Nemotron 15b Thinker
Nemotron · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
SK
Skywork SWE 32B
Skywork · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
US
UserLM 8b
Userlm · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
RI
Rivermind 12B v1
Rivermind · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
QW
Qwen3 16B A3B
Qwen · bartowski
Params16B
Context40K
Q4_K_M9.8 GB
PE
Q3 30b A3b Pentiment
Pentiment · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
GE
Gemma 2 27b It
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
US
UserRepGen 4B
Userrepgen · bartowski
Params4.21B
Context256K
Q4_K_M2.7 GB
OM
OmniCoder 9B
Omnicoder · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
LL
Trendyol LLM 8b Chat v2.0
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen3 VL 8B Thinking
Qwen · bartowski
Params8.19B
Context256K
Q4_K_M5.0 GB
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB