GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
HE
Hermes 4.3 36B
Hermes · bartowski
Params36.2B
Context512K
Q4_K_M21.8 GB
LE
LensVLM 9B
Lensvlm · bartowski
Params8.95B
Context256K
Q4_K_M5.8 GB
HO
K2-Horizon-3.7B
Horizon · bartowski
Params5.06B
Context512K
Q4_K_M3.3 GB
GE
Gemma 4 Dark Thoughts 31B
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
PH
Phi 3 Medium 4k Instruct
Phi · bartowski
Params14B
Context4K
Q4_K_M8.6 GB
MU
Muse Glimmer 30B Heretic
Muse · bartowski
Params27.9B
Context128K
Q4_K_M17.3 GB
MU
Muse Glimmer 30B Esper4
Muse · bartowski
Params27.9B
Context128K
Q4_K_M17.3 GB
DE
uncensoredai UncensoredLM DeepSeek R1 Distill Qwen 14B
DeepSeek · bartowski
Params14.2B
Context128K
Q4_K_M8.6 GB
MI
Voxtral Mini 3B 2507
Mistral · bartowski
Params4.01B
Context128K
Q4_K_M2.5 GB
OR
Ornith 1.0 9B
Ornith · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
GE
Gemma 4 31B It Scotoma 2
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
LL
LLaMA Mesh
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
MI
Ministral 3 8B Instruct 2512
Mistral · bartowski
Params8.49B
Context256K
Q4_K_M5.2 GB
LO
LongWriter Zero 32B
Longwriter · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GE
Gemma 3n E2B It
Gemma · bartowski
Params4.46B
Context32K
Q4_K_M2.8 GB
IN
InternVL3_5 38B
Internvl · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
LL
Hermes 3 Llama 3.1 8B Lorablated
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
MI
MiniCPM V 4.7 35B A3B
MiniCPM · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
EU
EuroLLM 9B Instruct
Eurollm · bartowski
Params9.15B
Context4K
Q4_K_M5.6 GB
MI
mathstral-7B-v0.1
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
AN
Anubis Mini 8B v1
Anubis · bartowski
Params8B
Context128K
Q4_K_M5.1 GB
QW
QwQ 32B Abliterated
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
NO
Novel Humanize 4b
Novel · bartowski
Params4.02B
Context40K
Q4_K_M2.6 GB
GE
Tiger Gemma 12B v3
Gemma · bartowski
Params12.8B
Context128K
Q4_K_M7.9 GB
QW
Qwen3 1.7B Abliterated
Qwen · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
PA
Pantheon Reasoning 27B
Pantheon · bartowski
Params27.3B
Context256K
Q4_K_M18.0 GB
HU
Hunyuan 0.5B Instruct
Hunyuan · bartowski
Params539M
Context256K
Q4_K_M0.4 GB
GR
Granite 3.1 2b Instruct
Granite · bartowski
Params2.53B
Context128K
Q4_K_M1.5 GB
FI
SUFE AIFLM Lab Fin R1
Fin · bartowski
Params7.6B
Context32K
Q4_K_M4.7 GB
TE
Terminal RSI 27B
Terminal · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB