GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
WI
Wicked Stuff 26B A4B v3.0 Final
Wicked · bartowski
Params25.2B
Context256K
Q4_K_M18.0 GB
ME
Mellum2 12B A2.5B Instruct
Mellum · bartowski
Params12.1B
Context128K
Q4_K_M8.2 GB
QW
Qwen2.5.1 Coder 1.5B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwythos 9B v2
Qwythos · bartowski
Params9.2B
Context1024K
Q4_K_M6.0 GB
FA
Falcon3 10B Instruct
Falcon · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
JA
AI21 Jamba Reasoning 3B
Jamba · bartowski
Params3.2B
Context256K
Q4_K_M1.9 GB
SA
Salience 27B R5
Salience · bartowski
Params27.3B
Context1024K
Q4_K_M17.8 GB
JE
Jeffan 31b 1710
Jeffan · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
BE
Behemoth X 123B v2.2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M76.3 GB
MI
Trinity 2 Codestral 22B v0.2
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GE
ThinkingCap Gemma 4 26B A4B It
Gemma · bartowski
Params25.2B
Context256K
Q4_K_M18.0 GB
VA
Valkyrie 49B v2.1
Valkyrie · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
GP
Gpt Oss 120b
gpt-oss · bartowski
Params117B
Context128K
Q4_K_M62.8 GB
GE
Tiger-Gemma-9B-v1
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
Devstral Small 2505
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
NousResearch DeepHermes 3 Llama 3 8B Preview
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
QW
Josiefied Qwen3 14B Abliterated v3
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
MI
Pixtral
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
AN
Anubis 70B v1.1
Anubis · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen2.5 Coder 0.5B Instruct Abliterated
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
GE
Gemma 3 270m It
Gemma · bartowski
Params268M
Context32K
Q4_K_M0.3 GB
HY
HybridAgent 14B Agentic
Hybridagent · bartowski
Params14.8B
Context32K
Q4_K_M9.3 GB
CY
TheDrummer Cydonia 24B v2
Cydonia · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
OL
OLMo 2 1124 7B Instruct
OLMo · bartowski
Params7.3B
Context4K
Q4_K_M4.5 GB
GR
Granite 4.2 3b
Granite · bartowski
Params3.66B
Context128K
Q4_K_M2.3 GB
RI
Ringg Router E2B
Ringg · bartowski
Params4.63B
Context128K
Q4_K_M3.2 GB
MA
Magnum 12b v2.5 Kto
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Hermes 3 Llama 3.1 405B
Llama · bartowski
Params405B
Context128K
Q4_K_M243.1 GB
MI
Mistral Medium 3.5 128B
Mistral · bartowski
Params125B
Context256K
Q4_K_M78.4 GB
DE
Q3 30B A3B Designant
Designant · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB