GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
DE
WhiteRabbitNeo WhiteRabbitNeo V3 7B
Deephat · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GR
Granite 20b Code Instruct
Granite · bartowski
Params20B
Context8K
Q4_K_M12.8 GB
GE
Fallen Gemma3 27B v1
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
MA
UI Mate 9B
Mate · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
DE
DeepSeek R1 Distill Llama 70B Abliterated
DeepSeek · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
FA
Fara1.5 9B
Fara · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
QW
Qwen3 VL 30B A3B Instruct
Qwen · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen2.5 14B_Uncencored
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen2.5 Coder 14B
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
PH
Phi 3 mini 4k instruct
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
BE
Behemoth 128B v3
Behemoth · bartowski
Params125B
Context256K
Q4_K_M78.4 GB
QW
Qwen2.5.1 Coder 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
LF
LFM2.5 24B A2B
Lfm · bartowski
Params24B
Context128K
Q4_K_M15.4 GB
LA
Laguna XS 2.1
Laguna · bartowski
Params33.4B
Context256K
Q4_K_M20.5 GB
QW
Qwen3 VL 2B Instruct
Qwen · bartowski
Params1.72B
Context256K
Q4_K_M1.1 GB
QW
Qwen3.5 397B A17B
Qwen · bartowski
Params403B
Context256K
Q4_K_M248.3 GB
ON
OneJev 9B
Onejev · bartowski
Params8.95B
Context256K
Q4_K_M5.8 GB
PA
Pantheon Reasoning 26B A4B 1.1 V2
Pantheon · bartowski
Params26B
Context256K
Q4_K_M18.8 GB
OR
Ornith 1.0 35B
Ornith · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
QW
Josiefied Qwen3 8B Abliterated v1
Qwen · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
DE
DeepSeek V3.1
DeepSeek · bartowski
Params670B
Context160K
Q4_K_M409.2 GB
GE
Gemma 3 4b It Abliterated
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
OR
Orion 26B A4B v1
Orion · bartowski
Params25.2B
Context256K
Q4_K_M17.0 GB
ON
OneJev 4B
Onejev · bartowski
Params4.84B
Context256K
Q4_K_M3.2 GB
NE
Nex N2.5 Mini
Nex · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
QW
Dolphin3.0 Qwen2.5 1.5B
Qwen · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
OL
olmOCR 2 7B 1025
OLMo · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
CO
Yi Coder 1.5B Chat
Coder · bartowski
Params1.48B
Context128K
Q4_K_M1.0 GB