GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
WI
Wicked Stuff 26B A4B v3.0 Final
Wicked · bartowski
Params25.2B
Context256K
Q4_K_M18.0 GB
ReasoningRoleplayTool use
ME
Mellum2 12B A2.5B Instruct
Mellum · bartowski
Params12.1B
Context128K
Q4_K_M8.2 GB
GGUF
QW
Qwen2.5.1 Coder 1.5B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
QW
Qwythos 9B v2
Qwythos · bartowski
Params9.2B
Context1024K
Q4_K_M6.0 GB
Reasoning
FA
Falcon3 10B Instruct
Falcon · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
JA
AI21 Jamba Reasoning 3B
Jamba · bartowski
Params3.2B
Context256K
Q4_K_M1.9 GB
Reasoning
SA
Salience 27B R5
Salience · bartowski
Params27.3B
Context1024K
Q4_K_M17.8 GB
CodingReasoningTool use
JE
Jeffan 31b 1710
Jeffan · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
ReasoningTool useVision
BE
Behemoth X 123B v2.2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M76.3 GB
GGUF
MI
Trinity 2 Codestral 22B v0.2
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
GE
ThinkingCap Gemma 4 26B A4B It
Gemma · bartowski
Params25.2B
Context256K
Q4_K_M18.0 GB
ReasoningTool useVision
VA
Valkyrie 49B v2.1
Valkyrie · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
GP
Gpt Oss 120b
gpt-oss · bartowski
Params117B
Context128K
Q4_K_M62.8 GB
GGUF
GE
Tiger-Gemma-9B-v1
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Devstral Small 2505
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingVision
LL
NousResearch DeepHermes 3 Llama 3 8B Preview
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
QW
Josiefied Qwen3 14B Abliterated v3
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
MI
Pixtral
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Vision
AN
Anubis 70B v1.1
Anubis · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen2.5 Coder 0.5B Instruct Abliterated
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
Coding
GE
Gemma 3 270m It
Gemma · bartowski
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
HY
HybridAgent 14B Agentic
Hybridagent · bartowski
Params14.8B
Context32K
Q4_K_M9.3 GB
ReasoningTool use
CY
TheDrummer Cydonia 24B v2
Cydonia · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
OL
OLMo 2 1124 7B Instruct
OLMo · bartowski
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
GR
Granite 4.2 3b
Granite · bartowski
Params3.66B
Context128K
Q4_K_M2.3 GB
ReasoningTool use
RI
Ringg Router E2B
Ringg · bartowski
Params4.63B
Context128K
Q4_K_M3.2 GB
CodingTool useVision
MA
Magnum 12b v2.5 Kto
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Hermes 3 Llama 3.1 405B
Llama · bartowski
Params405B
Context128K
Q4_K_M243.1 GB
RoleplayTool use
MI
Mistral Medium 3.5 128B
Mistral · bartowski
Params125B
Context256K
Q4_K_M78.4 GB
Vision
DE
Q3 30B A3B Designant
Designant · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
ReasoningRoleplay

Keep browsing