GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
Groot 19B A3B 261023
Groot · bartowski
Params19B
Context256K
Q4_K_M12.5 GB
ReasoningTool useVision
PH
Phi 3 Medium 128k Instruct
Phi · bartowski
Params14B
Context128K
Q4_K_M8.6 GB
Coding
TI
Tini Cybersec 8B A1B
Tini · bartowski
Params8.47B
Context125K
Q4_K_M5.2 GB
Reasoning
HO
K2-Horizon-7B
Horizon · bartowski
Params9B
Context512K
Q4_K_M5.8 GB
GGUF
QW
Qwen2.5 Coder 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
KO
Kolibri 1
Kolibri · bartowski
Params78.1B
Context256K
Q4_K_M49.8 GB
Reasoning
GE
gemma-1.1-7b-it
Gemma · bartowski
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GL
Glistening Gem 31B v2.1
Glistening · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
GL
Glm 4 9b Chat
GLM · bartowski
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
QW
Qwen2.5 7B Instruct 1M
Qwen · bartowski
Params7.62B
Context986K
Q4_K_M4.7 GB
GGUF
CE
MN 12B Celeste V1.9
Celeste · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CY
Cydonia 24B v4.2.0
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Mistral Small 24B Instruct 2501
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
DA
Darwin 36B Opus
Darwin · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Reasoning
NE
Nemotron 3 Nano 30B A3B
Nemotron · bartowski
Params31.6B
Context1024K
Q4_K_M24.7 GB
Coding
AY
Aya Expanse 8b
Aya · bartowski
Params8B
Context8K
Q4_K_M5.1 GB
GGUF
OL
Olmo 3.1 32B Instruct
OLMo · bartowski
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
GE
Gemma 4 MoonGem 31B
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
RoleplayVision
LL
dolphin 2.9.4 llama3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Coding
RW
Rwkv 6 World 7b
Rwkv · bartowski
Params7.64B
Context1024K
Q4_K_M4.8 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · bartowski
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
G9
G9v3 3B
bartowski
Params3B
Context128K
Q4_K_M1.9 GB
Tool use
GR
Granite 3.1 1b A400M Instruct
Granite · bartowski
Params1.33B
Context128K
Q4_K_M0.8 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · bartowski
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
GL
GLM Z1 32B 0414
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
GGUF
HA
L3.1 70B Hanami X1
Hanami · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GL
Glm 4 9b Chat
GLM · bartowski
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
TO
Tongyi DeepResearch 30B A3B
Tongyi · bartowski
Params30.5B
Context128K
Q4_K_M18.6 GB
GGUF
GE
Gemma 3 1b It Abliterated
Gemma · bartowski
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
QW
Qwen2.5 14B Instruct 1M
Qwen · bartowski
Params14.8B
Context986K
Q4_K_M9.0 GB
GGUF

Keep browsing