GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
NE
NextCoder 32B
Nextcoder · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
TE
Tessa T1 3B
Tessa · bartowski
Params3.09B
Context117K
Q4_K_M1.9 GB
GR
Granite 4.0 H Micro
Granite · bartowski
Params3.2B
Context1024K
Q4_K_M1.9 GB
GE
Gemma 2 9b It WPO HB
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
SK
Skywork OR1 7B
Skywork · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
MA
magnum v3 9b customgemma2
Magnum · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Artificium llama3.1 8B 001
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
IN
INTELLECT 2
Intellect · bartowski
Params32.8B
Context40K
Q4_K_M19.9 GB
RN
Rnj 1 Instruct
Rnj · bartowski
Params8.3B
Context32K
Q4_K_M5.1 GB
PH
luvGPT phi3 uncensored chat
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
LL
LLaMA3 iterative DPO final
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Gemma 3 270m It Qat
Gemma · bartowski
Params268M
Context32K
Q4_K_M0.3 GB
QW
nbeerbower Dumpling Qwen2.5 72B
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
BE
Behemoth 123B v1
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
VE
Veritas 12B
Veritas · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GR
Granite 3.0 1b A400M Instruct
Granite · bartowski
Params1.33B
Context4K
Q4_K_M0.8 GB
SH
Shuttle 3.5
Shuttle · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
LL
Llama 3.1 Tulu 3 8B DPO
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
FuseChat Llama 3.2 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
CH
CHEETAH 350M Merged
Cheetah · bartowski
Params354M
Context125K
Q4_K_M0.2 GB
MI
Mistral Evolved 11b v0.1
Mistral · bartowski
Params11.2B
Context32K
Q4_K_M6.7 GB
GR
Grug 3b
Grug · bartowski
Params4.17B
Context256K
Q4_K_M2.7 GB
EX
EXAONE Deep 7.8B
Exaone · bartowski
Params7.8B
Context32K
Q4_K_M4.8 GB
SH
L3.3 Shakudo 70b
Shakudo · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
YI
dolphin-2.9.3-Yi-1.5-34B-32k
Yi · bartowski
Params34.4B
Context32K
Q4_K_M20.7 GB
EX
EXAONE Deep 32B
Exaone · bartowski
Params32B
Context32K
Q4_K_M19.3 GB
GE
Gemma 3 R1 4B v1
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen2 VL 72B Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
AR
arcee ai Arcee Maestro 7B Preview
Arcee · bartowski
Params7.61B
Context128K
Q4_K_M4.7 GB
DA
Darkest muse v1
Darkest · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB