GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
LL
CodeLlama-7B-KStack
Llama · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
ZE
Zenith 4B
Zenith · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
DU
Dusk_Rainbow
Dusk · bartowski
Params8.03B
Context10K
Q4_K_M4.9 GB
QW
Qwen3.5 122B RpRMax v1
Qwen · bartowski
Params122B
Context256K
Q4_K_M74.9 GB
QW
Qwen2-7B-Instruct-deccp
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
CO
Star Command R 32B v1
Command R · bartowski
Params32.3B
Context128K
Q4_K_M19.8 GB
LL
Kudzu-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
mistral orpo capybara 7k
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
DA
DatacampLlama 3.1 8B
Datacampllama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
dolphin-2.9-llama3-70b
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
dolphin-2.9-llama3-8b-1m
Llama · bartowski
Params8.03B
Context1024K
Q4_K_M4.9 GB
QW
Qwerus 7B
Qwerus · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GR
GRMR 2B Instruct
Grmr · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
Hermes-2-Theta-Llama-3-70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
CA
Captain_BMO 12B
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
CA
arcee ai Caller
Caller · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
BI
BigQwen2.5 125B Instruct
Bigqwen · bartowski
Params125B
Context32K
Q4_K_M81.6 GB
MI
Mahou 1.5 mistral nemo 12B
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
CO
Confucius O1 14B
Confucius · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
ZE
zephyr 7b spin iter3 v0
Zephyr · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
AN
G3 27B Animus V12.0 Redux
Animus · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
TH
L3.1 TheGreenLion 8b SFT v0.1.2
Thegreenlion · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
TW
TwinLlama 3.1 8B 2
Twinllama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
PH
Phi 3 mini 4k instruct old
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
TR
Triplex
Triplex · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
CA
Captain BMO 0.420 Magnum 12B
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Llama3 Crab SFT
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Scarlett-Llama-3-8B-v1.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LY
Lyra Gutenbergs Twilight Magnum 12B
Lyra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
ON
Oni_Mitsubishi_12B
Oni · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB