GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
CodeLlama-7B-KStack
Llama · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
ZE
Zenith 4B
Zenith · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
DU
Dusk_Rainbow
Dusk · bartowski
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.5 122B RpRMax v1
Qwen · bartowski
Params122B
Context256K
Q4_K_M74.9 GB
ReasoningTool useVision
QW
Qwen2-7B-Instruct-deccp
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
CO
Star Command R 32B v1
Command R · bartowski
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
LL
Kudzu-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
mistral orpo capybara 7k
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DA
DatacampLlama 3.1 8B
Datacampllama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
dolphin-2.9-llama3-70b
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
CodingTool use
LL
dolphin-2.9-llama3-8b-1m
Llama · bartowski
Params8.03B
Context1024K
Q4_K_M4.9 GB
CodingTool use
QW
Qwerus 7B
Qwerus · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
GR
GRMR 2B Instruct
Grmr · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
Hermes-2-Theta-Llama-3-70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
CA
Captain_BMO 12B
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
CA
arcee ai Caller
Caller · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
BI
BigQwen2.5 125B Instruct
Bigqwen · bartowski
Params125B
Context32K
Q4_K_M81.6 GB
Tool use
MI
Mahou 1.5 mistral nemo 12B
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CO
Confucius O1 14B
Confucius · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
ZE
zephyr 7b spin iter3 v0
Zephyr · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AN
G3 27B Animus V12.0 Redux
Animus · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
RoleplayVision
TH
L3.1 TheGreenLion 8b SFT v0.1.2
Thegreenlion · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TW
TwinLlama 3.1 8B 2
Twinllama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
PH
Phi 3 mini 4k instruct old
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
TR
Triplex
Triplex · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
CA
Captain BMO 0.420 Magnum 12B
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
LL
Llama3 Crab SFT
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Scarlett-Llama-3-8B-v1.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LY
Lyra Gutenbergs Twilight Magnum 12B
Lyra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ON
Oni_Mitsubishi_12B
Oni · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF

Keep browsing