GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
PA
Palmyra Med 70B 32K
Palmyra · bartowski
Params70.6B
Context32K
Q4_K_M42.5 GB
SI
simplescaling s1.1 32B
bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
NA
Nanbeige4 3B Thinking 2511
Nanbeige · bartowski
Params3.93B
Context64K
Q4_K_M2.4 GB
FO
ReadyArt Forgotten Safeword 70B 3.6
Forgotten · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
CA
Cassiopeia 70B
Cassiopeia · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
llama-3-cat-8b-instruct-v1
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · bartowski
Params284B
Context—
Smallest10.9 GB
JA
Jan Nano 128k
Jan · bartowski
Params4B
Context128K
Q4_K_M2.5 GB
FI
v6 Finch 14B HF
Finch · bartowski
Params14.1B
Context1024K
Q4_K_M8.8 GB
SA
Steelskull L3.3 San Mai R1 70b
San · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GR
xai org grok 2
Grok · bartowski
Params270B
Context128K
Q4_K_M164.1 GB
LL
Llama 3.1 Tulu 3 70B DPO
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
nvidia Llama 3 1 Nemotron Ultra 253B v1
Llama · bartowski
Params253B
Context128K
Q4_K_M150.9 GB
LL
dolphin-2.9-llama3-8b
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
PH
dolphin-2.9.2-Phi-3-Medium
Phi · bartowski
Params14B
Context4K
Q4_K_M8.4 GB
LL
Cogito v2 Preview Llama 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
BlackSheep Mistral RP 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiroThinker v1.0 30B
Mirothinker · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
LL
MathCoder2 Llama 3 8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
ST
Step 3.7 Flash
Step · bartowski
Params199B
Context256K
Q4_K_M121.6 GB
LL
Llama 3.2 Korean Bllossom 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
TI
TinySwallow 1.5B Instruct
Tinyswallow · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
FA
Falcon3 10B Base
Falcon · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
QW
Rombo LLM V3.0 Qwen 72b
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
CY
cybertron v4 qw7B UNAMGS
Cybertron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
SA
TheSkullery L3.3 exp unnamed model 70b v0.5
San · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GL
GLM4 32B Neon v2
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
TH
TheSalt-RP-L3-8b-DPO-v0.3.2-e0.14.2
Thesalt · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
BA
Babel 83B Chat
Babel · bartowski
Params83.2B
Context128K
Q4_K_M54.2 GB
RE
reader lm 1.5b
Reader · bartowski
Params1.54B
Context250K
Q4_K_M1.0 GB