GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
TA
UI TARS 72B DPO
Tars · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen3.5 27B Anko
Qwen · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
NE
Neeto 1.0 8b
Neeto · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.2 3B ShiningValiant2
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
SA
Sailor2 1B Chat
Sailor · bartowski
Params988M
Context32K
Q4_K_M0.7 GB
ST
Starfallen Snow Fantasy 24B MS3.2 v0.0
Starfallen · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
TR
Trinity Nano Preview
Trinity · bartowski
Params6.12B
Context128K
Q4_K_M3.8 GB
QW
Qwen2.5 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen2.5 7B
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
BE
Behemoth R1 123B v2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
BI
allura org Bigger Body 70b
Bigger · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GE
Big-Tiger-Gemma-27B-v1
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
QW
Qwen3.5 4B Neo
Qwen · bartowski
Params4.21B
Context256K
Q4_K_M2.9 GB
MI
Mistral Nemo Gutenberg Doppel 12B
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Hermes 3 Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
CA
Captain Eris Diogenes Twilight V0.420 12B
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
SD
SDRPC CHML e1.2 12B
Sdrpc · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
FuseChat Llama 3.2 1B Instruct
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
AU
Austral Xgen 9B Winton
Austral · bartowski
Params10.7B
Context256K
Q4_K_M6.5 GB
QW
nbeerbower Dumpling Qwen2.5 32B v2
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
Replete AI_Replete LLM Qwen2 7b_Beta Preview
Qwen · bartowski
Params7.6B
Context128K
Q4_K_M4.7 GB
LL
OrcaAgent llama3.2 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
HU
HuatuoGPT O1 72B v0.1
Huatuogpt · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
NE
NemoRemix 12B
Nemoremix · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
NE
OpenMath Nemotron 32B
Nemotron · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
LL
Thespis Llama 3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GL
Austral 32B GLM4 Winton
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
LL
Dracarys Llama 3.1 70B Instruct
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
XY
XYZ Aquila Pro
Xyz · bartowski
Params396B
Context256K
Q4_K_M241.8 GB