GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
TA
UI TARS 72B DPO
Tars · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Vision
QW
Qwen3.5 27B Anko
Qwen · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
GGUF
NE
Neeto 1.0 8b
Neeto · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3.2 3B ShiningValiant2
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
SA
Sailor2 1B Chat
Sailor · bartowski
Params988M
Context32K
Q4_K_M0.7 GB
GGUF
ST
Starfallen Snow Fantasy 24B MS3.2 v0.0
Starfallen · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
TR
Trinity Nano Preview
Trinity · bartowski
Params6.12B
Context128K
Q4_K_M3.8 GB
Tool use
QW
Qwen2.5 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Roleplay
QW
Qwen2.5 7B
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Roleplay
BE
Behemoth R1 123B v2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
Reasoning
BI
allura org Bigger Body 70b
Bigger · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
GE
Big-Tiger-Gemma-27B-v1
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
QW
Qwen3.5 4B Neo
Qwen · bartowski
Params4.21B
Context256K
Q4_K_M2.9 GB
ReasoningVision
MI
Mistral Nemo Gutenberg Doppel 12B
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Hermes 3 Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
CA
Captain Eris Diogenes Twilight V0.420 12B
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
SD
SDRPC CHML e1.2 12B
Sdrpc · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
FuseChat Llama 3.2 1B Instruct
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
AU
Austral Xgen 9B Winton
Austral · bartowski
Params10.7B
Context256K
Q4_K_M6.5 GB
Roleplay
QW
nbeerbower Dumpling Qwen2.5 32B v2
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
QW
Replete AI_Replete LLM Qwen2 7b_Beta Preview
Qwen · bartowski
Params7.6B
Context128K
Q4_K_M4.7 GB
GGUF
LL
OrcaAgent llama3.2 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
HU
HuatuoGPT O1 72B v0.1
Huatuogpt · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Reasoning
NE
NemoRemix 12B
Nemoremix · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
NE
OpenMath Nemotron 32B
Nemotron · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
LL
Thespis Llama 3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3.1 Tulu 3 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GL
Austral 32B GLM4 Winton
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
GGUF
LL
Dracarys Llama 3.1 70B Instruct
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
XY
XYZ Aquila Pro
Xyz · bartowski
Params396B
Context256K
Q4_K_M241.8 GB
Vision

Keep browsing