GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
QW
Replete LLM V2.5 Qwen 14b
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GE
Huihui Gemma 3n E4B It Abliterated
Gemma · bartowski
Params6.9B
Context32K
Q4_K_M4.2 GB
LL
Llama 3.3 70B Instruct ablated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
CO
C4Ai Command R Plus 08 2024
Command R · bartowski
Params104B
Context128K
Q4_K_M62.8 GB
PA
MS3.2 PaintedFantasy v4 24B
Paintedfantasy · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
TA
UI TARS 7B DPO
Tars · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
NE
NVIDIA Nemotron 3.5 Bolt E4B
Nemotron · bartowski
Params7.52B
Context64K
Q4_K_M5.2 GB
NE
Nemomix v4.0 12B
Nemomix · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
DA
Dans PersonalityEngine V1.1.0 12b
Dans · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
CA
Carnice V3
Carnice · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
LI
Ling 3.1 Flash
Ling · bartowski
Params572B
Context256K
Q4_K_M358.0 GB
FI
v6 Finch 7B HF
Finch · bartowski
Params7.64B
Context1024K
Q4_K_M4.8 GB
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GR
Grug 27b
Grug · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
NE
Nemotron Cascade 8B Thinking
Nemotron · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
BO
prism ml Bonsai 8B unpacked
Bonsai · bartowski
Params8.19B
Context64K
Q4_K_M5.2 GB
QW
Qwen2.5 32B ArliAI RPMax v1.3
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen2.5 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
MA
Magnum 12b v2
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
CO
C4Ai Command R7B 12 2024
Command R · bartowski
Params8B
Context8K
Q4_K_M5.1 GB
GR
Granite 4.0 H Tiny
Granite · bartowski
Params6.94B
Context1024K
Q4_K_M4.3 GB
GP
kldzj gpt oss 120b heretic v2
gpt-oss · bartowski
Params117B
Context—
Smallest0.2 GB
MI
Voxtral Small 24B 2507
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
DE
Qwen2.5 32B
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
HU
Hunyuan 1.8B Instruct
Hunyuan · bartowski
Params1.79B
Context256K
Q4_K_M1.1 GB
CY
Cydonia 24B v4.1
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Ministral 3 3B Reasoning 2512
Mistral · bartowski
Params3.43B
Context256K
Q4_K_M2.1 GB
LL
Meta-Llama-3-70B-Instruct
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
SA
Sailor2 8B Chat
Sailor · bartowski
Params8.55B
Context32K
Q4_K_M5.2 GB
MA
magnum v3 9b chatml
Magnum · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB