GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
TI
TinyR1 32B Preview v0.2
Tinyr · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
DA
PocketDoc Dans SakuraKaze V1.0.0 12b
Dans · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
CR
Crystal Think V2
Crystal · bartowski
Params4B
Context32K
Q4_K_M2.5 GB
FA
Falcon3 3B Instruct
Falcon · bartowski
Params3.23B
Context32K
Q4_K_M2.0 GB
RE
Redemption_Wind_24B
Redemption · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GR
Granite 3.0 3b A800M Instruct
Granite · bartowski
Params3.37B
Context4K
Q4_K_M2.1 GB
LL
llama-3-Nephilim-v3-8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
ER
ERNIE 4.5 21B A3B Thinking
Ernie · bartowski
Params21.8B
Context128K
Q4_K_M13.5 GB
AB
Absolute_Zero_Reasoner Coder 14b
Absolute · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
CA
Carnice V2 27b
Carnice · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
TE
Tessera 27B B CJK
Tessera · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
LL
Llama 3.3 70B ArliAI RPMax v1.4
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Impish_LLAMA_4B
Llama · bartowski
Params4.5B
Context128K
Q4_K_M2.8 GB
LL
LLAMA 3_8B_Unaligned_BETA
Llama · bartowski
Params8B
Context16K
Q4_K_M4.9 GB
DE
deepseek-coder-1.3B-kexer
DeepSeek · bartowski
Params1.35B
Context16K
Q4_K_M0.9 GB
LL
Selene 1 Mini Llama 3.1 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
DE
FuseO1 DeepSeekR1 QwQ SkyT1 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
TH
AM Thinking v1
Thinking · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
WI
WizardLM-2-7B-abliterated
Wizardlm · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
knoveleng Open RS3
Open · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
deepseek-coder-6.7B-kexer
DeepSeek · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
AU
MS3.2 Austral Winton
Austral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Hercules-5.0-Qwen2-7B
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
BL
BlackSheep RP 12B
Blacksheep · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
OX
oxy 1 small
Oxy · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
SK
Skyfall 31B v4
Skyfall · bartowski
Params31.4B
Context128K
Q4_K_M19.0 GB
NE
Nemotron Cascade 14B Thinking
Nemotron · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
14B Qwen2.5 Freya x1
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
FA
Falcon3 3B Base
Falcon · bartowski
Params3.23B
Context32K
Q4_K_M2.0 GB
MA
magnum 32b v2
Magnum · bartowski
Params32.5B
Context32K
Q4_K_M19.7 GB