GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
TI
TinyR1 32B Preview v0.2
Tinyr · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
DA
PocketDoc Dans SakuraKaze V1.0.0 12b
Dans · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CR
Crystal Think V2
Crystal · bartowski
Params4B
Context32K
Q4_K_M2.5 GB
Reasoning
FA
Falcon3 3B Instruct
Falcon · bartowski
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
RE
Redemption_Wind_24B
Redemption · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
GR
Granite 3.0 3b A800M Instruct
Granite · bartowski
Params3.37B
Context4K
Q4_K_M2.1 GB
GGUF
LL
llama-3-Nephilim-v3-8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
ER
ERNIE 4.5 21B A3B Thinking
Ernie · bartowski
Params21.8B
Context128K
Q4_K_M13.5 GB
Reasoning
AB
Absolute_Zero_Reasoner Coder 14b
Absolute · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
CA
Carnice V2 27b
Carnice · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
Tool use
TE
Tessera 27B B CJK
Tessera · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningVision
LL
Llama 3.3 70B ArliAI RPMax v1.4
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Impish_LLAMA_4B
Llama · bartowski
Params4.5B
Context128K
Q4_K_M2.8 GB
GGUF
LL
LLAMA 3_8B_Unaligned_BETA
Llama · bartowski
Params8B
Context16K
Q4_K_M4.9 GB
GGUF
DE
deepseek-coder-1.3B-kexer
DeepSeek · bartowski
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
LL
Selene 1 Mini Llama 3.1 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
DE
FuseO1 DeepSeekR1 QwQ SkyT1 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
TH
AM Thinking v1
Thinking · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
WI
WizardLM-2-7B-abliterated
Wizardlm · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
knoveleng Open RS3
Open · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF
DE
deepseek-coder-6.7B-kexer
DeepSeek · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
AU
MS3.2 Austral Winton
Austral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
QW
Hercules-5.0-Qwen2-7B
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
BL
BlackSheep RP 12B
Blacksheep · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
OX
oxy 1 small
Oxy · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Roleplay
SK
Skyfall 31B v4
Skyfall · bartowski
Params31.4B
Context128K
Q4_K_M19.0 GB
GGUF
NE
Nemotron Cascade 14B Thinking
Nemotron · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Reasoning
QW
14B Qwen2.5 Freya x1
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
FA
Falcon3 3B Base
Falcon · bartowski
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
MA
magnum 32b v2
Magnum · bartowski
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF

Keep browsing