GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
PA
Pantheon Rp 1.6.2 22b Small
Pantheon · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
RE
lb reranker 0.5B v1.0
Reranker · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
SP
SpatialAxiom 35B A3B
Spatialaxiom · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
NE
Nemotron H 8B Reasoning 128K
Nemotron · bartowski
Params8.1B
Context1024K
Q4_K_M5.0 GB
SK
Skywork OR1 7B Preview
Skywork · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
TheDrummer Fallen Llama 3.3 R1 70B v1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
VA
Valkyrie 49B v2
Valkyrie · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
ME
Mellum2.1 12B A2.5B Thinking MTP
Mellum · bartowski
Params12.6B
Context128K
Q4_K_M9.0 GB
NE
AceReason Nemotron 1.1 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
CI
70B L3.3 Cirrus X1
Cirrus · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
PA
MS3.2 PaintedFantasy Visage v3 34B
Paintedfantasy · bartowski
Params34B
Context128K
Q4_K_M20.7 GB
IN
InternLM2
InternLM · bartowski
Params7.74B
Context32K
Q4_K_M4.7 GB
TA
Tacit 1.7B
Tacit · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
AR
AREX Base
Arex · bartowski
Params122B
Context256K
Q4_K_M74.9 GB
LL
Llama OpenReviewer 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
BE
Beam 1.0 501B A23B
Beam · bartowski
Params501B
Context1024K
Q4_K_M314.5 GB
LL
Dobby Unhinged Llama 3.3 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
OL
Olmo 3 7B Instruct
OLMo · bartowski
Params7.3B
Context64K
Q4_K_M4.5 GB
MI
Mistral Nemo Prism 12B
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
KI
Kiwen1.1 27B
Kiwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
QW
Nemotron Research Reasoning Qwen 1.5B
Qwen · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
HE
Hermes 4 405B
Hermes · bartowski
Params405B
Context128K
Q4_K_M243.1 GB
LL
MiniThinky v2 1B Llama 3.2
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
LF
LFM2.5 VL 3B
Lfm · bartowski
Params2.7B
Context125K
Q4_K_M1.7 GB
KI
Kimi Dev 72B
Kimi · bartowski
Params72.7B
Context128K
Smallest23.7 GB
FI
v6 Finch 3B HF
Finch · bartowski
Params3.1B
Context1024K
Q4_K_M1.9 GB
MA
Magnum v4 22b
Magnum · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
CY
Cydonia 22B v1
Cydonia · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
CO
codegemma-2b
Codegemma · bartowski
Params2.51B
Context8K
Q4_K_M1.6 GB
XL
xLAM 8x7b R
Xlam · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB