GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
PA
Pantheon Rp 1.6.2 22b Small
Pantheon · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
Roleplay
RE
lb reranker 0.5B v1.0
Reranker · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
Embedding
SP
SpatialAxiom 35B A3B
Spatialaxiom · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Vision
NE
Nemotron H 8B Reasoning 128K
Nemotron · bartowski
Params8.1B
Context1024K
Q4_K_M5.0 GB
Reasoning
SK
Skywork OR1 7B Preview
Skywork · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
TheDrummer Fallen Llama 3.3 R1 70B v1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
VA
Valkyrie 49B v2
Valkyrie · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
ME
Mellum2.1 12B A2.5B Thinking MTP
Mellum · bartowski
Params12.6B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
NE
AceReason Nemotron 1.1 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoning
CI
70B L3.3 Cirrus X1
Cirrus · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
PA
MS3.2 PaintedFantasy Visage v3 34B
Paintedfantasy · bartowski
Params34B
Context128K
Q4_K_M20.7 GB
GGUF
IN
InternLM2
InternLM · bartowski
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
TA
Tacit 1.7B
Tacit · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
AR
AREX Base
Arex · bartowski
Params122B
Context256K
Q4_K_M74.9 GB
ReasoningTool useVision
LL
Llama OpenReviewer 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
BE
Beam 1.0 501B A23B
Beam · bartowski
Params501B
Context1024K
Q4_K_M314.5 GB
CodingReasoningTool use
LL
Dobby Unhinged Llama 3.3 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
OL
Olmo 3 7B Instruct
OLMo · bartowski
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
MI
Mistral Nemo Prism 12B
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
KI
Kiwen1.1 27B
Kiwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
ReasoningVision
QW
Nemotron Research Reasoning Qwen 1.5B
Qwen · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
HE
Hermes 4 405B
Hermes · bartowski
Params405B
Context128K
Q4_K_M243.1 GB
Tool use
LL
MiniThinky v2 1B Llama 3.2
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LF
LFM2.5 VL 3B
Lfm · bartowski
Params2.7B
Context125K
Q4_K_M1.7 GB
Vision
KI
Kimi Dev 72B
Kimi · bartowski
Params72.7B
Context128K
Smallest23.7 GB
GGUF
FI
v6 Finch 3B HF
Finch · bartowski
Params3.1B
Context1024K
Q4_K_M1.9 GB
GGUF
MA
Magnum v4 22b
Magnum · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
CY
Cydonia 22B v1
Cydonia · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
CO
codegemma-2b
Codegemma · bartowski
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
XL
xLAM 8x7b R
Xlam · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use

Keep browsing