GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
PA
Palmyra Med 70B 32K
Palmyra · bartowski
Params70.6B
Context32K
Q4_K_M42.5 GB
GGUF
SI
simplescaling s1.1 32B
bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
NA
Nanbeige4 3B Thinking 2511
Nanbeige · bartowski
Params3.93B
Context64K
Q4_K_M2.4 GB
Reasoning
FO
ReadyArt Forgotten Safeword 70B 3.6
Forgotten · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
CA
Cassiopeia 70B
Cassiopeia · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
llama-3-cat-8b-instruct-v1
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · bartowski
Params284B
Context—
Smallest10.9 GB
GGUF
JA
Jan Nano 128k
Jan · bartowski
Params4B
Context128K
Q4_K_M2.5 GB
GGUF
FI
v6 Finch 14B HF
Finch · bartowski
Params14.1B
Context1024K
Q4_K_M8.8 GB
GGUF
SA
Steelskull L3.3 San Mai R1 70b
San · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
GR
xai org grok 2
Grok · bartowski
Params270B
Context128K
Q4_K_M164.1 GB
GGUF
LL
Llama 3.1 Tulu 3 70B DPO
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
nvidia Llama 3 1 Nemotron Ultra 253B v1
Llama · bartowski
Params253B
Context128K
Q4_K_M150.9 GB
GGUF
LL
dolphin-2.9-llama3-8b
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
CodingTool use
PH
dolphin-2.9.2-Phi-3-Medium
Phi · bartowski
Params14B
Context4K
Q4_K_M8.4 GB
CodingTool use
LL
Cogito v2 Preview Llama 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
MI
BlackSheep Mistral RP 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
MiroThinker v1.0 30B
Mirothinker · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
LL
MathCoder2 Llama 3 8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
Coding
ST
Step 3.7 Flash
Step · bartowski
Params199B
Context256K
Q4_K_M121.6 GB
ReasoningTool useVision
LL
Llama 3.2 Korean Bllossom 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
TI
TinySwallow 1.5B Instruct
Tinyswallow · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
FA
Falcon3 10B Base
Falcon · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
QW
Rombo LLM V3.0 Qwen 72b
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
ReasoningTool use
CY
cybertron v4 qw7B UNAMGS
Cybertron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
SA
TheSkullery L3.3 exp unnamed model 70b v0.5
San · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
GL
GLM4 32B Neon v2
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
GGUF
TH
TheSalt-RP-L3-8b-DPO-v0.3.2-e0.14.2
Thesalt · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
BA
Babel 83B Chat
Babel · bartowski
Params83.2B
Context128K
Q4_K_M54.2 GB
Tool use
RE
reader lm 1.5b
Reader · bartowski
Params1.54B
Context250K
Q4_K_M1.0 GB
GGUF

Keep browsing