GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Wukong-0.1-Mistral-7B-v0.2
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
SH
L3.3 Unnamed Exp 70B v0.8
Shakudo · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GR
Granite 4.1 3b
Granite · bartowski
Params3.4B
Context128K
Q4_K_M2.2 GB
Tool use
QW
72B Qwen2.5 Kunou v1
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
IN
Intern S1
InternLM · bartowski
Params235B
Context40K
Q4_K_M142.7 GB
Vision
RE
Replete LLM Mist Nemo 12b
Replete · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
UM
L3 Umbral Mind RP v3.0 8B
Umbral · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
NE
OpenMath Nemotron 14B
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
NE
Anubis 70B v1
Negative · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama-3.1-8B-Think
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
SE
SERA 8B GA
Sera · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
CY
cybertron v4 qw7B MGS
Cybertron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
BY
ByteCraft
Bytecraft · bartowski
Params8.39B
Context32K
Q4_K_M5.2 GB
Tool use
OL
Olmo Marvin Full Merged
OLMo · bartowski
Params32.2B
Context64K
Q4_K_M19.5 GB
Tool use
MI
Minitron 4B Base
Minitron · bartowski
Params4.19B
Context4K
Q4_K_M2.7 GB
GGUF
IN
MN 12b RP Ink
Ink · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
QW
Qwen2.5 72B
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
HA
Hathor Tahsin L3 8B v0.9
Hathor · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
dolphin-2.9.1-llama-3-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
QW
Deductive Reasoning Qwen 14B
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
RE
Remnant Mn 12b
Remnant · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
MA
Magnum v2 123b
Magnum · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
LI
Ling Lite
Ling · bartowski
Params16.8B
Context16K
Q4_K_M11.2 GB
GGUF
NE
nvidia OpenCodeReasoning Nemotron 32B
Nemotron · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingReasoningTool use
LL
Menlo ReZero v0.1 llama 3.2 3b it grpo 250404
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
AN
TheDrummer Anubis Pro 105B v1
Anubis · bartowski
Params105B
Context128K
Q4_K_M63.0 GB
Tool use
HU
HuatuoGPT O1 7B v0.1
Huatuogpt · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
LL
Einstein-v6.1-Llama3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
BR
Brisk Evolution 12B v0.1
Brisk · bartowski
Params12B
Context4192K
Q4_K_M7.5 GB
Roleplay
DE
DeepSeek V3.1 Base
DeepSeek · bartowski
Params671B
Context160K
Q4_K_M409.2 GB
ReasoningTool use

Keep browsing