GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
dolphin-2.9.3-mistral-7B-32k
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
cerebras/MiniMax-M2-REAP-139B-A10B
Minimax · bartowski
Params139B
Context192K
Q4_K_M84.4 GB
GGUF
GE
Amoral Gemma3 4B
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
BT
badtheorylabs BTL 4
Btl · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
CodingReasoningTool use
DE
DeepSeek R1
DeepSeek · bartowski
Params671B
Context160K
Q4_K_M404.4 GB
Reasoning
LU
Lumimaid Magnum 12B
Lumimaid · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen2.5 32B Instruct CFT
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
LL
deepthought 8b llama v0.01 alpha
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen1.5-110B-Chat
Qwen · bartowski
Params111B
Context32K
Q4_K_M67.2 GB
GGUF
QW
Qwen2.5 0.5B
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use
LL
Llama3 DocChat 1.0 8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
ER
ERNIE 4.5 0.3B PT
Ernie · bartowski
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
AL
ALLaM 7B Instruct Preview
Allam · bartowski
Params7B
Context4K
Q4_K_M4.3 GB
GGUF
SA
Sailor2 20B Chat
Sailor · bartowski
Params19.2B
Context32K
Q4_K_M11.6 GB
GGUF
TE
Tess 4 27B
Tess · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
ReasoningTool useVision
DA
Dans PersonalityEngine V1.3.0 12b
Dans · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
CodingRoleplay
XL
xLAM 7b R
Xlam · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
GR
Granite 4.0 Micro
Granite · bartowski
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
LL
Open Insurance LLM Llama3 8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
IC
darkps ice AI
Ice · bartowski
Params8.2B
Context40K
Q4_K_M5.2 GB
GGUF
LL
nvidia Llama 3 3 Nemotron Super 49B v1 5
Llama · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · bartowski
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
LF
LFM3 1.7B
Lfm · bartowski
Params1.73B
Context256K
Q4_K_M1.1 GB
CodingReasoningTool use
SC
Scarlet Shadow 31B
Scarlet · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
RoleplayVision
GR
Grug 35b v2
Grug · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
ReasoningTool useVision
LL
NousResearch DeepHermes 3 Llama 3 3B Preview
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningRoleplayTool use
LL
Llama 3.1 Storm 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
PA
Pantheon Reasoning 26B A4B 1.1
Pantheon · bartowski
Params26B
Context256K
Q4_K_M17.5 GB
ReasoningRoleplay
SU
SuperNova Medius
Supernova · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
GE
Fallen Gemma3 12B v1
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF

Keep browsing