GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
PA
Pantheon Rp 1.5 12b Nemo
Pantheon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
CO
Codefu 7b v0.1
Codefu · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MI
MiMo V2.5
Mimo · bartowski
Params310B
Context1024K
Q4_K_M188.8 GB
Vision
GE
Amoral Fallen Omega Gemma3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
Roleplay
MI
mergekit community Mistral Small 2501 SCE Mashup 2 24B
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
LF
LFM2 1.2B Extract
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
SH
shuttle 3
Shuttle · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
DA
datagemma rag 27b it
Datagemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
QW
Qwen3.5 9B Neo
Qwen · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
ReasoningVision
GE
Vikhr-Gemma-2B-instruct
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
OP
OpenCoder 8B Instruct
Opencoder · bartowski
Params7.77B
Context8K
Q4_K_M4.7 GB
Coding
WA
Watt Tool 70B
Watt · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
JA
AI21 Jamba2 Mini
Jamba · bartowski
Params51.6B
Context256K
Q4_K_M31.2 GB
GGUF
QW
ChaoticNeutrals Very Berry Qwen2 7B
Qwen · bartowski
Params7.6B
Context32K
Q4_K_M4.7 GB
GGUF
GE
Gemmasutra Mini 2B v1
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
perplexity ai r1 1776 distill llama 70b
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
MI
MindLink 32B 0801
Mindlink · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
LL
Llama 3.1 8B Instruct Heretic
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
FA
falcon mamba 7b
Falcon · bartowski
Params7.27B
Context1024K
Q4_K_M4.2 GB
GGUF
MA
suayptalha Maestro 10B
Maestro · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
PH
Phi 4 Heretic
Phi · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
AT
Athene V2 Chat
Athene · bartowski
Params73B
Context32K
Q4_K_M47.4 GB
GGUF
MI
Mistral Small 24B Instruct 2501
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
GR
Gradience T1 3B Preview
Gradience · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
Reasoning
DE
Deepthink Reasoning 7B
Deepthink · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingReasoning
ST
dolphincoder-starcoder2-7b
StarCoder · bartowski
Params7.4B
Context16K
Q4_K_M4.6 GB
CodingTool use
AS
Astrea R8 Chat 9B
Astrea · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
WA
Wayfarer 2 12B
Wayfarer · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
MI
MiniMax M2
Minimax · bartowski
Params230B
Context192K
Q4_K_M138.6 GB
GGUF
SK
Skyfall 31B v4.1
Skyfall · bartowski
Params31.4B
Context128K
Q4_K_M19.0 GB
GGUF

Keep browsing