GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
PA
Pantheon Rp 1.5 12b Nemo
Pantheon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
CO
Codefu 7b v0.1
Codefu · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
MI
MiMo V2.5
Mimo · bartowski
Params310B
Context1024K
Q4_K_M188.8 GB
GE
Amoral Fallen Omega Gemma3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
MI
mergekit community Mistral Small 2501 SCE Mashup 2 24B
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
LF
LFM2 1.2B Extract
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
SH
shuttle 3
Shuttle · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
DA
datagemma rag 27b it
Datagemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
QW
Qwen3.5 9B Neo
Qwen · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
GE
Vikhr-Gemma-2B-instruct
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
OP
OpenCoder 8B Instruct
Opencoder · bartowski
Params7.77B
Context8K
Q4_K_M4.7 GB
WA
Watt Tool 70B
Watt · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
JA
AI21 Jamba2 Mini
Jamba · bartowski
Params51.6B
Context256K
Q4_K_M31.2 GB
QW
ChaoticNeutrals Very Berry Qwen2 7B
Qwen · bartowski
Params7.6B
Context32K
Q4_K_M4.7 GB
GE
Gemmasutra Mini 2B v1
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
perplexity ai r1 1776 distill llama 70b
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
MindLink 32B 0801
Mindlink · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
LL
Llama 3.1 8B Instruct Heretic
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
FA
falcon mamba 7b
Falcon · bartowski
Params7.27B
Context1024K
Q4_K_M4.2 GB
MA
suayptalha Maestro 10B
Maestro · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
PH
Phi 4 Heretic
Phi · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
AT
Athene V2 Chat
Athene · bartowski
Params73B
Context32K
Q4_K_M47.4 GB
MI
Mistral Small 24B Instruct 2501
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GR
Gradience T1 3B Preview
Gradience · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
DE
Deepthink Reasoning 7B
Deepthink · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
ST
dolphincoder-starcoder2-7b
StarCoder · bartowski
Params7.4B
Context16K
Q4_K_M4.6 GB
AS
Astrea R8 Chat 9B
Astrea · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
WA
Wayfarer 2 12B
Wayfarer · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
MiniMax M2
Minimax · bartowski
Params230B
Context192K
Q4_K_M138.6 GB
SK
Skyfall 31B v4.1
Skyfall · bartowski
Params31.4B
Context128K
Q4_K_M19.0 GB