GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Replete LLM V2 Llama 3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
CodingTool use
IN
OREAL 7B
InternLM · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
CO
Cosmic Lightning
Cosmic · bartowski
Params1.73B
Context256K
Q4_K_M1.1 GB
ReasoningTool use
PA
MS3.2 PaintedFantasy Visage 33B
Paintedfantasy · bartowski
Params33.6B
Context128K
Q4_K_M20.4 GB
Roleplay
MI
Tess 3 Mistral Nemo
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
JA
Jan v3 4B Base Instruct
Jan · bartowski
Params4.41B
Context256K
Q4_K_M2.7 GB
Coding
KI
moonshotai Kimi K2.6
Kimi · bartowski
Params1030B
Context256K
Smallest1.5 GB
GGUF
LL
Llama 3.1 Hawkish 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
AT
Athene 70B
Athene · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
NE
OpenReasoning Nemotron 32B
Nemotron · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
JA
AI21 Jamba Mini 1.7
Jamba · bartowski
Params51.6B
Context256K
Q4_K_M31.2 GB
GGUF
MI
MiMo VL 7B SFT 2508
Mimo · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QU
Quest AI quest corruption 7b s375 v3 GRPO
Quest · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
OneLLM Doey ChatQA V1 Llama 3.2 1B
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
JA
Jan v1 4B
Jan · bartowski
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
AY
aya-23-8B
Aya · bartowski
Params8B
Context8K
Q4_K_M5.1 GB
GGUF
LU
Menlo Lucy
Lucy · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
NE
Nemomix v2.0 12B
Nemomix · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
DR
DRT O1 7B
Drt · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
GL
GLM 4.6V
GLM · bartowski
Params107B
Context128K
Q4_K_M71.4 GB
ReasoningTool useVision
GE
Gemma4 31b Gembrain Equinox
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Roleplay
AN
AnubisLemonade 70B v1.1
Anubislemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
OL
Olmo 3 7B Think
OLMo · bartowski
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
MI
MiMo V2 Flash
Mimo · bartowski
Params309B
Context256K
Q4_K_M187.1 GB
ReasoningTool use
AV
Ava 1.0 12B
Ava · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
MiniMax M2.1
Minimax · bartowski
Params230B
Context192K
Q4_K_M138.6 GB
GGUF
SA
Sarvam M
Sarvam · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
OP
OpenThinker Agent v1
Openthinker · bartowski
Params8.2B
Context40K
Q4_K_M5.0 GB
Coding
MA
magnum-72b-v1
Magnum · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
LU
Lucy 128k
Lucy · bartowski
Params1.72B
Context128K
Q4_K_M1.1 GB
GGUF

Keep browsing