GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
LL
Replete LLM V2 Llama 3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
IN
OREAL 7B
InternLM · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
CO
Cosmic Lightning
Cosmic · bartowski
Params1.73B
Context256K
Q4_K_M1.1 GB
PA
MS3.2 PaintedFantasy Visage 33B
Paintedfantasy · bartowski
Params33.6B
Context128K
Q4_K_M20.4 GB
MI
Tess 3 Mistral Nemo
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
JA
Jan v3 4B Base Instruct
Jan · bartowski
Params4.41B
Context256K
Q4_K_M2.7 GB
KI
moonshotai Kimi K2.6
Kimi · bartowski
Params1030B
Context256K
Smallest1.5 GB
LL
Llama 3.1 Hawkish 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
AT
Athene 70B
Athene · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
NE
OpenReasoning Nemotron 32B
Nemotron · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
JA
AI21 Jamba Mini 1.7
Jamba · bartowski
Params51.6B
Context256K
Q4_K_M31.2 GB
MI
MiMo VL 7B SFT 2508
Mimo · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
QU
Quest AI quest corruption 7b s375 v3 GRPO
Quest · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
OneLLM Doey ChatQA V1 Llama 3.2 1B
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
JA
Jan v1 4B
Jan · bartowski
Params4.02B
Context256K
Q4_K_M2.5 GB
AY
aya-23-8B
Aya · bartowski
Params8B
Context8K
Q4_K_M5.1 GB
LU
Menlo Lucy
Lucy · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
NE
Nemomix v2.0 12B
Nemomix · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
DR
DRT O1 7B
Drt · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GL
GLM 4.6V
GLM · bartowski
Params107B
Context128K
Q4_K_M71.4 GB
GE
Gemma4 31b Gembrain Equinox
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
AN
AnubisLemonade 70B v1.1
Anubislemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
OL
Olmo 3 7B Think
OLMo · bartowski
Params7.3B
Context64K
Q4_K_M4.5 GB
MI
MiMo V2 Flash
Mimo · bartowski
Params309B
Context256K
Q4_K_M187.1 GB
AV
Ava 1.0 12B
Ava · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
MiniMax M2.1
Minimax · bartowski
Params230B
Context192K
Q4_K_M138.6 GB
SA
Sarvam M
Sarvam · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
OP
OpenThinker Agent v1
Openthinker · bartowski
Params8.2B
Context40K
Q4_K_M5.0 GB
MA
magnum-72b-v1
Magnum · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
LU
Lucy 128k
Lucy · bartowski
Params1.72B
Context128K
Q4_K_M1.1 GB