GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
CH
Chocolatine 3B Instruct DPO v1.2
Chocolatine · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
AR
Artemis 31B v1
Artemis · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
LF
LFM2 VL 450M
Lfm · bartowski
Params354M
Context125K
Q4_K_M0.2 GB
JE
Jebadiah 27b v2 1
Jebadiah · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
VI
Vikhr Nemo 12B Instruct R 21 09 24
Vikhr · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
DE
FuseO1 DeepSeekR1 Qwen2.5 Coder 32B Preview v0.1
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
LL
nvidia Llama 3 3 Nemotron Super 49B v1
Llama · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
GE
Gemma4 Gutenberg 31B
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
QW
Qwable v1
Qwable · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
OV
OvisOCR2
Ovisocr · bartowski
Params752M
Context256K
Q4_K_M0.6 GB
MI
Devstral Small 2507
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Replete LLM V2.5 Qwen 32b
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GE
Gemma 3 1b It Qat
Gemma · bartowski
Params1B
Context32K
Q4_K_M0.8 GB
XO
XORTRON AgentRICO
Xortron · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
NE
L3.3 Nevoria R1 70b
Nevoria · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
YI
EVA Yi 1.5 9B 32K V1
Yi · bartowski
Params8.83B
Context32K
Q4_K_M5.3 GB
ER
ERNIE 4.5 21B A3B PT
Ernie · bartowski
Params21.8B
Context128K
Q4_K_M13.5 GB
NO
nomic ai nomic embed code
Nomic · bartowski
Params7.1B
Context32K
Q4_K_M4.4 GB
MI
Magistral Small 2509
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
FR
Froopert 31B
Froopert · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
MI
Mistral Large Instruct 2407
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
NE
Nex N2.5 Pro
Nex · bartowski
Params396B
Context256K
Q4_K_M250.8 GB
GR
Granite 4.0 H Small
Granite · bartowski
Params32.2B
Context1024K
Q4_K_M19.7 GB
ON
OneJev 0.8B
Onejev · bartowski
Params1.01B
Context256K
Q4_K_M0.7 GB
QW
OpenBuddy OpenBuddy R1 0528 Distill Qwen3 32B Preview0 QAT
Qwen · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
GR
GRM 2.6 Plus 0628
Grm · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
MI
Devstral 2 123B Instruct 2512
Mistral · bartowski
Params125B
Context256K
Q4_K_M74.9 GB