GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
IN
InternVL3_5 1B
Internvl · bartowski
Params752M
Context40K
Q4_K_M0.5 GB
CY
Cydonia R1 24B v4.1
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
EX
EXAONE 3.5 32B Instruct
Exaone · bartowski
Params32B
Context32K
Q4_K_M19.3 GB
LF
LFM2 8B A1B
Lfm · bartowski
Params8.34B
Context125K
Q4_K_M5.1 GB
ST
Strawberrylemonade 70B v1.1
Strawberrylemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
AP
Apriel 1.5 15b Thinker
Apriel · bartowski
Params14.4B
Context256K
Q4_K_M8.8 GB
AF
AFM 4.5B
Afm · bartowski
Params4.62B
Context64K
Q4_K_M2.9 GB
AN
Anubis 70B v1
Anubis · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
dolphin 2.8 mistral 7b v02
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
OREAL DeepSeek R1 Distill Qwen 7B
DeepSeek · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
LI
Ling Mini 2.0
Ling · bartowski
Params16.3B
Context32K
Q4_K_M9.9 GB
NE
Nemotron Cascade 8B
Nemotron · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
DR
DRT O1 14B
Drt · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
SC
Schisandra
Schisandra · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
RA
X Ray_Alpha
Ray · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
YA
YanoljaNEXT Rosetta 12B 2510
Yanoljanext · bartowski
Params12.8B
Context128K
Q4_K_M7.9 GB
NE
nvidia OpenCodeReasoning Nemotron 14B
Nemotron · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
Replete-Coder-Llama3-8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
QW
Rombo LLM V3.0 Qwen 32b
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
AY
Aya Expanse 32b
Aya · bartowski
Params32.3B
Context8K
Q4_K_M19.8 GB
LL
Llama 3.1 8B UltraLong 4M Instruct
Llama · bartowski
Params8B
Context4192K
Q4_K_M4.9 GB
FO
FoodGuard 4B
Foodguard · bartowski
Params4.41B
Context32K
Q4_K_M2.8 GB
DA
h2o-danube3-500m-chat
Danube · bartowski
Params514M
Context8K
Q4_K_M0.3 GB
LF
LFM2 1.2B RAG
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
CY
Cydonia_Vistral
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
Llama 3.1 Argunaut 1 8B SFT
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwentile2.5 32B Instruct
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
MI
Miril Drone 2B 1
Miril · bartowski
Params4.63B
Context128K
Q4_K_M3.4 GB
EX
EXAONE 4.0 32B
Exaone · bartowski
Params32B
Context128K
Q4_K_M19.3 GB