GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
IN
InternVL3_5 1B
Internvl · bartowski
Params752M
Context40K
Q4_K_M0.5 GB
Vision
CY
Cydonia R1 24B v4.1
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
Reasoning
EX
EXAONE 3.5 32B Instruct
Exaone · bartowski
Params32B
Context32K
Q4_K_M19.3 GB
GGUF
LF
LFM2 8B A1B
Lfm · bartowski
Params8.34B
Context125K
Q4_K_M5.1 GB
GGUF
ST
Strawberrylemonade 70B v1.1
Strawberrylemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
AP
Apriel 1.5 15b Thinker
Apriel · bartowski
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningVision
AF
AFM 4.5B
Afm · bartowski
Params4.62B
Context64K
Q4_K_M2.9 GB
GGUF
AN
Anubis 70B v1
Anubis · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MI
dolphin 2.8 mistral 7b v02
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
OREAL DeepSeek R1 Distill Qwen 7B
DeepSeek · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
LI
Ling Mini 2.0
Ling · bartowski
Params16.3B
Context32K
Q4_K_M9.9 GB
GGUF
NE
Nemotron Cascade 8B
Nemotron · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
Reasoning
DR
DRT O1 14B
Drt · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
SC
Schisandra
Schisandra · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
RA
X Ray_Alpha
Ray · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
YA
YanoljaNEXT Rosetta 12B 2510
Yanoljanext · bartowski
Params12.8B
Context128K
Q4_K_M7.9 GB
GGUF
NE
nvidia OpenCodeReasoning Nemotron 14B
Nemotron · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingReasoning
LL
Replete-Coder-Llama3-8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
CodingTool use
QW
Rombo LLM V3.0 Qwen 32b
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
AY
Aya Expanse 32b
Aya · bartowski
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
LL
Llama 3.1 8B UltraLong 4M Instruct
Llama · bartowski
Params8B
Context4192K
Q4_K_M4.9 GB
GGUF
FO
FoodGuard 4B
Foodguard · bartowski
Params4.41B
Context32K
Q4_K_M2.8 GB
GGUF
DA
h2o-danube3-500m-chat
Danube · bartowski
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
LF
LFM2 1.2B RAG
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
CY
Cydonia_Vistral
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
LL
Llama 3.1 Argunaut 1 8B SFT
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
QW
Qwentile2.5 32B Instruct
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
MI
Miril Drone 2B 1
Miril · bartowski
Params4.63B
Context128K
Q4_K_M3.4 GB
Vision
EX
EXAONE 4.0 32B
Exaone · bartowski
Params32B
Context128K
Q4_K_M19.3 GB
GGUF

Keep browsing