GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
QW
VellumMini 0.1 Qwen3 14B
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
GE
TheDrummer Gemmasutra Small 4B v1
Gemma · bartowski
Params3.86B
Context8K
Q4_K_M2.5 GB
NE
Orchestrator 8B
Nemotron · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
MS
MSM MS Cydrion 22B
Msm · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
OP
Openhands Lm 1.5b v0.1
Openhands · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
GR
Grug 35B A3B
Grug · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
FU
Functiongemma 270m It
Functiongemma · bartowski
Params268M
Context32K
Q4_K_M0.3 GB
HA
Hathor Sofit L3 8B v1
Hathor · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
KW
KwaiCoder AutoThink Preview
Kwaicoder · bartowski
Params40.6B
Context32K
Q4_K_M24.6 GB
QW
Rombos LLM V2.6 Qwen 14b
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GL
GLM4 9B Neon v2
GLM · bartowski
Params9.4B
Context32K
Q4_K_M6.2 GB
GE
L3.3 GeneticLemonade Opus 70B
Geneticlemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
PA
Pantheon Rp 1.8 24b Small 3.1
Pantheon · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
LA
Laguna S 2.1
Laguna · bartowski
Params118B
Context1024K
Q4_K_M71.8 GB
LL
Meta-Llama-3-8B-Instruct
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
VI
Virtuoso Lite
Virtuoso · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
MU
G4 E4B Musica v1
Musica · bartowski
Params7.5B
Context128K
Q4_K_M5.4 GB
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
MI
MiniCPM O 2_6
MiniCPM · bartowski
Params7.6B
Context32K
Q4_K_M4.7 GB
LL
FuseChat Llama 3.1 8B Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
SN
Snowpiercer 15B v3
Snowpiercer · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
QW
Replete LLM V2.5 Qwen 0.5b
Qwen · bartowski
Params630M
Context32K
Q4_K_M0.5 GB
DE
DeepSeek V3 0324
DeepSeek · bartowski
Params670B
Context160K
Q4_K_M404.4 GB
TE
Tess 4 9B
Tess · bartowski
Params9.2B
Context256K
Q4_K_M6.0 GB
CO
C4Ai Command R 08 2024
Command R · bartowski
Params32.3B
Context128K
Q4_K_M19.8 GB
LL
dolphin-2.9.1-llama-3-70b
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
OP
open thoughts OpenThinker2 7B
Openthinker · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Rombos Coder V2.5 Qwen 32b
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
TW
TwinLlama 3.1 8B
Twinllama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
AU
Aurora Code 1
Aurora · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB