GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
FA
CollectiveLM Falcon 3 7B
Falcon · bartowski
Params7.46B
Context32K
Q4_K_M4.6 GB
DO
Donnager 70B V1A
Donnager · bartowski
Params69B
Context32K
Q4_K_M41.4 GB
DE
FuseO1 DeepSeekR1 QwQ 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
LL
Tess R1 Limerick Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Young-Children-Storyteller-Mistral-7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 2 2b Jpn It
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
BE
Behemoth 123B v2.2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
CO
Command A Reasoning 08 2025
Command · bartowski
Params111B
Context488K
Q4_K_M67.1 GB
QW
Qwen1.5-7B-Chat
Qwen · bartowski
Params7.72B
Context32K
Q4_K_M4.8 GB
AN
AnubisLemonade 70B v1
Anubislemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
OR
Orbit 3.2 Nano
Orbit · bartowski
Params2.7B
Context128K
Q4_K_M1.8 GB
LL
Smaug-Llama-3-70B-Instruct
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
BI
BigQwen2.5 52B Instruct
Bigqwen · bartowski
Params52.3B
Context32K
Q4_K_M31.6 GB
LL
AMD Llama 135m
Llama · bartowski
Params134M
Context2K
Q4_K_M0.1 GB
AR
Arcee Blitz
Arcee · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mistral v0.3 7B ORPO
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
PO
Polaris 4B Preview
Polaris · bartowski
Params4.02B
Context128K
Q4_K_M2.5 GB
NE
nvidia OpenCodeReasoning Nemotron 7B
Nemotron · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
OL
AMD OLMo 1B SFT DPO
OLMo · bartowski
Params1.18B
Context2K
Q4_K_M0.7 GB
MI
Hermes 2 Pro Mistral 10.7B
Mistral · bartowski
Params10.7B
Context32K
Q4_K_M6.5 GB
WA
wavecoder ultra 6.7b
Wavecoder · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
QW
OpenR1-Qwen-7B
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
CA
Captain Eris Violet V0.420 12B
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
ME
Megrez 3B Instruct
Megrez · bartowski
Params2.92B
Context32K
Q4_K_M1.8 GB
LL
Llama 3.1 SuperNova 8B Lite TIES with Base
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
BE
Behemoth 123B v2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
QW
Samantha-Qwen-2-7B
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Llama 3.1 8B ArliAI RPMax v1.1
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Ministrations 8B v1
Ministrations · bartowski
Params8.02B
Context32K
Q4_K_M4.9 GB
LL
Llama 3.1 8B UltraLong 2M Instruct
Llama · bartowski
Params8.04B
Context2096K
Q4_K_M4.9 GB