GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
FA
CollectiveLM Falcon 3 7B
Falcon · bartowski
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
DO
Donnager 70B V1A
Donnager · bartowski
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
DE
FuseO1 DeepSeekR1 QwQ 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
LL
Tess R1 Limerick Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
MI
Young-Children-Storyteller-Mistral-7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma 2 2b Jpn It
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
BE
Behemoth 123B v2.2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
CO
Command A Reasoning 08 2025
Command · bartowski
Params111B
Context488K
Q4_K_M67.1 GB
ReasoningTool use
QW
Qwen1.5-7B-Chat
Qwen · bartowski
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
AN
AnubisLemonade 70B v1
Anubislemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
OR
Orbit 3.2 Nano
Orbit · bartowski
Params2.7B
Context128K
Q4_K_M1.8 GB
ReasoningTool use
LL
Smaug-Llama-3-70B-Instruct
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
BI
BigQwen2.5 52B Instruct
Bigqwen · bartowski
Params52.3B
Context32K
Q4_K_M31.6 GB
GGUF
LL
AMD Llama 135m
Llama · bartowski
Params134M
Context2K
Q4_K_M0.1 GB
GGUF
AR
Arcee Blitz
Arcee · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Mistral v0.3 7B ORPO
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
PO
Polaris 4B Preview
Polaris · bartowski
Params4.02B
Context128K
Q4_K_M2.5 GB
GGUF
NE
nvidia OpenCodeReasoning Nemotron 7B
Nemotron · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingReasoningTool use
OL
AMD OLMo 1B SFT DPO
OLMo · bartowski
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
MI
Hermes 2 Pro Mistral 10.7B
Mistral · bartowski
Params10.7B
Context32K
Q4_K_M6.5 GB
Tool use
WA
wavecoder ultra 6.7b
Wavecoder · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
QW
OpenR1-Qwen-7B
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
CA
Captain Eris Violet V0.420 12B
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
ME
Megrez 3B Instruct
Megrez · bartowski
Params2.92B
Context32K
Q4_K_M1.8 GB
GGUF
LL
Llama 3.1 SuperNova 8B Lite TIES with Base
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
BE
Behemoth 123B v2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
QW
Samantha-Qwen-2-7B
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
LL
Llama 3.1 8B ArliAI RPMax v1.1
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Ministrations 8B v1
Ministrations · bartowski
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B UltraLong 2M Instruct
Llama · bartowski
Params8.04B
Context2096K
Q4_K_M4.9 GB
Tool use

Keep browsing