GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
RE
RA Reasoner
Reasoner · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
MI
Mistral Large 3 675B Instruct 2512
Mistral · bartowski
Params673B
Context288K
Q4_K_M411.4 GB
LL
Llama 3.1_OpenScholar 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
OP
OpenClaude 1.7B Merged
Openclaude · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
LL
Llama SmolTalk 3.2 1B Instruct
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
WH
When2Think ThinkOnly 1.5B
When · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · bartowski
Params14B
Context4K
Q4_K_M8.4 GB
MA
Steelskull L3.3 Cu Mai R1 70b
Mai · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
AG
Agentflow Planner 7b
Agentflow · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
AL
TQ2.5 14B Aletheia v1
Aletheia · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
CH
Chronos Platinum 72B
Chronos · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
MI
miniclaus qw1.5B UNAMGS
Miniclaus · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
LL
Reflection Llama 3.1 70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
PR
L3.3 Prikol 70B v0.2
Prikol · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
ST
L3 SthenoMaid 8B V1
Sthenomaid · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
LL
allenai Llama 3.1 Tulu 3.1 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
EV
L3.3 MS Evalebis 70b
Evalebis · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek Coder V2 Instruct 0724
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
QW
Qwen2.5 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
AR
AGI 0 Art Skynet 3B
Art · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
QwQ Unofficial 14B Math v0.2
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Replete LLM V2.5 Qwen 1.5b
Qwen · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
ST
Step 3.5 Flash
Step · bartowski
Params197B
Context256K
Q4_K_M119.9 GB
CE
L3.1 8B Celeste V1.5
Celeste · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
TA
UI TARS 72B SFT
Tars · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
TR
Trinity Large Preview
Trinity · bartowski
Params399B
Context256K
Q4_K_M241.6 GB
GR
Granite 4.1 30b
Granite · bartowski
Params28.9B
Context128K
Q4_K_M17.8 GB
MA
Magistry 24B v1.1
Magistry · bartowski
Params23.6B
Context128K
Q4_K_M14.6 GB
MI
MathCoder2 Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiroThinker v1.0 8B
Mirothinker · bartowski
Params8.19B
Context256K
Q4_K_M5.0 GB