GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
RE
RA Reasoner
Reasoner · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
MI
Mistral Large 3 675B Instruct 2512
Mistral · bartowski
Params673B
Context288K
Q4_K_M411.4 GB
Tool useVision
LL
Llama 3.1_OpenScholar 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
OP
OpenClaude 1.7B Merged
Openclaude · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
Reasoning
LL
Llama SmolTalk 3.2 1B Instruct
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
WH
When2Think ThinkOnly 1.5B
When · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · bartowski
Params14B
Context4K
Q4_K_M8.4 GB
CodingTool use
MA
Steelskull L3.3 Cu Mai R1 70b
Mai · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
AG
Agentflow Planner 7b
Agentflow · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
AL
TQ2.5 14B Aletheia v1
Aletheia · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
CH
Chronos Platinum 72B
Chronos · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Roleplay
MI
miniclaus qw1.5B UNAMGS
Miniclaus · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF
LL
Reflection Llama 3.1 70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
PR
L3.3 Prikol 70B v0.2
Prikol · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
ST
L3 SthenoMaid 8B V1
Sthenomaid · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
allenai Llama 3.1 Tulu 3.1 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
EV
L3.3 MS Evalebis 70b
Evalebis · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
DE
DeepSeek Coder V2 Instruct 0724
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
Coding
QW
Qwen2.5 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
AR
AGI 0 Art Skynet 3B
Art · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
QW
QwQ Unofficial 14B Math v0.2
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
QW
Replete LLM V2.5 Qwen 1.5b
Qwen · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
GGUF
ST
Step 3.5 Flash
Step · bartowski
Params197B
Context256K
Q4_K_M119.9 GB
GGUF
CE
L3.1 8B Celeste V1.5
Celeste · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
TA
UI TARS 72B SFT
Tars · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Vision
TR
Trinity Large Preview
Trinity · bartowski
Params399B
Context256K
Q4_K_M241.6 GB
GGUF
GR
Granite 4.1 30b
Granite · bartowski
Params28.9B
Context128K
Q4_K_M17.8 GB
GGUF
MA
Magistry 24B v1.1
Magistry · bartowski
Params23.6B
Context128K
Q4_K_M14.6 GB
GGUF
MI
MathCoder2 Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
MiroThinker v1.0 8B
Mirothinker · bartowski
Params8.19B
Context256K
Q4_K_M5.0 GB
GGUF

Keep browsing