GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama3 Crab DPO
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
UL
Ultra Instruct 12B
Ultra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GE
Tiger Gemma 9B v2
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TU
Tulu MathLingo 8B
Tulu · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama-3-Smaug-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AR
Arch Function 7B
Arch · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
MI
MiroThinker v1.0 72B
Mirothinker · bartowski
Params72.7B
Context256K
Q4_K_M47.4 GB
Tool use
LL
ChatQA-1.5-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AB
L3.1 Ablaze Vulca v0.1 8B
Ablaze · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
VI
Virtuoso Large
Virtuoso · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
SE
Seeker 9b
Seeker · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
SubtleOne Qwen2.5 32b Erudite Writer
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.8 GB
Tool use
MI
Tess R1 Ballad Mistral Large 2 123B
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
Reasoning
YI
dolphin-2.9.1-yi-1.5-34b
Yi · bartowski
Params34.4B
Context8K
Q4_K_M20.7 GB
CodingTool use
TH
Theia 21B V2A
Theia · bartowski
Params20.4B
Context1000K
Q4_K_M12.4 GB
GGUF
DE
DeepSeek Llama3.3 Bllossom 70B
DeepSeek · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Code-Llama-3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
TA
TAID LLM 1.5B
Taid · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
MA
magnum v4 123b
Magnum · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
Tool use
MI
Hermes 2 Pro Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
QW
Chuluun Qwen2.5 72B v0.01
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
FA
Falcon3 1B Base
Falcon · bartowski
Params1.67B
Context4K
Q4_K_M1.1 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · bartowski
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
IN
Infracelestial 27B
Infracelestial · bartowski
Params26.9B
Context256K
Q4_K_M17.5 GB
ReasoningRoleplayTool use
DO
Dots.Llm1.Inst
Dots · bartowski
Params143B
Context32K
Q4_K_M96.1 GB
GGUF
MI
LiberatedHermes 2 Pro Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
SC
MS Schisandra 22B v0.3
Schisandra · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
NU
NuExtract 1.5 Smol
Nuextract · bartowski
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
LY
MN Lyrebird 12B
Lyrebird · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
HE
Helpingai3 Raw
Helpingai · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF

Keep browsing