GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
LL
Llama3 Crab DPO
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
UL
Ultra Instruct 12B
Ultra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
Tiger Gemma 9B v2
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
TU
Tulu MathLingo 8B
Tulu · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-Smaug-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
AR
Arch Function 7B
Arch · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
MiroThinker v1.0 72B
Mirothinker · bartowski
Params72.7B
Context256K
Q4_K_M47.4 GB
LL
ChatQA-1.5-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
AB
L3.1 Ablaze Vulca v0.1 8B
Ablaze · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
VI
Virtuoso Large
Virtuoso · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
SE
Seeker 9b
Seeker · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
SubtleOne Qwen2.5 32b Erudite Writer
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.8 GB
MI
Tess R1 Ballad Mistral Large 2 123B
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
YI
dolphin-2.9.1-yi-1.5-34b
Yi · bartowski
Params34.4B
Context8K
Q4_K_M20.7 GB
TH
Theia 21B V2A
Theia · bartowski
Params20.4B
Context1000K
Q4_K_M12.4 GB
DE
DeepSeek Llama3.3 Bllossom 70B
DeepSeek · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Code-Llama-3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
TA
TAID LLM 1.5B
Taid · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
MA
magnum v4 123b
Magnum · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
MI
Hermes 2 Pro Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Chuluun Qwen2.5 72B v0.01
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
FA
Falcon3 1B Base
Falcon · bartowski
Params1.67B
Context4K
Q4_K_M1.1 GB
YI
Yi-1.5-34B-Chat
Yi · bartowski
Params34.4B
Context4K
Q4_K_M20.7 GB
IN
Infracelestial 27B
Infracelestial · bartowski
Params26.9B
Context256K
Q4_K_M17.5 GB
DO
Dots.Llm1.Inst
Dots · bartowski
Params143B
Context32K
Q4_K_M96.1 GB
MI
LiberatedHermes 2 Pro Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
SC
MS Schisandra 22B v0.3
Schisandra · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
NU
NuExtract 1.5 Smol
Nuextract · bartowski
Params1.71B
Context8K
Q4_K_M1.1 GB
LY
MN Lyrebird 12B
Lyrebird · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
HE
Helpingai3 Raw
Helpingai · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB