GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
OP
open thoughts OpenThinker 32B
Openthinker · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
SE
T Search
Search · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
MI
Mixtral-8x22B-v0.1
Mistral · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
CA
Cathallama 70B
Cathallama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen3.5 27B Writer
Qwen · bartowski
Params26.9B
Context256K
Q4_K_M17.5 GB
MI
speechless-instruct-mistral-7b-v0.2
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
GEMMA SUTRA
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
BI
allura org Bigger Body 8b
Bigger · bartowski
Params8.02B
Context32K
Q4_K_M4.9 GB
GE
Gemma 3 Starshine 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
LL
Llama 3 8B Instruct Coder
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
CY
Cydonia 22B v1.1
Cydonia · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
LL
Openbuddy Llama3.3 70b v24.1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Rombo LLM V3.1 QWQ 32b
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
MI
General-Stories-Mistral-7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
AS
L3.1 MS Astoria 70b v2
Astoria · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Mistral-22B-v0.2
Mistral · bartowski
Params22.2B
Context64K
Q4_K_M13.3 GB
LL
Llama 3.1 8B UltraLong 1M Instruct
Llama · bartowski
Params8B
Context1048K
Q4_K_M4.9 GB
HU
HuatuoGPT O1 72B
Huatuogpt · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
RE
Reka Flash 3.1
Reka · bartowski
Params20.9B
Context96K
Q4_K_M13.6 GB
AQ
Aquif 3.5 8B Think
Aquif · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
OP
OpenThinker3 7B
Openthinker · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
FA
FairyR1 32B
Fairyr · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
MI
cerebras/MiniMax-M2-REAP-172B-A10B
Minimax · bartowski
Params173B
Context192K
Q4_K_M104.6 GB
LL
Llama 3.1 Tulu 3 405B
Llama · bartowski
Params406B
Context128K
Q4_K_M243.1 GB
MA
Mawdistical Mawdistic NightLife 24b
Mawdistic · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
AD
I Added Glitter
Added · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
IN
JanusCoder 8B
InternLM · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
TI
TildeOpen 30b
Tildeopen · bartowski
Params30.7B
Context64K
Q4_K_M18.5 GB
LL
openchat-3.6-8b-20240522
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB