GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
PL
Plesio 70B
Plesio · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
OP
Openchat 3.5 0106
Openchat · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
calme-2.3-rys-78b
Calme · bartowski
Params78B
Context32K
Q4_K_M50.7 GB
LL
Ichigo llama3.1 s instruct v0.4
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
Steiner 32b Preview
Steiner · bartowski
Params32.8B
Context32K
Q4_K_M19.8 GB
AR
Arcee SuperNova v1
Arcee · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Tiamat 24B Magistral
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen2.5 72B
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
LL
Llama-3-SauerkrautLM-8b-Instruct
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
JA
pszemraj jamba 900M v0.13 KIx2
Jamba · bartowski
Params888M
Context16K
Q4_K_M0.5 GB
PR
Precog 123B v1
Precog · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
PH
Phi 3 mini 4k instruct v0.3
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
LL
Hermes-2-Theta-Llama-3-8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
TR
Trinity Large Base
Trinity · bartowski
Params399B
Context256K
Q4_K_M241.6 GB
CO
codegemma-1.1-7b-it
Codegemma · bartowski
Params8.54B
Context8K
Q4_K_M5.3 GB
MO
Monstral 123B v2
Monstral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
MI
Tess 3 Mistral Large 2 123B
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
QW
Qwen2 Math 72B Instruct
Qwen · bartowski
Params72.7B
Context4K
Q4_K_M47.4 GB
AR
katanemo Arch Function Chat 7B
Arch · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
AL
AlchemistCoder-L-7B
Alchemistcoder · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Nomad LLaMa 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llm_Calculator_V0.1
Llm · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
AQ
Aquif 3.5 Max 1205
Aquif · bartowski
Params42.4B
Context256K
Q4_K_M25.8 GB
NE
Nemo 12b Humanize KTO v0.1
Nemo · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
HE
HelpingAI-9B
Helpingai · bartowski
Params8.83B
Context4K
Q4_K_M5.3 GB
MI
cerebras/MiniMax-M2-REAP-162B-A10B
Minimax · bartowski
Params162B
Context192K
Q4_K_M98.2 GB
GL
cerebras/GLM-4.7-REAP-218B-A32B
GLM · bartowski
Params218B
Context198K
Q4_K_M133.8 GB
CR
Creative Writer 32b Preview
Creative · bartowski
Params32.3B
Context128K
Q4_K_M19.8 GB
R1
R1 1776
bartowski
Params671B
Context160K
Q4_K_M404.4 GB
AR
katanemo Arch Function Chat 1.5B
Arch · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB