GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
PL
Plesio 70B
Plesio · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
OP
Openchat 3.5 0106
Openchat · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
calme-2.3-rys-78b
Calme · bartowski
Params78B
Context32K
Q4_K_M50.7 GB
GGUF
LL
Ichigo llama3.1 s instruct v0.4
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
Steiner 32b Preview
Steiner · bartowski
Params32.8B
Context32K
Q4_K_M19.8 GB
Tool use
AR
Arcee SuperNova v1
Arcee · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MI
Tiamat 24B Magistral
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningRoleplayTool use
QW
Qwen2.5 72B
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Roleplay
LL
Llama-3-SauerkrautLM-8b-Instruct
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
JA
pszemraj jamba 900M v0.13 KIx2
Jamba · bartowski
Params888M
Context16K
Q4_K_M0.5 GB
GGUF
PR
Precog 123B v1
Precog · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
PH
Phi 3 mini 4k instruct v0.3
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
LL
Hermes-2-Theta-Llama-3-8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
TR
Trinity Large Base
Trinity · bartowski
Params399B
Context256K
Q4_K_M241.6 GB
GGUF
CO
codegemma-1.1-7b-it
Codegemma · bartowski
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
MO
Monstral 123B v2
Monstral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
Tool use
MI
Tess 3 Mistral Large 2 123B
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
QW
Qwen2 Math 72B Instruct
Qwen · bartowski
Params72.7B
Context4K
Q4_K_M47.4 GB
GGUF
AR
katanemo Arch Function Chat 7B
Arch · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
AL
AlchemistCoder-L-7B
Alchemistcoder · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Nomad LLaMa 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llm_Calculator_V0.1
Llm · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
AQ
Aquif 3.5 Max 1205
Aquif · bartowski
Params42.4B
Context256K
Q4_K_M25.8 GB
ReasoningTool use
NE
Nemo 12b Humanize KTO v0.1
Nemo · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
HE
HelpingAI-9B
Helpingai · bartowski
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
MI
cerebras/MiniMax-M2-REAP-162B-A10B
Minimax · bartowski
Params162B
Context192K
Q4_K_M98.2 GB
ReasoningTool use
GL
cerebras/GLM-4.7-REAP-218B-A32B
GLM · bartowski
Params218B
Context198K
Q4_K_M133.8 GB
ReasoningTool use
CR
Creative Writer 32b Preview
Creative · bartowski
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
R1
R1 1776
bartowski
Params671B
Context160K
Q4_K_M404.4 GB
ReasoningTool use
AR
katanemo Arch Function Chat 1.5B
Arch · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use

Keep browsing