GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
TE
Teutonic I Reliquary RL
Teutonic · bartowski
Params8.95B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
KI
moonshotai Kimi K2 Thinking
Kimi · bartowski
Params1030B
Context256K
Q4_K_M624.0 GB
Reasoning
LL
Infinity Instruct 7M Gen Llama3_1 8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
GL
zai org GLM 4.6
GLM · bartowski
Params357B
Context198K
Q4_K_M217.7 GB
GGUF
AC
AceInstruct 7B
Aceinstruct · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Coding
BI
Bielik 11B v2.2 Instruct
Bielik · bartowski
Params11.2B
Context32K
Q4_K_M6.7 GB
GGUF
KI
Kimi K2.5
Kimi · bartowski
Params1030B
Context256K
Q4_K_M580.4 GB
Vision
QW
Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
CO
CodeQwen1.5-7B
Codeqwen · bartowski
Params7.25B
Context64K
Q4_K_M4.7 GB
GGUF
EQ
Equinox 31B
Equinox · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
RoleplayVision
ME
Merlin Agent
Merlin · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Coding
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · bartowski
Params12.3B
Context1024K
Q4_K_M7.5 GB
GGUF
MI
Magistral Small 2506
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
MI
NousResearch DeepHermes 3 Mistral 24B Preview
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
ReasoningRoleplayTool use
LL
Cogito v1 Preview Llama 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
NU
NuExtract v1.5
Nuextract · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
SK
TheDrummer Skyfall 36B v2
Skyfall · bartowski
Params36.9B
Context32K
Q4_K_M22.4 GB
GGUF
DE
DeepSeek V2.5 1210
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
GGUF
GR
Grug 9b
Grug · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
CodingReasoningTool use
AU
Aura 4B
Aura · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
RoleplayTool use
QW
Qwen2-7B-Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
DA
Darwin 35B A3B Opus
Darwin · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
ReasoningTool useVision
QW
Qwen2.5 72b RP Ink
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Roleplay
HA
Hathor_Tahsin-L3-8B-v0.85
Hathor · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
SN
Snowpiercer 15B v1
Snowpiercer · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
GGUF
BE
Behemoth X 123B v2.1
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
SI
SILMA 9B Instruct v1.0
Silma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Qwen2.5 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
FA
Falcon3 7B Instruct Abliterated
Falcon · bartowski
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF

Keep browsing