GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Einstein-v6.1-Llama3-8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
NA
NaturalLM 7B Instruct
Naturallm · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
OR
Ornith 1.0 397B
Ornith · bartowski
Params396B
Context256K
Q4_K_M241.8 GB
ReasoningTool useVision
VI
Violet Twilight v0.1
Violet · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen2.5 72B
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Roleplay
BE
Beck 0.6B
Beck · bartowski
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
GP
GPT4chan 24B
Gpt · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
GL
GLM Steam 106B A12B v1
GLM · bartowski
Params110B
Context128K
Q4_K_M73.5 GB
ReasoningTool use
AL
G2 9B Aletheia v1
Aletheia · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
smirki UIGEN T1.1 Qwen 14B
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingReasoningTool use
QW
Rombos Coder V2.5 Qwen 7b
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
MA
Magnum v3 27b Kto
Magnum · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
LO
M3.2 24B Loki V1.3
Loki · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
GL
GLM 4.5 Iceblink 106B A12B
GLM · bartowski
Params110B
Context128K
Q4_K_M73.5 GB
ReasoningTool use
AS
Assistant_Pepe_70B
Assistant · bartowski
Params70.6B
Context128K
Q4_K_M44.0 GB
GGUF
TH
TheBeagle V2Beta 32B MGS
Thebeagle · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
UW
UwU 7B Instruct
Uwu · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
LL
Meta-Llama-3-8B-Instruct
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NE
OpenMath Nemotron 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
LL
llama-3-70B-Instruct-abliterated
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
OL
AMD OLMo 1B SFT
OLMo · bartowski
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
LI
Lightning 1.7B
Lightning · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
Tool use
HA
Hathor Fractionate L3 8B v.05
Hathor · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MU
G4 26B A4B Musica v1
Musica · bartowski
Params25.2B
Context256K
Q4_K_M17.0 GB
ReasoningRoleplayTool use
LL
Llama-3-11.5B-Instruct-Coder-v2
Llama · bartowski
Params11.5B
Context8K
Q4_K_M7.0 GB
Coding
LL
CodeLlama-7B-KStack-clean
Llama · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama3.1 8B Enigma
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Coding
LF
LFM2 1.2B Tool
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
NE
Nex N2 Pro
Nex · bartowski
Params396B
Context256K
Q4_K_M241.8 GB
ReasoningTool useVision
CY
Cydonia 24B v3.1
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF

Keep browsing