GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Uncensored-Frank-Llama-3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SE
SEMIKONG 70B
Semikong · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
TR
Trinity
Trinity · bartowski
Params399B
Context256K
Q4_K_M241.8 GB
ReasoningTool use
NE
OpenMath Nemotron 1.5B
Nemotron · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning
LL
Llama-3-8B-LexiFun-Uncensored-V1
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
SU
G2 9B Sugarquill v0
Sugarquill · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
FO
ReadyArt Forgotten Safeword 24B 3.6
Forgotten · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
AY
aya-23-35B
Aya · bartowski
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
AP
Apollo V0.1 4B Thinking
Apollo · bartowski
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
IG
L3.3 Ignition v0.1 70B
Ignition · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
TR
Triangulum 10B
Triangulum · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
Reasoning
FA
FairyR1 14B Preview
Fairyr · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
LL
EVA LLaMA 3.33 70B v0.1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
LL
Llama3.1 70B ShiningValiant2
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
CU
Art 0 8B
Customthinker · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
LL
ArliAI-Llama-3-8B-Formax-v1.0
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
KI
moonshotai Kimi K2 Instruct 0905
Kimi · bartowski
Params1030B
Context256K
Q4_K_M624.0 GB
Tool use
LL
Llama-3-8B-LexiFun-Uncensored-V1
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
NE
Openbuddy Nemotron 70b V23.2Q 131k
Nemotron · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GR
granite 34b code instruct
Granite · bartowski
Params33.7B
Context8K
Q4_K_M21.4 GB
CodingTool use
LL
Llama Chat Summary 3.2 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
LlamaThink 8B Instruct
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
BA
Babel 9B Chat
Babel · bartowski
Params9.01B
Context128K
Q4_K_M5.5 GB
Tool use
LL
OpenBioLLM-Llama3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PA
Palmyra Fin 70B 32K
Palmyra · bartowski
Params70.6B
Context32K
Q4_K_M42.5 GB
GGUF
QW
MS 2501 DPE QwQify v0.1 24B
Qwen · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
ST
dolphincoder-starcoder2-15b
StarCoder · bartowski
Params16B
Context16K
Q4_K_M9.9 GB
CodingTool use
AC
AceInstruct 72B
Aceinstruct · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Coding
SP
Spark X2.6 1.7B
Spark · bartowski
Params1.71B
Context1024K
Q4_K_M1.1 GB
ReasoningTool use
WA
wavecoder-ultra-1.1-6.7b
Wavecoder · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding

Keep browsing