GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
NeuralSirKrishna 7b
Neuralkrishna · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BL
.\BlackSheep
Blacksheep · bartowski
Params3.82B
Context8K
Q4_K_M2.3 GB
GGUF
AP
rootxhacker Apollo v3 32B
Apollo · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
LL
Hercules 6.1 Llama 3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NE
Buzz-8b-Large-v0.5
Neural · bartowski
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
Smaug-Llama-3-70B-Instruct-32K
Llama · bartowski
Params70.6B
Context32K
Q4_K_M42.5 GB
GGUF
CE
L3-8B-Celeste-v1
Celeste · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HA
Hathor_Respawn-L3-8B-v0.8
Hathor · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama-3-sqlcoder-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
UN
UNA-ThePitbull-21.4-v1
Una · bartowski
Params21.4B
Context32K
Q4_K_M12.9 GB
GGUF
HA
Hathor_Unstable-L3-8B-v0.3
Hathor · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Stroganoff 3.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DR
Dracarys2 72B Instruct
Dracarys · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
MA
Excalibur 7b
Magic · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SM
Smegmma-Deluxe-9B-v1
Smegmma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Tess-v2.5.2-Qwen2-72B
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M50.7 GB
GGUF
DI
.\DigitalSoul
Digitalsoul · bartowski
Params4.62B
Context128K
Q4_K_M2.9 GB
Tool use
MI
Einstein v5 v0.2 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LL
LocalAI-Llama3-8b-Function-Call-v0.2
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Cat-Llama-3-70B-instruct
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LA
labradorite 13b
Labradorite · bartowski
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama-3-Hercules-5.1-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IN
QuixiAI Ina v11.1
Ina · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
LL
Apollo 0.4 Llama 3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
BU
buddhi-128k-chat-7b
Buddhi · bartowski
Params7.24B
Context128K
Q4_K_M4.4 GB
GGUF
MO
Moxin Chat
Moxin · bartowski
Params8.11B
Context32K
Q4_K_M4.9 GB
GGUF
LL
llama-3-8B-function-calling
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
TW
TwinLlama 3.1 8B trl
Twinllama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Apollo 2.0 Llama 3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
MindLink 72B 0801
Mindlink · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use

Keep browsing