GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
NE
NeuralSirKrishna 7b
Neuralkrishna · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
BL
.\BlackSheep
Blacksheep · bartowski
Params3.82B
Context8K
Q4_K_M2.3 GB
AP
rootxhacker Apollo v3 32B
Apollo · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
LL
Hercules 6.1 Llama 3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
Buzz-8b-Large-v0.5
Neural · bartowski
Params8.03B
Context1024K
Q4_K_M4.9 GB
LL
Smaug-Llama-3-70B-Instruct-32K
Llama · bartowski
Params70.6B
Context32K
Q4_K_M42.5 GB
CE
L3-8B-Celeste-v1
Celeste · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
HA
Hathor_Respawn-L3-8B-v0.8
Hathor · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama-3-sqlcoder-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
UN
UNA-ThePitbull-21.4-v1
Una · bartowski
Params21.4B
Context32K
Q4_K_M12.9 GB
HA
Hathor_Unstable-L3-8B-v0.3
Hathor · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B Stroganoff 3.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
DR
Dracarys2 72B Instruct
Dracarys · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
MA
Excalibur 7b
Magic · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
SM
Smegmma-Deluxe-9B-v1
Smegmma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Tess-v2.5.2-Qwen2-72B
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M50.7 GB
DI
.\DigitalSoul
Digitalsoul · bartowski
Params4.62B
Context128K
Q4_K_M2.9 GB
MI
Einstein v5 v0.2 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
LocalAI-Llama3-8b-Function-Call-v0.2
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Cat-Llama-3-70B-instruct
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
LA
labradorite 13b
Labradorite · bartowski
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama-3-Hercules-5.1-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
IN
QuixiAI Ina v11.1
Ina · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Apollo 0.4 Llama 3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
BU
buddhi-128k-chat-7b
Buddhi · bartowski
Params7.24B
Context128K
Q4_K_M4.4 GB
MO
Moxin Chat
Moxin · bartowski
Params8.11B
Context32K
Q4_K_M4.9 GB
LL
llama-3-8B-function-calling
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
TW
TwinLlama 3.1 8B trl
Twinllama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Apollo 2.0 Llama 3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
MindLink 72B 0801
Mindlink · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB