GGUF models by maddes8cht

88 GGUF models quantized by maddes8cht on Hugging Face. Sizes run from 1.59B to 41.9B parameters. The longest trained context is 64K tokens.

Most downloadedNewestLargestLongest contextSmallest
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
AC
acrastt Puma 3B
Acrastt · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params41.8B
Context2K
Q4_K_M25.5 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
VI
vigogne-stablelm-3b-4e1t-chat
Vigogne · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
LL
openlm research open llama 13b
Llama · maddes8cht
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
harborwater open llama 3b claude 30k
Llama · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
AI
airoboros-mpt-30b-gpt4-1p4-five-epochs
Airoboros · maddes8cht
Params30.3B
Context8K
Q4_K_M19.3 GB
GGUF
LL
harborwater open llama 3b v2 wizard evol instuct v2 196k
Llama · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
ST
stablecode-instruct-alpha-3b
Stablecode · maddes8cht
Params2.77B
Context4K
Q4_K_M1.8 GB
Coding
LL
openlm research open llama 3b v2
Llama · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
Coding
LL
Karajan42 open llama preview gpt4
Llama · maddes8cht
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
Karajan42 open llama dolly
Llama · maddes8cht
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params41.8B
Context2K
Q4_K_M25.5 GB
GGUF
LL
harborwater open llama 3b everything v2
Llama · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
LL
VMware open llama 0.3T 7B instruct dolly hhrlhf
Llama · maddes8cht
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params41.8B
Context2K
Q4_K_M25.5 GB
GGUF
NO
Nous-Capybara-3B-V1.9
Nous · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params41.8B
Context2K
Q4_K_M25.5 GB
GGUF
ST
StableHermes-3b
Stablehermes · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
Tool use
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
LL
syzymon long llama 3b instruct
Llama · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
Coding
JA
japanese-stablelm-3b-4e1t-base
Japanese · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
LL
harborwater open llama 3b everythingLM 2048
Llama · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params41.8B
Context2K
Q4_K_M25.5 GB
GGUF
BL
bling-stable-lm-3b-4e1t-v0
Bling · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
LL
openlm research open llama 7b v2
Llama · maddes8cht
Params6.74B
Context2K
Q4_K_M4.1 GB
Coding

About maddes8cht on Hugging Face

maddes8cht has published 88 GGUF models that ggufmodels.com tracks, across families such as Falcon, Llama and Mpt. The most downloaded are Falcon, acrastt Puma 3B and Falcon.

The quants maddes8cht publishes most often are Q8_0 (86), Q5_K_M (86), Q4_K_M (86) and Q4_0 (86). Their Q4_K_M files range from 1.0 to 25.5 GB. Parameter counts run from 1.59B to 41.9B, and the longest trained context window is 64K tokens.

Frequently asked questions

What GGUF models has maddes8cht published?

88 models are listed here, mainly from the Falcon, Llama and Mpt families. The most downloaded is Falcon.

Which quants does maddes8cht publish?

The most common are Q8_0 (86 models), Q5_K_M (86 models), Q4_K_M (86 models) and Q4_0 (86 models).

Keep browsing