GGUF models by maddes8cht

88 GGUF models quantized by maddes8cht on Hugging Face. Sizes run from 1.59B to 41.9B parameters. The longest trained context is 64K tokens.

Most downloadedNewestLargestLongest contextSmallest
MA
IS-LM-3B
Maddes · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
OP
openbuddy-stablelm-3b-v13
Openbuddy · maddes8cht
Params2.81B
Context4K
Q4_K_M1.7 GB
GGUF
AK
Akins-3B
Akins · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
MP
mpt-7b-chat
Mpt · maddes8cht
Params6.86B
Context2K
Q4_K_M4.4 GB
GGUF
MA
Marx-3B-V3
Marx · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
AS
Astrid-3B
Astrid · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
ST
StableMed-3b
Stablemed · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.44B
Context2K
Q4_K_M5.2 GB
GGUF
AC
acrastt Griffin 3B
Acrastt · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
MP
mpt-7b-8k
Mpt · maddes8cht
Params6.86B
Context8K
Q4_K_M4.4 GB
GGUF
MP
mpt-30b-v2
Mpt · maddes8cht
Params30.3B
Context8K
Q4_K_M19.3 GB
GGUF
LI
lightonai alfred 40b 1023
Lightonai · maddes8cht
Params41.8B
Context2K
Q4_K_M25.5 GB
GGUF
FA
OpenLLM France Claire 7B 0.1
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
MP
mpt-30b-instruct
Mpt · maddes8cht
Params30.3B
Context8K
Q4_K_M19.3 GB
GGUF
MP
mpt-7b-8k-chat
Mpt · maddes8cht
Params6.86B
Context8K
Q4_K_M4.4 GB
GGUF
MP
mpt-7b-wizardlm
Mpt · maddes8cht
Params6.86B
Context2K
Q4_K_M4.4 GB
GGUF
MP
mpt-30b-v4
Mpt · maddes8cht
Params30.3B
Context8K
Q4_K_M19.3 GB
GGUF
LL
VMware open llama 7b open instruct
Llama · maddes8cht
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.26B
Context2K
Smallest4.2 GB
GGUF
AC
acrastt Bean 3B
Acrastt · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
MP
mpt-30b
Mpt · maddes8cht
Params30.3B
Context8K
Q4_K_M19.3 GB
GGUF
MP
mpt-30b-chat
Mpt · maddes8cht
Params30.3B
Context8K
Q4_K_M19.3 GB
GGUF
ST
slimorca-stablelm-3b-4e1t
Stablelm · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
LL
VMware open llama 7b v2 open instruct
Llama · maddes8cht
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MP
mpt-7b-8k-instruct
Mpt · maddes8cht
Params6.86B
Context8K
Q4_K_M4.4 GB
GGUF

Keep browsing