GGUF models by maddes8cht
88 GGUF models quantized by maddes8cht on Hugging Face. Sizes run from 1.59B to 41.9B parameters. The longest trained context is 64K tokens.
MA
IS-LM-3B
Maddes · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
OP
openbuddy-stablelm-3b-v13
Openbuddy · maddes8cht
Params2.81B
Context4K
Q4_K_M1.7 GB
AK
Akins-3B
Akins · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
MP
mpt-7b-chat
Mpt · maddes8cht
Params6.86B
Context2K
Q4_K_M4.4 GB
MA
Marx-3B-V3
Marx · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
AS
Astrid-3B
Astrid · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
ST
StableMed-3b
Stablemed · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
FA
Falcon
Falcon · maddes8cht
Params7.44B
Context2K
Q4_K_M5.2 GB
AC
acrastt Griffin 3B
Acrastt · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
MP
mpt-7b-8k
Mpt · maddes8cht
Params6.86B
Context8K
Q4_K_M4.4 GB
MP
mpt-30b-v2
Mpt · maddes8cht
Params30.3B
Context8K
Q4_K_M19.3 GB
LI
lightonai alfred 40b 1023
Lightonai · maddes8cht
Params41.8B
Context2K
Q4_K_M25.5 GB
FA
OpenLLM France Claire 7B 0.1
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
MP
mpt-30b-instruct
Mpt · maddes8cht
Params30.3B
Context8K
Q4_K_M19.3 GB
MP
mpt-7b-8k-chat
Mpt · maddes8cht
Params6.86B
Context8K
Q4_K_M4.4 GB
MP
mpt-7b-wizardlm
Mpt · maddes8cht
Params6.86B
Context2K
Q4_K_M4.4 GB
MP
mpt-30b-v4
Mpt · maddes8cht
Params30.3B
Context8K
Q4_K_M19.3 GB
LL
VMware open llama 7b open instruct
Llama · maddes8cht
Params6.74B
Context2K
Q4_K_M4.1 GB
FA
Falcon
Falcon · maddes8cht
Params7.26B
Context2K
Smallest4.2 GB
AC
acrastt Bean 3B
Acrastt · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
MP
mpt-30b
Mpt · maddes8cht
Params30.3B
Context8K
Q4_K_M19.3 GB
MP
mpt-30b-chat
Mpt · maddes8cht
Params30.3B
Context8K
Q4_K_M19.3 GB
ST
slimorca-stablelm-3b-4e1t
Stablelm · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
LL
VMware open llama 7b v2 open instruct
Llama · maddes8cht
Params6.74B
Context2K
Q4_K_M4.1 GB
MP
mpt-7b-8k-instruct
Mpt · maddes8cht
Params6.86B
Context8K
Q4_K_M4.4 GB