GGUF models by maddes8cht

88 GGUF models quantized by maddes8cht on Hugging Face. Sizes run from 1.59B to 41.9B parameters. The longest trained context is 64K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
StableLM-3b-EssayWriter
Stablelm · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
HA
harborwater wizard orca 3b
Harborwater · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
LL
georgesung open llama 7b qlora uncensored
Llama · maddes8cht
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
RE
Refact
Refact · maddes8cht
Params1.59B
Context4K
Q4_K_M1.0 GB
Coding
DI
Dimensity-3B
Dimensity · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
LL
syzymon long llama 3b v1 1
Llama · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
Coding
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
ST
stablelm-3b-4e1t
Stablelm · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
Coding
PE
persimmon-8b-chat
Persimmon · maddes8cht
Params9.4B
Context16K
Q4_K_M6.1 GB
GGUF
GO
gorilla-mpt-7b-hf-v0
Gorilla · maddes8cht
Params6.86B
Context2K
Q4_K_M4.4 GB
GGUF
MO
mosaicml mpt 7b
Mosaicml · maddes8cht
Params6.86B
Context2K
Q4_K_M4.4 GB
GGUF
MP
mpt-7b-storywriter
Mpt · maddes8cht
Params6.86B
Context64K
Q4_K_M4.4 GB
GGUF
AD
adept persimmon 8b base
Adept · maddes8cht
Params9.4B
Context16K
Q4_K_M6.1 GB
GGUF
AI
airoboros-3b-3p11
Airoboros · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params41.9B
Context2K
Smallest23.9 GB
GGUF
JA
japanese-stablelm-3b-4e1t-instruct
Japanese · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
AC
acrastt OmegLLaMA 3B
Acrastt · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
KN
KnutJaegersberg openllama 3b EvolInstruct lora merged
Knutjaegersberg · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params41.8B
Context2K
Q4_K_M25.5 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
MP
mpt-30b-v3
Mpt · maddes8cht
Params30.3B
Context8K
Q4_K_M19.3 GB
GGUF
MP
mpt-7b-instruct
Mpt · maddes8cht
Params6.86B
Context2K
Q4_K_M4.4 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.26B
Context2K
Q4_K_M5.0 GB
GGUF
ST
rocket-3B
Stablelm · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
LL
syzymon long llama 3b
Llama · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF

Keep browsing