GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · MaziyarPanahi
Params1.1B
Context2K
Q4_K_M0.7 GB
MI
mamba gpt 7b v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--Experiment29Experiment24-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
jackalope 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 11B OmniMix9 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
models--mergekit-community--mergekit-slerp-jovftfd
Saul · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MetaMath Cybertron Starling Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
models--automerger--T3qm7xPercival_01-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SM
SmolLM2 360M Instruct
SmolLM · MaziyarPanahi
Params362M
Context8K
Q4_K_M0.3 GB
MI
models--automerger--Strangemerges_32T3q-7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral 7b sft beta
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
models--automerger--AlloyingotneoyInex12-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--Experiment24Experiment28-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SH
models--automerger--T3qm7Shadow-7B
Shadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
neural chat 7b v3 2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
shisa 7b v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
models--automerger--T3qm7xpT3q-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenHermes 2.5 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Tess XS v1 3 yarn 128K Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
testllm c2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
MetaMath Tulpar 7b v2 Slerp
Metamath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
models--automerger--Experiment24Alloyingotneoy-7B
Alloyingotneoy · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
go bruins v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
BR
go bruins v2
Bruins · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mamba gpt 7b v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
models--mergekit-community--mergekit-slerp-kxzcrwh
Saul · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B golden Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
shisa base 7b v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SH
models--automerger--ShadowStrangemerges_32-7B
Shadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB