GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
MI
Nebula v2 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
DI
Models Mantis2024 Dirty Shirley Writer v01 Uncensored
Dirty · MaziyarPanahi
Params9.24B
Context8K
Smallest6.5 GB
MI
go bruins v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenHermes 2.5 neural chat 7b v3 1 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
japanese stablelm instruct gamma 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
dolphin 2.6 mistral 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Models Huihui Ai Qwen2.5 Coder 14B Instruct Abliterated
Qwen · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
NU
NuExtract 1.5 Smol
Nuextract · MaziyarPanahi
Params1.71B
Context8K
Q4_K_M1.1 GB
YA
models--automerger--Experiment26Yam-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 2 7b chat hf function calling v3
Llama · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
CodeLlama 34b Instruct hf
Llama · MaziyarPanahi
Params33.7B
Context16K
Q4_K_M20.2 GB
EX
models--automerger--ShadowExperiment24-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
calme-3.1-llamaloi-3b
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
EX
models--automerger--Experiment24Inex12-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Synatra V0.1 7B Instruct Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
openbuddy mistral 7b v13.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenZephyrChat Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
agiin 13.6B v0.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-model_stock-qykbest
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--Inex12Experiment26-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
sqlcoder 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--Experiment26Shadow-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--allenai--tulu-2-dpo-13b
Llama · MaziyarPanahi
Params13B
Context8K
Q4_K_M7.9 GB
MI
Models Mistralai Ministral 8B Instruct 2410
Mistral · MaziyarPanahi
Params8.02B
Context32K
Q4_K_M4.9 GB
MI
Mistral 7B KNUT v0.3 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-v0.1
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Tess XS v1 3 yarn 128K Mistral 7B Instruct v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
models--automerger--CalmexperimentMeliodas-7B
Calmexperiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
models--automerger--T3qm7xpExperiment26-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB