GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Nebula v2 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DI
Models Mantis2024 Dirty Shirley Writer v01 Uncensored
Dirty · MaziyarPanahi
Params9.24B
Context8K
Smallest6.5 GB
GGUF
MI
go bruins v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenHermes 2.5 neural chat 7b v3 1 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
japanese stablelm instruct gamma 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
dolphin 2.6 mistral 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
QW
Models Huihui Ai Qwen2.5 Coder 14B Instruct Abliterated
Qwen · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
CodingTool use
NU
NuExtract 1.5 Smol
Nuextract · MaziyarPanahi
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
YA
models--automerger--Experiment26Yam-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 2 7b chat hf function calling v3
Llama · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
Tool use
LL
CodeLlama 34b Instruct hf
Llama · MaziyarPanahi
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
EX
models--automerger--ShadowExperiment24-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
calme-3.1-llamaloi-3b
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
EX
models--automerger--Experiment24Inex12-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Synatra V0.1 7B Instruct Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
openbuddy mistral 7b v13.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenZephyrChat Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
agiin 13.6B v0.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-model_stock-qykbest
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
models--automerger--Inex12Experiment26-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
sqlcoder 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
EX
models--automerger--Experiment26Shadow-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
models--allenai--tulu-2-dpo-13b
Llama · MaziyarPanahi
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
MI
Models Mistralai Ministral 8B Instruct 2410
Mistral · MaziyarPanahi
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
MI
Mistral 7B KNUT v0.3 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-v0.1
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Tess XS v1 3 yarn 128K Mistral 7B Instruct v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
models--automerger--CalmexperimentMeliodas-7B
Calmexperiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
models--automerger--T3qm7xpExperiment26-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing