GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Nous Hermes 2 Mixtral 8x7B SFT Wikihow
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
EX
models--automerger--Experiment27pasticheShadowm7exp-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
zephyr 7b beta Mistral 7B Instruct v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
BASH Coder Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
NE
models--automerger--Experiment28Neuralsirkrishna-7B
Neuralsirkrishna · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-v0.9
Llama · MaziyarPanahi
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-npojgos
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
EX
models--automerger--Experiment26Pastiche-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-dafvhck
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-rfdxiqs
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
CA
Calme 7B Instruct v0.1.1
Calme · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
SA
models--mergekit-community--mergekit-slerp-ksadkxl
Saul · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BE
34b beta
Beta · MaziyarPanahi
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
CH
Chocolatine 3B Instruct DPO Revised
Chocolatine · MaziyarPanahi
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
MA
NeuralMarcoro14 7B
Marcoro · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
models--automerger--T3qm7Neuralsynthesis-7B
Neuralsynthesis · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
Calme 7B Instruct v0.2
Calme · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
Calme 7B Instruct v0.5
Calme · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
models--automerger--Experiment27Neuralsirkrishna-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
models--automerger--Inex12Strangemerges_32-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
models--mergekit-community--mergekit-slerp-ueqsixf
Saul · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
models--mergekit-community--mergekit-slerp-idbupbn
Llama · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
models--automerger--MergerixInex12-7B
Mergerix · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
models--HuggingFaceH4--zephyr-orpo-141b-A35b-v0.1
Zephyr · MaziyarPanahi
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
LL
Models Huihui Ai Llama 3.2 3B Instruct Abliterated
Llama · MaziyarPanahi
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
WI
models--mergekit-community--mergekit-slerp-aazqqhn
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
BE
NeuralBeagle14 7B
Beagle · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-tejngyg
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
models--zhengr--MixTAO-7Bx2-MoE-v8.1
Mixtao · MaziyarPanahi
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
CO
models--mergekit-community--mergekit-slerp-fecxcxs
Code · MaziyarPanahi
Params22.7B
Context16K
Q4_K_M13.6 GB
Coding

Keep browsing