GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
MI
Nous Hermes 2 Mixtral 8x7B SFT Wikihow
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
EX
models--automerger--Experiment27pasticheShadowm7exp-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
zephyr 7b beta Mistral 7B Instruct v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
BASH Coder Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
models--automerger--Experiment28Neuralsirkrishna-7B
Neuralsirkrishna · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-v0.9
Llama · MaziyarPanahi
Params8B
Context8K
Q4_K_M4.9 GB
MI
models--mergekit-community--mergekit-slerp-npojgos
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--Experiment26Pastiche-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-dafvhck
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-rfdxiqs
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
Calme 7B Instruct v0.1.1
Calme · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
models--mergekit-community--mergekit-slerp-ksadkxl
Saul · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
BE
34b beta
Beta · MaziyarPanahi
Params34.4B
Context195K
Q4_K_M20.7 GB
CH
Chocolatine 3B Instruct DPO Revised
Chocolatine · MaziyarPanahi
Params3.82B
Context4K
Q4_K_M2.4 GB
MA
NeuralMarcoro14 7B
Marcoro · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
models--automerger--T3qm7Neuralsynthesis-7B
Neuralsynthesis · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
Calme 7B Instruct v0.2
Calme · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
Calme 7B Instruct v0.5
Calme · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--Experiment27Neuralsirkrishna-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
models--automerger--Inex12Strangemerges_32-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
models--mergekit-community--mergekit-slerp-ueqsixf
Saul · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--mergekit-community--mergekit-slerp-idbupbn
Llama · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
models--automerger--MergerixInex12-7B
Mergerix · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
models--HuggingFaceH4--zephyr-orpo-141b-A35b-v0.1
Zephyr · MaziyarPanahi
Params141B
Context64K
Q4_K_M85.6 GB
LL
Models Huihui Ai Llama 3.2 3B Instruct Abliterated
Llama · MaziyarPanahi
Params3.61B
Context128K
Q4_K_M2.2 GB
WI
models--mergekit-community--mergekit-slerp-aazqqhn
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
BE
NeuralBeagle14 7B
Beagle · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-tejngyg
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--zhengr--MixTAO-7Bx2-MoE-v8.1
Mixtao · MaziyarPanahi
Params12.9B
Context32K
Q4_K_M7.8 GB
CO
models--mergekit-community--mergekit-slerp-fecxcxs
Code · MaziyarPanahi
Params22.7B
Context16K
Q4_K_M13.6 GB