GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
NE
models--automerger--PasticheNeuralsirkrishna-7B
Neuralsirkrishna · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
models--automerger--Ognoexperiment27multi_verse_modelCalmexperiment-7B
Calmexperiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Hercules 2.0 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
models--mergekit-community--mergekit-slerp-gpprpds
Saul · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
models--automerger--MeliodasPercival_01-7B
Meliodas · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QS
models--automerger--T3qStrangemerges_32-7B
Qstrangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SM
SmolLM 1.7B Instruct
SmolLM · MaziyarPanahi
Params1.71B
Context2K
Q4_K_M1.1 GB
NE
models--automerger--NeuralsirkrishnaT3qm7x-7B
Neuralsirkrishna · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--mergekit-community--mergekit-ties-kkhkcqw
Llama · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
OP
openchat 3.5 1210 Seraph Slerp
Openchat · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
Models Sail Sailor2 20B Chat
Sailor · MaziyarPanahi
Params19.2B
Context32K
Q4_K_M11.6 GB
CA
models--automerger--NeuralsynthesisCalmexperiment-7B
Calmexperiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-zonivkr
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-xqswkgn
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.1 16k Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
models--automerger--Strangemerges_32Shadow-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MU
models--automerger--Multi_verse_modelInex12-7B
Multi · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen1.5 8x7b v0.1
Qwen · MaziyarPanahi
Params38B
Context32K
Q4_K_M23.6 GB
MI
Mistral 7B Instruct Aya 101
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
zephyr 7b gemma sft v0.1
Gemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.1 GB
CA
models--MaziyarPanahi--Calme-4x7B-MoE-v0.2
Calme · MaziyarPanahi
Params24.2B
Context32K
Q4_K_M14.6 GB
IN
models--automerger--CalmeInex12-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
MetaMath Cybertron Starling
Metamath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
models--mergekit-community--mergekit-slerp-zzizhry
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
models--automerger--MeliodasT3qm7-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
WI
models--mergekit-community--mergekit-slerp-nfoezyj
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
models--automerger--Strangemerges_32Yam-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
models--automerger--Ognoexperiment27multi_verse_modelNeuralsynthesis-7B
Neuralsynthesis · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
WH
WhiteRabbitNeo 13B v1
Whiterabbitneo · MaziyarPanahi
Params13B
Context16K
Q4_K_M7.9 GB
MI
Mistral 7B Instruct KhanAcademy v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB