GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
models--automerger--PasticheNeuralsirkrishna-7B
Neuralsirkrishna · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
models--automerger--Ognoexperiment27multi_verse_modelCalmexperiment-7B
Calmexperiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Hercules 2.0 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
SA
models--mergekit-community--mergekit-slerp-gpprpds
Saul · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
models--automerger--MeliodasPercival_01-7B
Meliodas · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QS
models--automerger--T3qStrangemerges_32-7B
Qstrangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · MaziyarPanahi
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
NE
models--automerger--NeuralsirkrishnaT3qm7x-7B
Neuralsirkrishna · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
models--mergekit-community--mergekit-ties-kkhkcqw
Llama · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OP
openchat 3.5 1210 Seraph Slerp
Openchat · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
Models Sail Sailor2 20B Chat
Sailor · MaziyarPanahi
Params19.2B
Context32K
Q4_K_M11.6 GB
GGUF
CA
models--automerger--NeuralsynthesisCalmexperiment-7B
Calmexperiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-zonivkr
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
models--mergekit-community--mergekit-slerp-xqswkgn
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.1 16k Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
models--automerger--Strangemerges_32Shadow-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MU
models--automerger--Multi_verse_modelInex12-7B
Multi · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen1.5 8x7b v0.1
Qwen · MaziyarPanahi
Params38B
Context32K
Q4_K_M23.6 GB
GGUF
MI
Mistral 7B Instruct Aya 101
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
zephyr 7b gemma sft v0.1
Gemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.1 GB
GGUF
CA
models--MaziyarPanahi--Calme-4x7B-MoE-v0.2
Calme · MaziyarPanahi
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
IN
models--automerger--CalmeInex12-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
MetaMath Cybertron Starling
Metamath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
models--mergekit-community--mergekit-slerp-zzizhry
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
models--automerger--MeliodasT3qm7-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WI
models--mergekit-community--mergekit-slerp-nfoezyj
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
ST
models--automerger--Strangemerges_32Yam-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
models--automerger--Ognoexperiment27multi_verse_modelNeuralsynthesis-7B
Neuralsynthesis · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WH
WhiteRabbitNeo 13B v1
Whiterabbitneo · MaziyarPanahi
Params13B
Context16K
Q4_K_M7.9 GB
Coding
MI
Mistral 7B Instruct KhanAcademy v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing