GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
MI
LMCocktail Mistral 7B v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
models--mergekit-community--mergekit-slerp-dclolyo
Gemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
MI
OpenHermes 7B Symbolic Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
neural chat 7b v3 2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Dans AdventurousWinds Mk2 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
WI
models--mergekit-community--mergekit-slerp-hfjular
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SH
models--automerger--ShadowNeuralsirkrishna-7B
Shadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
models--automerger--M7Alloyingotneoy-7B
Alloyingotneoy · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
loyal piano m7 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
phi 2 super
Phi · MaziyarPanahi
Params2.78B
Context2K
Q4_K_M1.7 GB
ST
models--automerger--Strangemerges_30Pastiche-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
sqlcoder 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Models Qwen Qwen2.5 Coder 14B Instruct
Qwen · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
LL
Llama 3.1 8B Instruct Fei v1 Uncensored
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
models--mergekit-community--mergekit-passthrough-yqhuxcv
Llama · MaziyarPanahi
Params44.9B
Context8K
Q4_K_M27.1 GB
MI
Dans 07YahooAnswers 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Models MiniLLM MiniPLM Qwen 500M
Qwen · MaziyarPanahi
Params464M
Context32K
Smallest0.3 GB
MI
zephyr 7b alpha sharded Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Noromaid 7b v0.1.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Synatra 7B v0.3 dpo Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LI
light 3B
Light · MaziyarPanahi
Params3.4B
Context32K
Smallest2.4 GB
MI
blossom v4 mistral 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
openchat 3.5 0106
Mistral · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
Ferret 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
notus 7b v1
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-rzooeoj
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Relay v0.1 Mistral Nemo 2407
Mistral · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
MI
MetaMath OpenHermes 2.5 neural chat v3 3 Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
notus 7b v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral 7b v0.1 layla v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB