GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
WI
models--mergekit-community--mergekit-slerp-zevysvp
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
RE
reader lm 1.5b
Reader · MaziyarPanahi
Params1.54B
Context250K
Q4_K_M1.0 GB
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-v0.2
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
dolphin 2.0 mistral 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
models--AdaptLLM--medicine-chat
Medicine · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
GR
Models Ibm Granite Granite 3.0 8b Instruct
Granite · MaziyarPanahi
Params8.17B
Context4K
Q4_K_M4.9 GB
LL
models--MaziyarPanahi--Llama-3-70B-Instruct-v0.1
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
Seraph 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
speechless code mistral 7b v1.0 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Models Bllossom Llama 3.2 Korean Bllossom 3B
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
MI
koOpenChat sft Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
WI
models--mergekit-community--mergekit-slerp-rnzykzl
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
WI
models--mergekit-community--mergekit-slerp-zvrdvfy
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
loyal piano m7 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SU
yi super 9B
Super · MaziyarPanahi
Params8.83B
Context8K
Q4_K_M5.3 GB
MI
distilabeled OpenHermes 2.5 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral ft optimized 1218 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.1 Open Platypus Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--Experiment28Inex12-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
models--mergekit-community--mergekit-slerp-ieauevl
Codeninja · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-euzaldk
Mistral · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
neural chat 7b v3 3 Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--dolphin-mistral-instruct-7b
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
blossom v3 mistral 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
GreenNode mini 7B multilingual v1olet Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Kant Test 0.1 Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Models Orion Zhen Qwen2.5 7B Instruct Uncensored
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
MI
blossom v3 1 mistral 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
models--automerger--Strangemerges_32Experiment28-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.1 sharded Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB