GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
WI
models--mergekit-community--mergekit-slerp-zevysvp
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
RE
reader lm 1.5b
Reader · MaziyarPanahi
Params1.54B
Context250K
Q4_K_M1.0 GB
GGUF
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-v0.2
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
dolphin 2.0 mistral 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
models--AdaptLLM--medicine-chat
Medicine · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GR
Models Ibm Granite Granite 3.0 8b Instruct
Granite · MaziyarPanahi
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
LL
models--MaziyarPanahi--Llama-3-70B-Instruct-v0.1
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MI
Seraph 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
speechless code mistral 7b v1.0 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
LL
Models Bllossom Llama 3.2 Korean Bllossom 3B
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MI
koOpenChat sft Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WI
models--mergekit-community--mergekit-slerp-rnzykzl
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
WI
models--mergekit-community--mergekit-slerp-zvrdvfy
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
loyal piano m7 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SU
yi super 9B
Super · MaziyarPanahi
Params8.83B
Context8K
Q4_K_M5.3 GB
Tool use
MI
distilabeled OpenHermes 2.5 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
mistral ft optimized 1218 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.1 Open Platypus Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
models--automerger--Experiment28Inex12-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
models--mergekit-community--mergekit-slerp-ieauevl
Codeninja · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-euzaldk
Mistral · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
neural chat 7b v3 3 Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--dolphin-mistral-instruct-7b
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
blossom v3 mistral 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
GreenNode mini 7B multilingual v1olet Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Kant Test 0.1 Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Models Orion Zhen Qwen2.5 7B Instruct Uncensored
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
GGUF
MI
blossom v3 1 mistral 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
models--automerger--Strangemerges_32Experiment28-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.1 sharded Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing