GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
LMCocktail Mistral 7B v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
models--mergekit-community--mergekit-slerp-dclolyo
Gemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
MI
OpenHermes 7B Symbolic Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
neural chat 7b v3 2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Dans AdventurousWinds Mk2 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WI
models--mergekit-community--mergekit-slerp-hfjular
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
SH
models--automerger--ShadowNeuralsirkrishna-7B
Shadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
models--automerger--M7Alloyingotneoy-7B
Alloyingotneoy · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
loyal piano m7 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
phi 2 super
Phi · MaziyarPanahi
Params2.78B
Context2K
Q4_K_M1.7 GB
Coding
ST
models--automerger--Strangemerges_30Pastiche-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
sqlcoder 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
QW
Models Qwen Qwen2.5 Coder 14B Instruct
Qwen · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
CodingTool use
LL
Llama 3.1 8B Instruct Fei v1 Uncensored
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
LL
models--mergekit-community--mergekit-passthrough-yqhuxcv
Llama · MaziyarPanahi
Params44.9B
Context8K
Q4_K_M27.1 GB
GGUF
MI
Dans 07YahooAnswers 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Models MiniLLM MiniPLM Qwen 500M
Qwen · MaziyarPanahi
Params464M
Context32K
Smallest0.3 GB
GGUF
MI
zephyr 7b alpha sharded Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Noromaid 7b v0.1.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Synatra 7B v0.3 dpo Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LI
light 3B
Light · MaziyarPanahi
Params3.4B
Context32K
Smallest2.4 GB
Tool use
MI
blossom v4 mistral 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
openchat 3.5 0106
Mistral · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
Ferret 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
notus 7b v1
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-rzooeoj
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Relay v0.1 Mistral Nemo 2407
Mistral · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
GGUF
MI
MetaMath OpenHermes 2.5 neural chat v3 3 Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
notus 7b v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral 7b v0.1 layla v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing