GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Hercules 1.0 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MA
matricide 12B Unslop Unleashed v2
Matricide · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
LL
Llama 3 8B Instruct v0.8
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
neural chat 7b v3 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
go bruins v2.1.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-qzxjuip
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
IN
models--automerger--Inex12Mergerix-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
models--mergekit-community--mergekit-slerp-eundxnq
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Models Mlabonne Gemma 3 1b It Abliterated
Gemma · MaziyarPanahi
Params1B
Context32K
Smallest0.8 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.1 Uncensored
Llama · MaziyarPanahi
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
calme 2.5 qwen2 7b
Qwen · MaziyarPanahi
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
CO
Models CyberNative AI Colibri_8b_v0.1
Colibri · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
ME
models--automerger--ShadowMeliodas-7B
Meliodas · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
smol 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Synatra 7B v0.3 RP Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
NE
models--automerger--Experiment26Neuralsirkrishna-7B
Neuralsirkrishna · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
QwenSlerp7 14B
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
MI
models--mergekit-community--mergekit-slerp-lnhotro
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
v1olet marcoroni go bruins merge 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B claude instruct Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
models--mergekit-community--mergekit-slerp-fcxoywi
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
rfp instruct model Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
speechless mistral six in one 7b orth 1.0 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
ALLaM 7B Instruct Preview
Allam · MaziyarPanahi
Params7B
Context4K
Smallest4.9 GB
Reasoning
MI
japanese stablelm base gamma 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Yi 9B 200K
Yi · MaziyarPanahi
Params8.83B
Context256K
Q4_K_M5.3 GB
GGUF
NE
NeuralPipe 7B slerp
Neuralpipe · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Venomia 1.1 m7 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
samantha mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
piano medley 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing