GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
MI
Hercules 1.0 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
matricide 12B Unslop Unleashed v2
Matricide · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
LL
Llama 3 8B Instruct v0.8
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
neural chat 7b v3 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
go bruins v2.1.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-qzxjuip
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
models--automerger--Inex12Mergerix-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--mergekit-community--mergekit-slerp-eundxnq
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Models Mlabonne Gemma 3 1b It Abliterated
Gemma · MaziyarPanahi
Params1B
Context32K
Smallest0.8 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.1 Uncensored
Llama · MaziyarPanahi
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
calme 2.5 qwen2 7b
Qwen · MaziyarPanahi
Params7.62B
Context128K
Q4_K_M4.7 GB
CO
Models CyberNative AI Colibri_8b_v0.1
Colibri · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
ME
models--automerger--ShadowMeliodas-7B
Meliodas · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
smol 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Synatra 7B v0.3 RP Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
models--automerger--Experiment26Neuralsirkrishna-7B
Neuralsirkrishna · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
QwenSlerp7 14B
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
MI
models--mergekit-community--mergekit-slerp-lnhotro
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
v1olet marcoroni go bruins merge 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B claude instruct Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
models--mergekit-community--mergekit-slerp-fcxoywi
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
rfp instruct model Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
speechless mistral six in one 7b orth 1.0 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
ALLaM 7B Instruct Preview
Allam · MaziyarPanahi
Params7B
Context4K
Smallest4.9 GB
MI
japanese stablelm base gamma 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
Yi 9B 200K
Yi · MaziyarPanahi
Params8.83B
Context256K
Q4_K_M5.3 GB
NE
NeuralPipe 7B slerp
Neuralpipe · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Venomia 1.1 m7 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
samantha mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
piano medley 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB