GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
MI
models--mergekit-community--Superevolution
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 Coder 0.5B QwQ draft
Qwen · MaziyarPanahi
Params494M
Context32K
Smallest0.4 GB
MI
MythoMist 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MY
models--automerger--MyriadStrangemerges_32-7B
Myriad · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
models--mergekit-community--mergekit-slerp-lvhhlmq
Gemma · MaziyarPanahi
Params2.51B
Context8K
Q4_K_M1.6 GB
TE
TEST2 Q2.5 Lenned 14B
Test · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
MI
Mistral 11B OmniMix Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
zephyr beta math Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--Experiment29Multi_verse_model-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
models--AgentPublic--albertlight-7b
Albertlight · MaziyarPanahi
Params13B
Context4K
Q4_K_M7.9 GB
BI
BioMedGPT LM 7B
Biomedgpt · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
Mistral 7b FFT Test3 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
samantha 1.2 mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
VI
MN Violet Lotus 12B
Violet · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
MI
tiledfloor Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
openchat 3.5 1210
Mistral · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
RE
ReasonFlux F1 7B
Reasonflux · MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
MI
openbuddy mistral 7b v13 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MixTAO 7Bx2 MoE Instruct v7.0
Mixtao · MaziyarPanahi
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
OpenHermes 2.5 neural chat 7b v3 1 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
bagel dpo 7b v0.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
llama3 8B DarkIdol 2.3 Uncensored 32K
Llama · MaziyarPanahi
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
models--AgentPublic--LlaMAndement-7b
Llama · MaziyarPanahi
Params6.74B
Context2K
Q4_K_M4.1 GB
MI
merlinite 7b
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Models Huihui Ai Qwen2.5 Coder 7B Instruct Abliterated
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
NY
L3 Nymeria Maid 8B
Nymeria · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
una cybertron 7b v3 OMA Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
OPEN SOLAR KO 10.7B
Open · MaziyarPanahi
Params10.9B
Context2K
Q4_K_M6.5 GB
OG
models--automerger--Strangemerges_32Ogno-7B
Ogno · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
KU
models--mergekit-community--Evolver
Kunoichi · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB