GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
NE
NekoMix 12B
Nekomix · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
RY
RYS XLarge
Rys · MaziyarPanahi
Params78B
Context32K
Smallest24.3 GB
LL
Llama 8B Distill CoT
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
MI
Dans TotSirocco 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
models--automerger--M7T3qm7x-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.2 1b RandomLego RP R1 0.1
Llama · MaziyarPanahi
Params1.5B
Context128K
Smallest1.1 GB
QW
ZYH LLM Qwen2.5 14B V3
Qwen · MaziyarPanahi
Params14.8B
Context986K
Smallest10.3 GB
QW
Models OpenPipe Deductive Reasoning Qwen 14B
Qwen · MaziyarPanahi
Params10M
Context32K
Q4_K_M0.0 GB
MI
models--mergekit-community--mergekit-slerp-guwkdma
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 7B HomerAnvita NerdMix
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
MI
models--mergekit-community--mergekit-ties-cmdmayc
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Trismegistus 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
Captain Eris Violet V0.420 12B
Captain · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
MI
models--mergekit-community--mergekit-slerp-hsdezod
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 8B Uncensored 0.3c
Llama · MaziyarPanahi
Params8.03B
Context1024K
Smallest5.6 GB
XL
Models Salesforce xLAM 1b Fc R
Xlam · MaziyarPanahi
Params1.35B
Context16K
Smallest1.0 GB
SA
Sarvam 1
Sarvam · MaziyarPanahi
Params2.53B
Context8K
Smallest1.8 GB
OM
OGNO 7B
Omningotex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Models Malteos German R1
German · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
EM
EmojiLlama 3.1 8B
Emojillama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GE
Models Soob3123 Amoral Gemma3 4B
Gemma · MaziyarPanahi
Params3.88B
Context128K
Smallest2.8 GB
DE
natural sql 7b
DeepSeek · MaziyarPanahi
Params6.91B
Context4K
Q4_K_M4.2 GB
GE
MT Merge6 gemma 2 9B
Gemma · MaziyarPanahi
Params9.24B
Context8K
Smallest6.5 GB
MU
models--automerger--T3qm7xpMultiverseex26-7B
Multiverseex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
samantha 1.2 mistral 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
TIGERScore 13B
Tigerscore · MaziyarPanahi
Params13B
Context4K
Q4_K_M7.9 GB
QW
QwenStock1 14B
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
CA
Captain Eris Twighlight V0.420 12B
Captain · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
MI
LeoScorpius GreenNode Alpaca 7B v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
SauerkrautLM 7b HerO Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB