GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
NekoMix 12B
Nekomix · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
RY
RYS XLarge
Rys · MaziyarPanahi
Params78B
Context32K
Smallest24.3 GB
GGUF
LL
Llama 8B Distill CoT
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
MI
Dans TotSirocco 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
models--automerger--M7T3qm7x-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.2 1b RandomLego RP R1 0.1
Llama · MaziyarPanahi
Params1.5B
Context128K
Smallest1.1 GB
ReasoningRoleplayTool use
QW
ZYH LLM Qwen2.5 14B V3
Qwen · MaziyarPanahi
Params14.8B
Context986K
Smallest10.3 GB
Tool use
QW
Models OpenPipe Deductive Reasoning Qwen 14B
Qwen · MaziyarPanahi
Params10M
Context32K
Q4_K_M0.0 GB
ReasoningTool use
MI
models--mergekit-community--mergekit-slerp-guwkdma
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
QW
Qwen2.5 7B HomerAnvita NerdMix
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
Tool use
MI
models--mergekit-community--mergekit-ties-cmdmayc
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Trismegistus 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
Captain Eris Violet V0.420 12B
Captain · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
MI
models--mergekit-community--mergekit-slerp-hsdezod
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 8B Uncensored 0.3c
Llama · MaziyarPanahi
Params8.03B
Context1024K
Smallest5.6 GB
GGUF
XL
Models Salesforce xLAM 1b Fc R
Xlam · MaziyarPanahi
Params1.35B
Context16K
Smallest1.0 GB
Tool use
SA
Sarvam 1
Sarvam · MaziyarPanahi
Params2.53B
Context8K
Smallest1.8 GB
Tool use
OM
OGNO 7B
Omningotex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Models Malteos German R1
German · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
ReasoningTool use
EM
EmojiLlama 3.1 8B
Emojillama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
GE
Models Soob3123 Amoral Gemma3 4B
Gemma · MaziyarPanahi
Params3.88B
Context128K
Smallest2.8 GB
GGUF
DE
natural sql 7b
DeepSeek · MaziyarPanahi
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
GE
MT Merge6 gemma 2 9B
Gemma · MaziyarPanahi
Params9.24B
Context8K
Smallest6.5 GB
GGUF
MU
models--automerger--T3qm7xpMultiverseex26-7B
Multiverseex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
samantha 1.2 mistral 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
TIGERScore 13B
Tigerscore · MaziyarPanahi
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
QwenStock1 14B
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
CA
Captain Eris Twighlight V0.420 12B
Captain · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
MI
LeoScorpius GreenNode Alpaca 7B v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
SauerkrautLM 7b HerO Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing