GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QV
Vikhrmodels/QVikhr-2.5-1.5B-Instruct-r
Qvikhr · MaziyarPanahi
Params1.54B
Context32K
Smallest1.1 GB
Tool use
ST
models--automerger--T3qm7xStrangemerges_32-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
CabraQwen14b
Cabraqwen · MaziyarPanahi
Params14.2B
Context32K
Smallest10.0 GB
GGUF
MI
SynthIA 7B v1.3 dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KO
Kosmos EVAA v9 8B
Kosmos · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
QW
Qwen2.5 Coder 7B
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
Coding
LL
Llama 3 8B LexiFun Uncensored V1
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
SA
SAXON 0
Saxon · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
QW
Models Qwen Qwen2.5 Math 7B Instruct
Qwen · MaziyarPanahi
Params7.62B
Context4K
Smallest5.3 GB
Tool use
NO
models--mergekit-community--mergekit-ties-vjlpsxw
Not · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 14B Unity
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
IC
IceWhiskeyRP 7b
Icewhiskeyrp · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
GGUF
MI
smartyplats 7b v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
models--automerger--YamMulti_verse_model-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Reasoning Llama 3b v0.1
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
Reasoning
LL
Llama 3.2 3B ToxicKod
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
Tool use
NE
nepoticide 12B Unslop Unleashed Mell RPMax
Nepoticide · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
MI
Mini synata 7b 011 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.1 sharded Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Models LGAI EXAONE EXAONE 4.0 1.2B
Exaone · MaziyarPanahi
Params1.28B
Context64K
Q4_K_M0.8 GB
ReasoningTool use
MA
Orpheus 3b 0.1 Ft
Malaysian · MaziyarPanahi
Params3.78B
Context128K
Smallest2.7 GB
Tool use
PA
models--mergekit-community--mergekit-ties-zwxzpdk
Patent · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
badger lambda llama 3 8b
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
VI
Models prithivMLmods Viper Coder HybridMini v1.3
Viper · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
CodingTool use
ST
models--automerger--Strangemerges_32M7-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 7B LongPO 128K
Qwen · MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
Tool use
FA
models--AgentPublic--Faust
Faust · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 3B RP Mix
Qwen · MaziyarPanahi
Params3.4B
Context32K
Smallest2.4 GB
RoleplayTool use
QW
Qwen2.5 3B YOYO
Qwen · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
Tool use
LL
Llama 3.1 8B SuperTulu LexiNova
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use

Keep browsing