GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
QV
Vikhrmodels/QVikhr-2.5-1.5B-Instruct-r
Qvikhr · MaziyarPanahi
Params1.54B
Context32K
Smallest1.1 GB
ST
models--automerger--T3qm7xStrangemerges_32-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
CabraQwen14b
Cabraqwen · MaziyarPanahi
Params14.2B
Context32K
Smallest10.0 GB
MI
SynthIA 7B v1.3 dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
KO
Kosmos EVAA v9 8B
Kosmos · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
QW
Qwen2.5 Coder 7B
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
LL
Llama 3 8B LexiFun Uncensored V1
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
SA
SAXON 0
Saxon · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
QW
Models Qwen Qwen2.5 Math 7B Instruct
Qwen · MaziyarPanahi
Params7.62B
Context4K
Smallest5.3 GB
NO
models--mergekit-community--mergekit-ties-vjlpsxw
Not · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 14B Unity
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
IC
IceWhiskeyRP 7b
Icewhiskeyrp · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
MI
smartyplats 7b v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
YA
models--automerger--YamMulti_verse_model-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Reasoning Llama 3b v0.1
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
LL
Llama 3.2 3B ToxicKod
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
NE
nepoticide 12B Unslop Unleashed Mell RPMax
Nepoticide · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
MI
Mini synata 7b 011 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.1 sharded Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
Models LGAI EXAONE EXAONE 4.0 1.2B
Exaone · MaziyarPanahi
Params1.28B
Context64K
Q4_K_M0.8 GB
MA
Orpheus 3b 0.1 Ft
Malaysian · MaziyarPanahi
Params3.78B
Context128K
Smallest2.7 GB
PA
models--mergekit-community--mergekit-ties-zwxzpdk
Patent · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
badger lambda llama 3 8b
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
VI
Models prithivMLmods Viper Coder HybridMini v1.3
Viper · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
ST
models--automerger--Strangemerges_32M7-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 7B LongPO 128K
Qwen · MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
FA
models--AgentPublic--Faust
Faust · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 3B RP Mix
Qwen · MaziyarPanahi
Params3.4B
Context32K
Smallest2.4 GB
QW
Qwen2.5 3B YOYO
Qwen · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
LL
Llama 3.1 8B SuperTulu LexiNova
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB